2020-06-12T02:20:29.890 INFO:root:teuthology version: 1.0.0-6c966fe 2020-06-12T02:20:29.892 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027 --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} --owner scheduled_kchai@teuthology --lock --block --name kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi --verbose -- /tmp/teuthology-worker.lvpuqokl.tmp 2020-06-12T02:20:29.929 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:20:30.017 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027 branch: octopus description: rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} email: tchaikov@gmail.com first_in_suite: false job_id: '5138027' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: octopus ceph: conf: global: enable experimental unrecoverable data corrupting features: '*' mon client directed command retry: 5 ms inject socket failures: 2500 ms tcp read timeout: 5 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 2 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true create_rbd_pool: false fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request pre-mgr-commands: - sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 disable_objectstore_tool_tests: true workunit: branch: octopus-py3 sha1: 1e0d5d60071d5554f87a2be72ea0bcccb272aab3 owner: scheduled_kchai@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 sleep_before_teardown: 0 suite: rados suite_branch: octopus-py3 suite_path: /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa suite_relpath: qa suite_repo: https://github.com/tchaikov/ceph.git suite_sha1: 1e0d5d60071d5554f87a2be72ea0bcccb272aab3 tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: chance_test_min_size: 3 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_use_overwrites: true objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.8463 2020-06-12T02:20:30.018 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa; will attempt to use it 2020-06-12T02:20:30.019 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks 2020-06-12T02:20:30.019 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-06-12T02:20:30.021 INFO:teuthology.task.internal:Checking packages... 2020-06-12T02:20:30.047 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '91d24f498556f86f6d1318d2efd5210c35b36762' 2020-06-12T02:20:30.047 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-06-12T02:20:30.048 INFO:teuthology.packaging:ref: None 2020-06-12T02:20:30.048 INFO:teuthology.packaging:tag: None 2020-06-12T02:20:30.049 INFO:teuthology.packaging:branch: octopus 2020-06-12T02:20:30.049 INFO:teuthology.packaging:sha1: 91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:20:30.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2020-06-12T02:20:30.361 INFO:teuthology.task.internal:Found packages for ceph version 15.2.3-298-g7488806bf1-1bionic 2020-06-12T02:20:30.362 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-06-12T02:20:30.372 INFO:teuthology.task.internal:no buildpackages task found 2020-06-12T02:20:30.373 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-06-12T02:20:30.390 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-06-12T02:20:30.391 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:20:30.452 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T02:20:40.470 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T02:20:50.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T02:21:00.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-06-12T02:21:10.533 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027'} 2020-06-12T02:21:10.563 DEBUG:teuthology.lock.ops:locked ubuntu@smithi142.front.sepia.ceph.com, ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:21:10.630 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f78e5ac9ae8>, signals=[15]) 2020-06-12T02:21:10.853 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 18.04 2020-06-12T02:21:10.859 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 18.04 2020-06-12T02:21:11.336 INFO:teuthology.orchestra.console:Power off smithi142 2020-06-12T02:21:11.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T02:21:11.369 INFO:teuthology.orchestra.console:Power off smithi117 2020-06-12T02:21:11.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-06-12T02:21:11.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:11.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:15.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:15.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:19.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:19.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:23.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:23.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:23.888 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2020-06-12T02:21:23.902 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2020-06-12T02:21:23.990 INFO:teuthology.orchestra.console:Power on smithi142 2020-06-12T02:21:23.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T02:21:24.008 INFO:teuthology.orchestra.console:Power on smithi117 2020-06-12T02:21:24.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-06-12T02:21:24.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:24.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:28.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:28.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-06-12T02:21:28.278 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2020-06-12T02:21:28.291 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2020-06-12T02:21:28.380 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2020-06-12T02:21:28.393 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2020-06-12T02:24:14.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:24:30.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:24:39.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:24:48.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:24:57.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:06.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:15.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:21.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:24.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:45.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:51.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:51.567 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:25:56.194 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:25:57.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:25:57.583 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:01.566 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:02.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:02.211 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:03.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:03.598 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:08.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:09.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:09.613 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:14.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:14.242 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:15.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:15.626 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:20.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:20.258 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-06-12T02:26:21.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:21.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T02:26:21.712 INFO:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T02:26:22.034 INFO:teuthology.provision.fog.smithi142:Node is ready 2020-06-12T02:26:22.034 INFO:teuthology.orchestra.run.smithi142:> hostname 2020-06-12T02:26:22.081 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2020-06-12T02:26:22.082 INFO:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2020-06-12T02:26:22.135 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2020-06-12T02:26:22.136 INFO:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2020-06-12T02:26:22.235 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2020-06-12T02:26:22.290 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2020-06-12T02:26:22.347 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2020-06-12T02:26:22.407 INFO:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2020-06-12T02:26:22.465 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2020-06-12T02:26:22.466 DEBUG:teuthology.parallel:result is None 2020-06-12T02:26:26.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:26.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-06-12T02:26:26.345 INFO:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-06-12T02:26:26.675 INFO:teuthology.provision.fog.smithi117:Node is ready 2020-06-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi117:> hostname 2020-06-12T02:26:26.724 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2020-06-12T02:26:26.724 INFO:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2020-06-12T02:26:26.772 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2020-06-12T02:26:26.773 INFO:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2020-06-12T02:26:26.940 INFO:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2020-06-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2020-06-12T02:26:27.014 INFO:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2020-06-12T02:26:27.068 INFO:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2020-06-12T02:26:27.125 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2020-06-12T02:26:27.126 DEBUG:teuthology.parallel:result is None 2020-06-12T02:26:27.338 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2020-06-12T02:26:27.340 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T02:26:27.370 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2020-06-12T02:26:27.371 INFO:teuthology.lock.ops:New key found. Updating... 2020-06-12T02:26:27.393 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2020-06-12T02:26:27.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:26:27.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:27.487 INFO:teuthology.orchestra.run.smithi142:> true 2020-06-12T02:26:27.727 INFO:teuthology.orchestra.run.smithi142:> uname -m 2020-06-12T02:26:27.782 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2020-06-12T02:26:27.783 INFO:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2020-06-12T02:26:27.832 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2020-06-12T02:26:27.832 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-06-12T02:26:27.833 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2020-06-12T02:26:27.833 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2020-06-12T02:26:27.833 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-06-12T02:26:27.834 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="18.04" 2020-06-12T02:26:27.834 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2020-06-12T02:26:27.834 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-06-12T02:26:27.835 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-06-12T02:26:27.835 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-06-12T02:26:27.835 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=bionic 2020-06-12T02:26:27.836 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=bionic 2020-06-12T02:26:27.838 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2020-06-12T02:26:27.877 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2020-06-12T02:26:27.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:26:27.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:27.987 INFO:teuthology.orchestra.run.smithi117:> true 2020-06-12T02:26:28.212 INFO:teuthology.orchestra.run.smithi117:> uname -m 2020-06-12T02:26:28.259 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2020-06-12T02:26:28.260 INFO:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2020-06-12T02:26:28.309 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2020-06-12T02:26:28.309 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-06-12T02:26:28.309 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2020-06-12T02:26:28.310 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2020-06-12T02:26:28.310 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-06-12T02:26:28.310 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="18.04" 2020-06-12T02:26:28.310 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2020-06-12T02:26:28.310 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-06-12T02:26:28.311 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-06-12T02:26:28.311 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-06-12T02:26:28.311 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=bionic 2020-06-12T02:26:28.311 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=bionic 2020-06-12T02:26:28.312 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2020-06-12T02:26:28.337 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-06-12T02:26:28.385 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC99cai4valUcmR5vgSmhUVGkNsbWrGei6z1qACoMzBOr+H8C5nKeRaByOyf/y4A/t/fE4NMc1+qCK7Pku/nWAQ+OubzIMv3e2VXN8MGwsjayE3l50LUw+Wd+qg2ckOmdZa+ldj2mbXIwyZSwUCS1SKHZp84ImvYK5gJSS35Xki3GiqacVvFvXr0Tfq9rZRkcDy2H5QNZMsz6xI5LOXUyhHc53tdy+5WqoRGvVUDwZopKj8OXCPk8hHgVp/l3JX9CkTHZg+qh3HBzdzhCDe3dpinLG+B6GIMxiASQEPBYBrH9q1edjnaHbis7sbVUWyHAuVWJArkAT2K+NcgoD5EUBp smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcZCHhPvTlDmeMXHJYX4Ngg/3hDNaKEJP/Oax7P4WM361db5mpRSaaUoU7PP9UOAxhPYNs298IdY/LgV5UWAXcsTxX9fs437t4pqpbpjTKoTjqOjMpQLRDxtbX7O/mes++0SzJ1DgmL0LTnnia7w8QaKu0JhVVJbAmwWarvANbc+KEKs9ICqCKrmmZhoE9yxU+fiQm7HZ6D/97dTnzX86XGeIxnT033lLpzlNqvgEqUEt/zOI5aScvQsEsdS1RCa0Cl9TETVhMQYz5wayzxT+vFEmXA5g/oQtvxpYKpyDKaB7bNJMwqksvVZ/iBrtxe4+5BsEznW/+KGpV8J+kdqRn 2020-06-12T02:26:28.385 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-06-12T02:26:28.451 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-06-12T02:26:28.478 INFO:teuthology.task.internal:Saving configuration 2020-06-12T02:26:28.508 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-06-12T02:26:28.524 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-06-12T02:26:28.545 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 02:21:10.541639', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILwEpmPFrdtj61yoQDjPMvfv1P6Jc3jyHuOJ7hK77wfk', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi142.front.sepia.ceph.com'} 2020-06-12T02:26:28.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-06-12 02:21:10.541661', 'description': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH10FhfCoNRA+E1yWAJKA/wjPYu7QAGzGz9cFDpS7Y8r', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi117.front.sepia.ceph.com'} 2020-06-12T02:26:28.565 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-06-12T02:26:28.576 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-06-12T02:26:28.576 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-06-12T02:26:28.576 INFO:teuthology.run_tasks:Running task console_log... 2020-06-12T02:26:28.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f78e5a4d7b8>, signals=[15]) 2020-06-12T02:26:28.676 INFO:teuthology.run_tasks:Running task internal.connect... 2020-06-12T02:26:28.686 INFO:teuthology.task.internal:Opening connections... 2020-06-12T02:26:28.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:26:28.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:28.804 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:26:28.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:26:28.885 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-06-12T02:26:28.895 INFO:teuthology.orchestra.run.smithi142:> uname -m 2020-06-12T02:26:29.001 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2020-06-12T02:26:29.001 INFO:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2020-06-12T02:26:29.051 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2020-06-12T02:26:29.052 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-06-12T02:26:29.052 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2020-06-12T02:26:29.052 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2020-06-12T02:26:29.052 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-06-12T02:26:29.053 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="18.04" 2020-06-12T02:26:29.053 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2020-06-12T02:26:29.053 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-06-12T02:26:29.053 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-06-12T02:26:29.053 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-06-12T02:26:29.062 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=bionic 2020-06-12T02:26:29.062 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=bionic 2020-06-12T02:26:29.062 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2020-06-12T02:26:29.086 INFO:teuthology.orchestra.run.smithi117:> uname -m 2020-06-12T02:26:29.091 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2020-06-12T02:26:29.092 INFO:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2020-06-12T02:26:29.138 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2020-06-12T02:26:29.139 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="18.04.4 LTS (Bionic Beaver)" 2020-06-12T02:26:29.139 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2020-06-12T02:26:29.139 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2020-06-12T02:26:29.139 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 18.04.4 LTS" 2020-06-12T02:26:29.140 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="18.04" 2020-06-12T02:26:29.140 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2020-06-12T02:26:29.140 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-06-12T02:26:29.140 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-06-12T02:26:29.140 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-06-12T02:26:29.141 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=bionic 2020-06-12T02:26:29.141 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=bionic 2020-06-12T02:26:29.141 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2020-06-12T02:26:29.161 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-06-12T02:26:29.178 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-06-12T02:26:29.189 INFO:teuthology.task.internal:Checking for old test directory... 2020-06-12T02:26:29.189 INFO:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2020-06-12T02:26:29.192 INFO:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2020-06-12T02:26:29.197 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-06-12T02:26:29.214 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-06-12T02:26:29.216 INFO:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2020-06-12T02:26:29.237 INFO:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2020-06-12T02:26:29.258 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-06-12T02:26:29.302 INFO:teuthology.run_tasks:Running task kernel... 2020-06-12T02:26:29.324 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2020-06-12T02:26:29.325 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-06-12T02:26:29.325 INFO:teuthology.orchestra.run.smithi142:> uname -r 2020-06-12T02:26:29.333 INFO:teuthology.orchestra.run.smithi142.stdout:4.15.0-101-generic 2020-06-12T02:26:29.333 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.15.0-101-generic 2020-06-12T02:26:29.334 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2020-06-12T02:26:29.468 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-06-12T02:26:29.618 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-06-12T02:26:29.737 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:26:29.818 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-06-12T02:26:29.870 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [484 kB] 2020-06-12T02:26:29.955 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [746 kB] 2020-06-12T02:26:29.982 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [236 kB] 2020-06-12T02:26:30.001 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [50.8 kB] 2020-06-12T02:26:30.002 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [12.3 kB] 2020-06-12T02:26:30.002 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [673 kB] 2020-06-12T02:26:30.003 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [624 kB] 2020-06-12T02:26:30.010 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [223 kB] 2020-06-12T02:26:30.019 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [7,808 B] 2020-06-12T02:26:30.020 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,288 B] 2020-06-12T02:26:30.020 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,856 B] 2020-06-12T02:26:30.074 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-06-12T02:26:30.239 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [694 kB] 2020-06-12T02:26:30.433 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [969 kB] 2020-06-12T02:26:30.534 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [329 kB] 2020-06-12T02:26:30.575 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [60.5 kB] 2020-06-12T02:26:30.575 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [14.7 kB] 2020-06-12T02:26:30.576 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,081 kB] 2020-06-12T02:26:30.618 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,018 kB] 2020-06-12T02:26:30.655 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [336 kB] 2020-06-12T02:26:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [15.9 kB] 2020-06-12T02:26:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [8,720 B] 2020-06-12T02:26:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,420 B] 2020-06-12T02:26:31.462 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 7,849 kB in 2s (4,470 kB/s) 2020-06-12T02:26:32.924 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:26:32.972 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-06-12T02:26:33.065 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:26:33.316 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-06-12T02:26:33.317 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-06-12T02:26:33.397 INFO:teuthology.orchestra.run.smithi142.stderr:E: Unable to locate package linux-image-current-generic 2020-06-12T02:26:33.405 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-06-12T02:26:33.412 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-06-12T02:26:33.490 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:26:33.711 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-06-12T02:26:33.712 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-06-12T02:26:33.877 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2020-06-12T02:26:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-4.15.0-106 linux-headers-4.15.0-106-generic 2020-06-12T02:26:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-generic linux-image-4.15.0-106-generic 2020-06-12T02:26:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-4.15.0-106-generic linux-modules-extra-4.15.0-106-generic 2020-06-12T02:26:33.878 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2020-06-12T02:26:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-06-12T02:26:33.879 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2020-06-12T02:26:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: thermald 2020-06-12T02:26:33.916 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2020-06-12T02:26:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-4.15.0-106 linux-headers-4.15.0-106-generic 2020-06-12T02:26:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-4.15.0-106-generic linux-modules-4.15.0-106-generic 2020-06-12T02:26:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-extra-4.15.0-106-generic 2020-06-12T02:26:33.917 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2020-06-12T02:26:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-generic linux-image-generic 2020-06-12T02:26:34.092 INFO:teuthology.orchestra.run.smithi142.stdout:3 upgraded, 5 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:26:34.116 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 65.8 MB of archives. 2020-06-12T02:26:34.116 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 333 MB of additional disk space will be used. 2020-06-12T02:26:34.116 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-106-generic amd64 4.15.0-106.107 [13.0 MB] 2020-06-12T02:26:35.080 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-106-generic amd64 4.15.0-106.107 [8,008 kB] 2020-06-12T02:26:35.277 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-106-generic amd64 4.15.0-106.107 [32.8 MB] 2020-06-12T02:26:36.219 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.106.94 [1,868 B] 2020-06-12T02:26:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.106.94 [2,472 B] 2020-06-12T02:26:36.220 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-106 all 4.15.0-106.107 [10.9 MB] 2020-06-12T02:26:36.509 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-106-generic amd64 4.15.0-106.107 [1,098 kB] 2020-06-12T02:26:36.551 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.106.94 [2,432 B] 2020-06-12T02:26:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 65.8 MB in 3s (25.1 MB/s) 2020-06-12T02:26:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-4.15.0-106-generic. 2020-06-12T02:26:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102026 files and directories currently installed.) 2020-06-12T02:26:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../0-linux-modules-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:26:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:38.868 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-4.15.0-106-generic. 2020-06-12T02:26:38.878 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../1-linux-image-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:26:38.967 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:39.472 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-106-generic. 2020-06-12T02:26:39.482 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:26:39.520 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-extra-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:43.180 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../3-linux-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:26:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:26:43.610 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:26:43.869 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:26:44.237 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-4.15.0-106. 2020-06-12T02:26:44.250 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../5-linux-headers-4.15.0-106_4.15.0-106.107_all.deb ... 2020-06-12T02:26:44.288 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-4.15.0-106 (4.15.0-106.107) ... 2020-06-12T02:26:49.608 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-4.15.0-106-generic. 2020-06-12T02:26:49.628 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../6-linux-headers-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:26:49.682 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:52.043 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:26:52.164 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:26:52.521 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-4.15.0-106 (4.15.0-106.107) ... 2020-06-12T02:26:52.637 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:53.170 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:53.654 INFO:teuthology.orchestra.run.smithi142.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:26:53.655 INFO:teuthology.orchestra.run.smithi142.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-106-generic 2020-06-12T02:26:53.788 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:53.914 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-extra-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:54.474 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-generic (4.15.0.106.94) ... 2020-06-12T02:26:54.575 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-generic (4.15.0.106.94) ... 2020-06-12T02:26:54.676 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-generic (4.15.0.106.94) ... 2020-06-12T02:26:54.777 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:26:54.971 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-06-12T02:26:54.972 INFO:teuthology.orchestra.run.smithi142.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:27:10.032 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-06-12T02:27:10.033 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub' 2020-06-12T02:27:10.079 INFO:teuthology.orchestra.run.smithi142.stdout:Generating grub configuration file ... 2020-06-12T02:27:10.404 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:27:10.746 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-4.15.0-101-generic 2020-06-12T02:27:10.771 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-4.15.0-101-generic 2020-06-12T02:27:11.672 INFO:teuthology.orchestra.run.smithi142.stdout:done 2020-06-12T02:27:12.099 INFO:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2020-06-12T02:27:12.125 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2020-06-12T02:27:12.125 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2020-06-12T02:27:12.125 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2020-06-12T02:27:12.126 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2020-06-12T02:27:12.126 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 16 2020-06-12T02:27:12.126 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2020-06-12T02:27:12.126 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2020-06-12T02:27:12.126 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 4.15.0.106.94 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-4.15.0-106-generic, linux-modules-extra-4.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2020-06-12T02:27:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2020-06-12T02:27:12.128 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-101-generic Expected: 4.15.0-106-generic 2020-06-12T02:27:12.129 INFO:teuthology.orchestra.run.smithi117:> uname -r 2020-06-12T02:27:12.135 INFO:teuthology.orchestra.run.smithi117.stdout:4.15.0-101-generic 2020-06-12T02:27:12.136 INFO:teuthology.task.kernel:Running kernel on smithi117: 4.15.0-101-generic 2020-06-12T02:27:12.136 INFO:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2020-06-12T02:27:12.270 INFO:teuthology.orchestra.run.smithi117:> sudo apt-get update 2020-06-12T02:27:12.402 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-06-12T02:27:12.523 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:27:12.604 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-06-12T02:27:12.667 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [484 kB] 2020-06-12T02:27:12.764 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [746 kB] 2020-06-12T02:27:12.788 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [236 kB] 2020-06-12T02:27:12.794 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [50.8 kB] 2020-06-12T02:27:12.796 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [12.3 kB] 2020-06-12T02:27:12.796 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [673 kB] 2020-06-12T02:27:12.815 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [624 kB] 2020-06-12T02:27:12.826 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [223 kB] 2020-06-12T02:27:12.830 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,288 B] 2020-06-12T02:27:12.830 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [7,808 B] 2020-06-12T02:27:12.830 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,856 B] 2020-06-12T02:27:12.860 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-06-12T02:27:12.953 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [694 kB] 2020-06-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [969 kB] 2020-06-12T02:27:13.337 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [329 kB] 2020-06-12T02:27:13.365 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [60.5 kB] 2020-06-12T02:27:13.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [14.7 kB] 2020-06-12T02:27:13.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,081 kB] 2020-06-12T02:27:13.428 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,018 kB] 2020-06-12T02:27:13.464 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [336 kB] 2020-06-12T02:27:13.480 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [8,720 B] 2020-06-12T02:27:13.481 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [15.9 kB] 2020-06-12T02:27:13.481 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,420 B] 2020-06-12T02:27:14.160 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 7,849 kB in 2s (4,722 kB/s) 2020-06-12T02:27:15.582 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:27:15.627 INFO:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-06-12T02:27:15.722 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:27:15.946 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2020-06-12T02:27:15.946 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2020-06-12T02:27:16.020 INFO:teuthology.orchestra.run.smithi117.stderr:E: Unable to locate package linux-image-current-generic 2020-06-12T02:27:16.021 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-06-12T02:27:16.028 INFO:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-06-12T02:27:16.116 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:27:16.351 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2020-06-12T02:27:16.351 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2020-06-12T02:27:16.510 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2020-06-12T02:27:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-4.15.0-106 linux-headers-4.15.0-106-generic 2020-06-12T02:27:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-4.15.0-106-generic 2020-06-12T02:27:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-4.15.0-106-generic linux-modules-extra-4.15.0-106-generic 2020-06-12T02:27:16.512 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2020-06-12T02:27:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-06-12T02:27:16.513 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2020-06-12T02:27:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2020-06-12T02:27:16.543 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2020-06-12T02:27:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-4.15.0-106 linux-headers-4.15.0-106-generic 2020-06-12T02:27:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-4.15.0-106-generic linux-modules-4.15.0-106-generic 2020-06-12T02:27:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-4.15.0-106-generic 2020-06-12T02:27:16.545 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2020-06-12T02:27:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2020-06-12T02:27:16.727 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:27:16.728 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 65.8 MB of archives. 2020-06-12T02:27:16.728 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 333 MB of additional disk space will be used. 2020-06-12T02:27:16.728 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-106-generic amd64 4.15.0-106.107 [13.0 MB] 2020-06-12T02:27:17.731 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-106-generic amd64 4.15.0-106.107 [8,008 kB] 2020-06-12T02:27:17.925 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-106-generic amd64 4.15.0-106.107 [32.8 MB] 2020-06-12T02:27:18.840 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.106.94 [1,868 B] 2020-06-12T02:27:18.841 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.106.94 [2,472 B] 2020-06-12T02:27:18.841 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-106 all 4.15.0-106.107 [10.9 MB] 2020-06-12T02:27:19.153 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-106-generic amd64 4.15.0-106.107 [1,098 kB] 2020-06-12T02:27:19.188 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.106.94 [2,432 B] 2020-06-12T02:27:19.679 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 65.8 MB in 3s (25.1 MB/s) 2020-06-12T02:27:19.838 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-4.15.0-106-generic. 2020-06-12T02:27:19.874 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102026 files and directories currently installed.) 2020-06-12T02:27:19.877 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:27:19.931 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:21.505 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-4.15.0-106-generic. 2020-06-12T02:27:21.518 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:27:21.623 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:22.125 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-106-generic. 2020-06-12T02:27:22.137 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:27:22.178 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:25.938 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:27:26.067 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:27:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:27:26.503 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:27:26.840 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-4.15.0-106. 2020-06-12T02:27:26.853 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-4.15.0-106_4.15.0-106.107_all.deb ... 2020-06-12T02:27:26.890 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-4.15.0-106 (4.15.0-106.107) ... 2020-06-12T02:27:31.969 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-4.15.0-106-generic. 2020-06-12T02:27:31.990 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-4.15.0-106-generic_4.15.0-106.107_amd64.deb ... 2020-06-12T02:27:32.027 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:34.420 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.106.94_amd64.deb ... 2020-06-12T02:27:34.529 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (4.15.0.106.94) over (4.15.0.101.91) ... 2020-06-12T02:27:34.857 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-4.15.0-106 (4.15.0-106.107) ... 2020-06-12T02:27:34.992 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:35.535 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:35.965 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:27:35.965 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-106-generic 2020-06-12T02:27:36.104 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:36.230 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:36.756 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (4.15.0.106.94) ... 2020-06-12T02:27:36.882 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (4.15.0.106.94) ... 2020-06-12T02:27:37.000 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (4.15.0.106.94) ... 2020-06-12T02:27:37.110 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-4.15.0-106-generic (4.15.0-106.107) ... 2020-06-12T02:27:37.307 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-06-12T02:27:37.308 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:27:53.108 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-06-12T02:27:53.109 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2020-06-12T02:27:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2020-06-12T02:27:53.501 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:27:53.530 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:27:53.863 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-4.15.0-101-generic 2020-06-12T02:27:53.890 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-4.15.0-101-generic 2020-06-12T02:27:55.252 INFO:teuthology.orchestra.run.smithi117.stdout:done 2020-06-12T02:27:55.699 INFO:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2020-06-12T02:27:55.726 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2020-06-12T02:27:55.726 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2020-06-12T02:27:55.726 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2020-06-12T02:27:55.727 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2020-06-12T02:27:55.727 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 16 2020-06-12T02:27:55.727 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2020-06-12T02:27:55.727 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 4.15.0.106.94 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-4.15.0-106-generic, linux-modules-extra-4.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2020-06-12T02:27:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2020-06-12T02:27:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2020-06-12T02:27:55.729 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-101-generic Expected: 4.15.0-106-generic 2020-06-12T02:27:55.730 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-06-12T02:27:55.730 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-06-12T02:27:55.730 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-06-12T02:27:55.731 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-06-12T02:27:55.731 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2020-06-12T02:27:55.731 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2020-06-12T02:27:55.842 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-06-12T02:27:55.970 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-06-12T02:27:56.103 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:27:56.184 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-06-12T02:27:56.265 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-06-12T02:27:58.054 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:27:58.100 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-06-12T02:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:27:58.416 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-06-12T02:27:58.417 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-06-12T02:27:58.496 INFO:teuthology.orchestra.run.smithi142.stderr:E: Unable to locate package linux-image-current-generic 2020-06-12T02:27:58.496 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-06-12T02:27:58.497 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-06-12T02:27:58.596 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:27:58.822 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-06-12T02:27:58.823 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-06-12T02:27:59.010 INFO:teuthology.orchestra.run.smithi142.stdout:linux-image-generic is already the newest version (4.15.0.106.94). 2020-06-12T02:27:59.011 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:27:59.012 INFO:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2020-06-12T02:27:59.027 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2020-06-12T02:27:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2020-06-12T02:27:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2020-06-12T02:27:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2020-06-12T02:27:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 16 2020-06-12T02:27:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2020-06-12T02:27:59.029 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2020-06-12T02:27:59.029 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2020-06-12T02:27:59.029 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 4.15.0.106.94 2020-06-12T02:27:59.029 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-4.15.0-106-generic, linux-modules-extra-4.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2020-06-12T02:27:59.029 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2020-06-12T02:27:59.031 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2020-06-12T02:27:59.032 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2020-06-12T02:27:59.032 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2020-06-12T02:27:59.032 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:27:59.073 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.ITeWgaTEUR 2020-06-12T02:27:59.073 INFO:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ITeWgaTEUR 2020-06-12T02:27:59.124 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.ITeWgaTEUR 2020-06-12T02:27:59.248 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.ITeWgaTEUR is 8KB 2020-06-12T02:27:59.320 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.ITeWgaTEUR 2020-06-12T02:27:59.328 INFO:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-06-12T02:27:59.383 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-06-12T02:27:59.484 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-106-generic 2020-06-12T02:27:59.485 INFO:teuthology.orchestra.run.smithi142:> sudo update-grub 2020-06-12T02:28:00.723 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2020-06-12T02:28:00.749 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2020-06-12T02:28:01.018 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:28:01.029 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:28:01.331 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-4.15.0-101-generic 2020-06-12T02:28:01.344 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-4.15.0-101-generic 2020-06-12T02:28:01.944 INFO:teuthology.orchestra.run.smithi142.stderr:done 2020-06-12T02:28:01.945 INFO:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2020-06-12T02:28:01.947 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-06-12T02:28:01.948 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2020-06-12T02:28:01.948 INFO:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2020-06-12T02:28:02.023 INFO:teuthology.orchestra.run.smithi117:> sudo apt-get update 2020-06-12T02:28:02.273 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-06-12T02:28:02.273 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:28:02.343 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-06-12T02:28:02.423 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-06-12T02:28:04.164 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:28:04.208 INFO:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-06-12T02:28:04.302 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:28:04.528 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2020-06-12T02:28:04.528 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2020-06-12T02:28:04.605 INFO:teuthology.orchestra.run.smithi117.stderr:E: Unable to locate package linux-image-current-generic 2020-06-12T02:28:04.606 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-06-12T02:28:04.606 INFO:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-06-12T02:28:04.690 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:28:04.908 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2020-06-12T02:28:04.909 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2020-06-12T02:28:05.096 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (4.15.0.106.94). 2020-06-12T02:28:05.096 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:28:05.097 INFO:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2020-06-12T02:28:05.117 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2020-06-12T02:28:05.118 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2020-06-12T02:28:05.118 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2020-06-12T02:28:05.118 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2020-06-12T02:28:05.119 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 16 2020-06-12T02:28:05.119 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2020-06-12T02:28:05.119 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2020-06-12T02:28:05.119 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2020-06-12T02:28:05.121 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 4.15.0.106.94 2020-06-12T02:28:05.121 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-4.15.0-106-generic, linux-modules-extra-4.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2020-06-12T02:28:05.121 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2020-06-12T02:28:05.122 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2020-06-12T02:28:05.122 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2020-06-12T02:28:05.122 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2020-06-12T02:28:05.122 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:28:05.163 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.w1TJyP9vmN 2020-06-12T02:28:05.164 INFO:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.w1TJyP9vmN 2020-06-12T02:28:05.229 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.w1TJyP9vmN 2020-06-12T02:28:05.369 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.w1TJyP9vmN is 8KB 2020-06-12T02:28:05.420 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.w1TJyP9vmN 2020-06-12T02:28:05.427 INFO:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-06-12T02:28:05.484 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-06-12T02:28:05.586 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-106-generic 2020-06-12T02:28:05.586 INFO:teuthology.orchestra.run.smithi117:> sudo update-grub 2020-06-12T02:28:06.904 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2020-06-12T02:28:06.926 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2020-06-12T02:28:07.172 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-4.15.0-106-generic 2020-06-12T02:28:07.185 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-4.15.0-106-generic 2020-06-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-4.15.0-101-generic 2020-06-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-4.15.0-101-generic 2020-06-12T02:28:08.577 INFO:teuthology.orchestra.run.smithi117.stderr:done 2020-06-12T02:28:08.578 INFO:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2020-06-12T02:28:38.610 INFO:teuthology.misc:Re-opening connections... 2020-06-12T02:28:38.612 INFO:teuthology.misc:trying to connect to ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:28:38.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:28:38.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:38.618 DEBUG:teuthology.orchestra.remote:timed out 2020-06-12T02:29:38.621 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:29:38.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:38.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:38.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2020-06-12T02:29:38.629 DEBUG:teuthology.misc:waited 60.01746463775635 2020-06-12T02:29:39.630 INFO:teuthology.misc:trying to connect to ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:29:39.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:39.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:39.835 INFO:teuthology.orchestra.run.smithi142:> true 2020-06-12T02:29:40.787 DEBUG:teuthology.misc:waited 62.174965620040894 2020-06-12T02:29:41.788 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:29:41.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:41.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:41.791 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2020-06-12T02:29:41.792 DEBUG:teuthology.misc:waited 63.180103063583374 2020-06-12T02:29:42.794 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:29:42.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:42.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:42.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2020-06-12T02:29:42.798 DEBUG:teuthology.misc:waited 64.18608808517456 2020-06-12T02:29:43.799 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:29:43.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:43.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:44.025 DEBUG:teuthology.orchestra.remote:No existing session 2020-06-12T02:29:44.034 DEBUG:teuthology.misc:waited 65.42216372489929 2020-06-12T02:29:45.043 INFO:teuthology.misc:trying to connect to ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:29:45.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:29:45.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:29:45.106 INFO:teuthology.orchestra.run.smithi117:> true 2020-06-12T02:29:45.717 DEBUG:teuthology.misc:waited 67.10484528541565 2020-06-12T02:29:46.718 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-06-12T02:29:46.719 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-106-generic"... 2020-06-12T02:29:46.719 INFO:teuthology.orchestra.run.smithi142:> uname -r 2020-06-12T02:29:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:4.15.0-106-generic 2020-06-12T02:29:46.731 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-106-generic vs 4.15.0-106-generic 2020-06-12T02:29:46.731 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-06-12T02:29:46.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-06-12T02:29:46.732 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-106-generic"... 2020-06-12T02:29:46.732 INFO:teuthology.orchestra.run.smithi117:> uname -r 2020-06-12T02:29:46.741 INFO:teuthology.orchestra.run.smithi117.stdout:4.15.0-106-generic 2020-06-12T02:29:46.742 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-106-generic vs 4.15.0-106-generic 2020-06-12T02:29:46.742 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-06-12T02:29:47.743 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-06-12T02:29:47.743 INFO:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-12T02:29:47.789 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2020-06-12T02:29:47.812 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-06-12T02:29:47.812 INFO:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-06-12T02:29:47.853 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2020-06-12T02:29:47.882 INFO:teuthology.run_tasks:Running task internal.base... 2020-06-12T02:29:47.890 INFO:teuthology.task.internal:Creating test directory... 2020-06-12T02:29:47.891 INFO:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-12T02:29:47.926 INFO:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-06-12T02:29:47.933 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-06-12T02:29:47.944 INFO:teuthology.run_tasks:Running task internal.archive... 2020-06-12T02:29:47.958 INFO:teuthology.task.internal:Creating archive directory... 2020-06-12T02:29:47.958 INFO:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-12T02:29:47.973 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-06-12T02:29:47.988 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-06-12T02:29:47.998 INFO:teuthology.task.internal:Enabling coredump saving... 2020-06-12T02:29:47.999 INFO:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-12T02:29:48.029 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-06-12T02:29:48.047 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T02:29:48.049 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T02:29:48.059 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T02:29:48.060 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-06-12T02:29:48.061 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-06-12T02:29:48.071 INFO:teuthology.task.internal:Configuring sudo... 2020-06-12T02:29:48.072 INFO:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-12T02:29:48.105 INFO:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-06-12T02:29:48.121 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-06-12T02:29:48.133 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-06-12T02:29:48.134 INFO:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-12T02:29:48.161 INFO:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-06-12T02:29:48.171 INFO:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T02:29:48.220 INFO:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T02:29:48.267 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-12T02:29:48.355 INFO:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-06-12T02:29:48.362 INFO:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-06-12T02:29:48.410 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-06-12T02:29:48.506 INFO:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2020-06-12T02:29:48.550 INFO:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2020-06-12T02:29:48.612 INFO:teuthology.run_tasks:Running task internal.timer... 2020-06-12T02:29:48.628 INFO:teuthology.task.internal:Starting timer... 2020-06-12T02:29:48.629 INFO:teuthology.run_tasks:Running task pcp... 2020-06-12T02:29:48.650 INFO:teuthology.run_tasks:Running task selinux... 2020-06-12T02:29:48.662 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2020-06-12T02:29:48.663 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2020-06-12T02:29:48.663 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-06-12T02:29:48.664 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-06-12T02:29:48.664 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-06-12T02:29:48.664 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-06-12T02:29:48.680 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-06-12T02:29:48.681 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-06-12T02:29:48.713 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-06-12T02:29:48.716 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-06-12T02:29:49.100 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-06-12T02:29:50.075 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-06-12T02:29:52.473 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-06-12T02:29:52.500 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:52 +0000 (0:00:00.078) 0:00:00.078 *********** 2020-06-12T02:29:52.516 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:52 +0000 (0:00:00.016) 0:00:00.094 *********** 2020-06-12T02:29:54.255 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-06-12T02:29:54.257 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] 2020-06-12T02:29:54.321 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2020-06-12T02:29:54.365 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:54 +0000 (0:00:01.848) 0:00:01.943 *********** 2020-06-12T02:29:54.454 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:54 +0000 (0:00:00.088) 0:00:02.032 *********** 2020-06-12T02:29:54.787 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-06-12T02:29:54.825 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:54 +0000 (0:00:00.371) 0:00:02.403 *********** 2020-06-12T02:29:54.838 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-06-12T02:29:54.876 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:54 +0000 (0:00:00.050) 0:00:02.454 *********** 2020-06-12T02:29:55.511 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-06-12T02:29:55.514 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-12T02:29:55.553 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:55 +0000 (0:00:00.677) 0:00:03.131 *********** 2020-06-12T02:29:55.562 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-06-12T02:29:55.601 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:55 +0000 (0:00:00.048) 0:00:03.179 *********** 2020-06-12T02:29:56.051 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-06-12T02:29:56.052 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.065341", "end": "2020-06-12 02:29:56.498503", "rc": 0, "start": "2020-06-12 02:29:56.433162", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-06-12T02:29:56.054 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.082083", "end": "2020-06-12 02:29:56.030265", "rc": 0, "start": "2020-06-12 02:29:55.948182", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-06-12T02:29:56.089 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:56 +0000 (0:00:00.487) 0:00:03.667 *********** 2020-06-12T02:29:56.151 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:56 +0000 (0:00:00.062) 0:00:03.729 *********** 2020-06-12T02:29:56.490 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:29:56.492 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:29:56.531 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:56 +0000 (0:00:00.379) 0:00:04.109 *********** 2020-06-12T02:29:56.575 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:56 +0000 (0:00:00.044) 0:00:04.153 *********** 2020-06-12T02:29:57.437 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-06-12T02:29:57.439 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591928996.5486262-64385098777870/source", "state": "file", "uid": 0} 2020-06-12T02:29:57.480 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:57 +0000 (0:00:00.905) 0:00:05.058 *********** 2020-06-12T02:29:57.493 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591928996.595929-187116490449551/source", "state": "file", "uid": 0} 2020-06-12T02:29:57.535 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:57 +0000 (0:00:00.055) 0:00:05.113 *********** 2020-06-12T02:29:57.988 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-06-12T02:29:57.990 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2020-06-12T02:29:57.992 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2020-06-12T02:29:57.996 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-06-12T02:29:58.126 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-06-12T02:29:58.132 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-06-12T02:29:58.297 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:58 +0000 (0:00:00.761) 0:00:05.875 *********** 2020-06-12T02:29:58.336 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:58 +0000 (0:00:00.038) 0:00:05.914 *********** 2020-06-12T02:29:59.257 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi117.front.sepia.ceph.com] 2020-06-12T02:29:59.265 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] 2020-06-12T02:29:59.366 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-06-12T02:29:59.368 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:59 +0000 (0:00:01.030) 0:00:06.945 *********** 2020-06-12T02:29:59.404 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:59 +0000 (0:00:00.037) 0:00:06.982 *********** 2020-06-12T02:29:59.814 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi117.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.178381", "end": "2020-06-12 02:29:59.781853", "rc": 0, "start": "2020-06-12 02:29:59.603472", "stderr": "", "stderr_lines": [], "stdout": "982b99592bd601b0475ee21e26576645605e4b52", "stdout_lines": ["982b99592bd601b0475ee21e26576645605e4b52"]} 2020-06-12T02:29:59.864 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:59 +0000 (0:00:00.458) 0:00:07.441 *********** 2020-06-12T02:29:59.882 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.203284", "end": "2020-06-12 02:29:59.836570", "rc": 0, "start": "2020-06-12 02:29:59.633286", "stderr": "", "stderr_lines": [], "stdout": "982b99592bd601b0475ee21e26576645605e4b52", "stdout_lines": ["982b99592bd601b0475ee21e26576645605e4b52"]} 2020-06-12T02:29:59.920 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:29:59 +0000 (0:00:00.057) 0:00:07.499 *********** 2020-06-12T02:30:00.016 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-06-12T02:30:00.018 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.018493", "end": "2020-06-12 02:30:00.474494", "failed_when_result": false, "rc": 0, "start": "2020-06-12 02:30:00.456001", "stderr": "", "stderr_lines": [], "stdout": "743c659c40211acb851086b2a21beddfbfe09383", "stdout_lines": ["743c659c40211acb851086b2a21beddfbfe09383"]} 2020-06-12T02:30:00.054 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.133) 0:00:07.632 *********** 2020-06-12T02:30:00.087 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-06-12T02:30:00.089 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008510", "end": "2020-06-12 02:30:00.065172", "failed_when_result": false, "rc": 0, "start": "2020-06-12 02:30:00.056662", "stderr": "", "stderr_lines": [], "stdout": "743c659c40211acb851086b2a21beddfbfe09383", "stdout_lines": ["743c659c40211acb851086b2a21beddfbfe09383"]} 2020-06-12T02:30:00.123 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.068) 0:00:07.701 *********** 2020-06-12T02:30:00.167 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.044) 0:00:07.745 *********** 2020-06-12T02:30:00.178 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.218 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.051) 0:00:07.796 *********** 2020-06-12T02:30:00.229 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-06-12T02:30:00.231 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.276 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.056) 0:00:07.852 *********** 2020-06-12T02:30:00.283 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-12T02:30:00.285 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.322 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.048) 0:00:07.900 *********** 2020-06-12T02:30:00.331 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-06-12T02:30:00.333 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.376 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.053) 0:00:07.954 *********** 2020-06-12T02:30:00.384 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-06-12T02:30:00.386 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.421 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.045) 0:00:07.999 *********** 2020-06-12T02:30:00.431 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-06-12T02:30:00.432 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.469 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.047) 0:00:08.047 *********** 2020-06-12T02:30:00.484 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.517 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.047) 0:00:08.094 *********** 2020-06-12T02:30:00.524 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-06-12T02:30:00.526 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.568 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.051) 0:00:08.146 *********** 2020-06-12T02:30:00.610 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-06-12T02:30:00.612 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:00.648 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.080) 0:00:08.227 *********** 2020-06-12T02:30:00.675 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-06-12T02:30:00.677 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:30:00.714 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.065) 0:00:08.292 *********** 2020-06-12T02:30:00.802 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:30:00.846 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:00 +0000 (0:00:00.131) 0:00:08.424 *********** 2020-06-12T02:30:00.927 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-06-12T02:30:00.929 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-06-12T02:30:01.037 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-06-12T02:30:01.095 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-06-12T02:30:01.168 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-06-12T02:30:01.264 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-06-12T02:30:01.329 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-06-12T02:30:01.452 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-06-12T02:30:01.504 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-06-12T02:30:01.618 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-06-12T02:30:01.651 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-06-12T02:30:01.778 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-06-12T02:30:01.801 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-06-12T02:30:01.933 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-06-12T02:30:01.965 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-06-12T02:30:02.071 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-06-12T02:30:02.123 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-06-12T02:30:02.206 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-06-12T02:30:02.244 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-06-12T02:30:02.351 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-06-12T02:30:02.374 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-06-12T02:30:02.490 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-06-12T02:30:02.555 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-06-12T02:30:02.628 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-06-12T02:30:02.708 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-06-12T02:30:02.773 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-06-12T02:30:02.899 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-06-12T02:30:02.922 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-06-12T02:30:03.051 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-06-12T02:30:03.063 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-06-12T02:30:03.196 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-06-12T02:30:03.218 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-06-12T02:30:03.325 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-06-12T02:30:03.376 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-06-12T02:30:03.460 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-06-12T02:30:03.524 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-06-12T02:30:03.608 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-06-12T02:30:03.672 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-06-12T02:30:03.736 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-06-12T02:30:03.813 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-06-12T02:30:03.887 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-06-12T02:30:03.973 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-06-12T02:30:04.022 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-06-12T02:30:04.137 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-06-12T02:30:04.169 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-06-12T02:30:04.306 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-06-12T02:30:04.308 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-06-12T02:30:04.460 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae5849 2020-06-12T02:30:04.462 INFO:teuthology.task.ansible.out:0d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-06-12T02:30:04.589 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-06-12T02:30:04.619 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-06-12T02:30:04.741 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-06-12T02:30:04.784 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-06-12T02:30:04.868 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-06-12T02:30:04.940 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-06-12T02:30:05.029 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-06-12T02:30:05.071 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-06-12T02:30:05.169 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-06-12T02:30:05.241 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-06-12T02:30:05.244 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:05.296 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-06-12T02:30:05.299 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:05.395 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-06-12T02:30:05.448 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-06-12T02:30:05.542 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-06-12T02:30:05.585 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-06-12T02:30:05.690 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-06-12T02:30:05.725 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-06-12T02:30:05.840 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-06-12T02:30:05.862 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-06-12T02:30:06.004 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-06-12T02:30:06.017 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-06-12T02:30:06.137 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-06-12T02:30:06.148 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-06-12T02:30:06.287 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-06-12T02:30:06.299 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-06-12T02:30:06.435 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-06-12T02:30:06.458 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-06-12T02:30:06.576 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T02:30:06.587 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-06-12T02:30:06.742 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-06-12T02:30:06.774 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-06-12T02:30:06.896 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-06-12T02:30:06.966 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-06-12T02:30:07.072 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-06-12T02:30:07.136 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T02:30:07.199 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-06-12T02:30:07.293 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-06-12T02:30:07.365 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-06-12T02:30:07.466 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-06-12T02:30:07.510 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-06-12T02:30:07.596 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-06-12T02:30:07.663 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-06-12T02:30:07.670 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:07.750 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-06-12T02:30:07.793 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T02:30:07.931 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-06-12T02:30:07.943 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-06-12T02:30:08.068 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-06-12T02:30:08.090 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-06-12T02:30:08.198 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-06-12T02:30:08.231 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-06-12T02:30:08.332 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T02:30:08.380 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-06-12T02:30:08.455 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-06-12T02:30:08.518 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-06-12T02:30:08.604 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-06-12T02:30:08.677 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-06-12T02:30:08.752 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-06-12T02:30:08.808 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-06-12T02:30:08.882 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-06-12T02:30:08.949 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-06-12T02:30:09.033 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-06-12T02:30:09.085 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-06-12T02:30:09.181 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-06-12T02:30:09.234 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-06-12T02:30:09.324 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-06-12T02:30:09.366 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-06-12T02:30:09.483 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-06-12T02:30:09.505 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-06-12T02:30:09.632 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-06-12T02:30:09.633 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-06-12T02:30:09.769 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-06-12T02:30:09.781 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-06-12T02:30:09.914 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-06-12T02:30:10.041 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-06-12T02:30:10.110 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-06-12T02:30:10.195 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T02:30:10.273 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-06-12T02:30:10.362 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-06-12T02:30:10.424 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-06-12T02:30:10.522 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-06-12T02:30:10.606 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-06-12T02:30:10.658 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-06-12T02:30:10.768 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-06-12T02:30:10.804 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-06-12T02:30:10.927 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-06-12T02:30:10.928 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-06-12T02:30:11.068 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-06-12T02:30:11.092 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-06-12T02:30:11.216 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-06-12T02:30:11.238 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-06-12T02:30:11.357 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-06-12T02:30:11.402 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-06-12T02:30:11.490 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-06-12T02:30:11.553 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-06-12T02:30:11.639 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-06-12T02:30:11.714 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-06-12T02:30:11.828 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-06-12T02:30:11.854 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-06-12T02:30:11.987 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-06-12T02:30:12.278 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-06-12T02:30:12.282 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-06-12T02:30:12.327 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-06-12T02:30:12.437 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-06-12T02:30:12.506 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-06-12T02:30:12.592 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-06-12T02:30:12.671 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-06-12T02:30:12.723 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-06-12T02:30:12.828 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-06-12T02:30:12.875 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-06-12T02:30:12.998 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-06-12T02:30:13.037 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-06-12T02:30:13.174 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-06-12T02:30:13.179 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-06-12T02:30:13.328 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-06-12T02:30:13.349 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-06-12T02:30:13.499 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-06-12T02:30:13.529 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-06-12T02:30:13.642 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-06-12T02:30:13.690 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-06-12T02:30:13.812 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-06-12T02:30:13.842 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-06-12T02:30:13.943 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-06-12T02:30:13.996 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-06-12T02:30:14.084 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-06-12T02:30:14.133 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-06-12T02:30:14.239 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-06-12T02:30:14.293 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-06-12T02:30:14.402 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-06-12T02:30:14.475 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-06-12T02:30:14.532 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-06-12T02:30:14.630 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-06-12T02:30:14.674 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-06-12T02:30:14.801 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-06-12T02:30:14.823 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-06-12T02:30:14.933 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-06-12T02:30:14.954 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-06-12T02:30:15.086 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-06-12T02:30:15.098 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-06-12T02:30:15.229 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-06-12T02:30:15.240 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-06-12T02:30:15.372 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-06-12T02:30:15.416 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-06-12T02:30:15.506 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-06-12T02:30:15.565 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-06-12T02:30:15.669 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-06-12T02:30:15.747 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-06-12T02:30:15.800 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T02:30:15.906 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-06-12T02:30:15.938 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-06-12T02:30:16.066 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-06-12T02:30:16.098 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-06-12T02:30:16.217 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-06-12T02:30:16.255 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-06-12T02:30:16.257 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:16.372 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-06-12T02:30:16.397 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-06-12T02:30:16.506 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-06-12T02:30:16.538 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-06-12T02:30:16.642 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-06-12T02:30:16.689 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-06-12T02:30:16.783 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-06-12T02:30:16.830 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-06-12T02:30:16.922 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-06-12T02:30:16.956 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-06-12T02:30:17.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-06-12T02:30:17.114 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-06-12T02:30:17.211 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-06-12T02:30:17.253 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-06-12T02:30:17.337 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-06-12T02:30:17.395 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-06-12T02:30:17.498 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-06-12T02:30:17.543 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-06-12T02:30:17.648 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-06-12T02:30:17.680 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-06-12T02:30:17.807 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-06-12T02:30:17.818 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-06-12T02:30:17.940 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-06-12T02:30:17.951 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-06-12T02:30:18.081 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-06-12T02:30:18.092 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-06-12T02:30:18.219 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-06-12T02:30:18.231 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-06-12T02:30:18.356 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-06-12T02:30:18.515 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-06-12T02:30:18.676 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-06-12T02:30:18.838 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-06-12T02:30:18.901 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-06-12T02:30:18.992 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-06-12T02:30:19.036 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:19 +0000 (0:00:18.190) 0:00:26.614 *********** 2020-06-12T02:30:19.068 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-12T02:30:19.103 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:19 +0000 (0:00:00.066) 0:00:26.681 *********** 2020-06-12T02:30:19.166 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-12T02:30:19.171 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-06-12T02:30:19.173 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-06-12T02:30:19.178 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-06-12T02:30:19.182 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-06-12T02:30:19.188 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-06-12T02:30:19.190 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-06-12T02:30:19.192 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4Uk 2020-06-12T02:30:19.201 INFO:teuthology.task.ansible.out:ibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237 2020-06-12T02:30:19.203 INFO:teuthology.task.ansible.out:a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomth 2020-06-12T02:30:19.204 INFO:teuthology.task.ansible.out:d@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri 2020-06-12T02:30:19.206 INFO:teuthology.task.ansible.out:", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a862 2020-06-12T02:30:19.207 INFO:teuthology.task.ansible.out:89ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73 2020-06-12T02:30:19.209 INFO:teuthology.task.ansible.out:728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}]}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-06-12T02:30:19.255 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:19 +0000 (0:00:00.151) 0:00:26.833 *********** 2020-06-12T02:30:19.350 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-06-12T02:30:19.481 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-06-12T02:30:20.113 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "name": "sunny", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-06-12T02:30:20.191 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi142.front.sepia.ceph.com -> localhost] => {"after": "982b99592bd601b0475ee21e26576645605e4b52", "attempts": 1, "before": "982b99592bd601b0475ee21e26576645605e4b52", "changed": false, "remote_url_changed": false} 2020-06-12T02:30:20.230 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:20 +0000 (0:00:00.975) 0:00:27.808 *********** 2020-06-12T02:30:20.268 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:20 +0000 (0:00:00.037) 0:00:27.846 *********** 2020-06-12T02:30:20.276 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-06-12T02:30:20.316 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:20 +0000 (0:00:00.048) 0:00:27.894 *********** 2020-06-12T02:30:20.368 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-06-12T02:30:20.373 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 2020-06-12T02:30:20.375 INFO:teuthology.task.ansible.out: 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAx 2020-06-12T02:30:20.377 INFO:teuthology.task.ansible.out:j+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8ea 2020-06-12T02:30:20.379 INFO:teuthology.task.ansible.out:c8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f261 2020-06-12T02:30:20.381 INFO:teuthology.task.ansible.out:02d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomai 2020-06-12T02:30:20.383 INFO:teuthology.task.ansible.out:wang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redha 2020-06-12T02:30:20.385 INFO:teuthology.task.ansible.out:t.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4Uk 2020-06-12T02:30:20.385 INFO:teuthology.task.ansible.out:ibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMiv 2020-06-12T02:30:20.387 INFO:teuthology.task.ansible.out:DNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "beng 2020-06-12T02:30:20.389 INFO:teuthology.task.ansible.out:land@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name" 2020-06-12T02:30:20.390 INFO:teuthology.task.ansible.out:: "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643 2020-06-12T02:30:20.392 INFO:teuthology.task.ansible.out:eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4 2020-06-12T02:30:20.394 INFO:teuthology.task.ansible.out:yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}]}, "changed": false} 2020-06-12T02:30:20.449 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:20 +0000 (0:00:00.132) 0:00:28.027 *********** 2020-06-12T02:30:20.491 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T02:30:20.492 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-06-12T02:30:20.626 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-06-12T02:30:20.840 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-06-12T02:30:21.010 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-06-12T02:30:21.012 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-06-12T02:30:21.178 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-06-12T02:30:21.222 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-06-12T02:30:21.223 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com -> localhost] => {"after": "982b99592bd601b0475ee21e26576645605e4b52", "attempts": 1, "before": "982b99592bd601b0475ee21e26576645605e4b52", "changed": false, "remote_url_changed": false} 2020-06-12T02:30:21.262 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:21 +0000 (0:00:00.813) 0:00:28.840 *********** 2020-06-12T02:30:21.323 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T02:30:21.325 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-06-12T02:30:21.327 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-06-12T02:30:21.439 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-06-12T02:30:21.589 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-06-12T02:30:21.596 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-06-12T02:30:21.722 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-06-12T02:30:21.733 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:21.744 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-06-12T02:30:21.875 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-06-12T02:30:21.878 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-06-12T02:30:21.886 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:21.908 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:21.923 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:21.964 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-06-12T02:30:22.059 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-06-12T02:30:22.136 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-06-12T02:30:22.137 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-06-12T02:30:22.202 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-06-12T02:30:22.204 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-06-12T02:30:22.298 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-06-12T02:30:22.355 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-06-12T02:30:22.462 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-06-12T02:30:22.464 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-06-12T02:30:22.499 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-06-12T02:30:22.631 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-06-12T02:30:22.635 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:22.637 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-06-12T02:30:22.638 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:22.767 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-06-12T02:30:22.786 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-06-12T02:30:22.919 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac 2020-06-12T02:30:22.921 INFO:teuthology.task.ansible.out:75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-06-12T02:30:22.942 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:23.045 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-06-12T02:30:23.105 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-06-12T02:30:23.107 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-06-12T02:30:23.131 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:23.138 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:23.149 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:23.187 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-06-12T02:30:23.194 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-06-12T02:30:23.314 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-06-12T02:30:23.342 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-06-12T02:30:23.344 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-06-12T02:30:23.474 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-06-12T02:30:23.492 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-06-12T02:30:23.496 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-06-12T02:30:23.645 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-06-12T02:30:23.667 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-06-12T02:30:23.808 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-06-12T02:30:23.810 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-06-12T02:30:23.812 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-06-12T02:30:23.963 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-06-12T02:30:23.971 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-06-12T02:30:24.097 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-06-12T02:30:24.110 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-06-12T02:30:24.249 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-06-12T02:30:24.268 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-06-12T02:30:24.381 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-06-12T02:30:24.444 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-06-12T02:30:24.513 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-06-12T02:30:24.516 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:24.596 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-06-12T02:30:24.598 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-06-12T02:30:24.672 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-06-12T02:30:24.674 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-06-12T02:30:24.747 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-06-12T02:30:24.751 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-06-12T02:30:24.807 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-06-12T02:30:24.904 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-06-12T02:30:24.944 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-06-12T02:30:25.053 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-06-12T02:30:25.111 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-06-12T02:30:25.205 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-06-12T02:30:25.207 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-06-12T02:30:25.239 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-06-12T02:30:25.353 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-06-12T02:30:25.407 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-06-12T02:30:25.480 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-06-12T02:30:25.554 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-06-12T02:30:25.629 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-06-12T02:30:25.708 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T02:30:25.789 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-06-12T02:30:25.862 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-06-12T02:30:25.958 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-06-12T02:30:26.034 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-06-12T02:30:26.119 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-06-12T02:30:26.122 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-06-12T02:30:26.187 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-06-12T02:30:26.189 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-06-12T02:30:26.279 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-06-12T02:30:26.332 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-06-12T02:30:26.333 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-06-12T02:30:26.459 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-06-12T02:30:26.474 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-06-12T02:30:26.621 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-06-12T02:30:26.623 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-06-12T02:30:26.765 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-06-12T02:30:26.779 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-06-12T02:30:26.924 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-06-12T02:30:26.935 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-06-12T02:30:26.937 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T02:30:27.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-06-12T02:30:27.063 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-06-12T02:30:27.065 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-06-12T02:30:27.066 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-06-12T02:30:27.197 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-06-12T02:30:27.235 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T02:30:27.339 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-06-12T02:30:27.408 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-06-12T02:30:27.484 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-06-12T02:30:27.564 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-06-12T02:30:27.637 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-06-12T02:30:27.710 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-06-12T02:30:27.712 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-06-12T02:30:27.807 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-06-12T02:30:27.859 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-06-12T02:30:27.861 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-06-12T02:30:27.958 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-06-12T02:30:27.960 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-06-12T02:30:28.021 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-06-12T02:30:28.098 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-06-12T02:30:28.175 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-06-12T02:30:28.249 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-06-12T02:30:28.303 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-06-12T02:30:28.397 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-06-12T02:30:28.399 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-06-12T02:30:28.450 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-06-12T02:30:28.452 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T02:30:28.545 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-06-12T02:30:28.587 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-06-12T02:30:28.589 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-06-12T02:30:28.590 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-06-12T02:30:28.691 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-06-12T02:30:28.733 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-06-12T02:30:28.837 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-06-12T02:30:28.839 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-06-12T02:30:28.873 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-06-12T02:30:28.982 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-06-12T02:30:29.016 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-06-12T02:30:29.150 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-06-12T02:30:29.174 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-06-12T02:30:29.270 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-06-12T02:30:29.326 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-06-12T02:30:29.399 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T02:30:29.495 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-06-12T02:30:29.497 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-06-12T02:30:29.540 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-06-12T02:30:29.624 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-06-12T02:30:29.688 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-06-12T02:30:29.776 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-06-12T02:30:29.841 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-06-12T02:30:29.936 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-06-12T02:30:29.938 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-06-12T02:30:29.978 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-06-12T02:30:30.099 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-06-12T02:30:30.101 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-06-12T02:30:30.231 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-06-12T02:30:30.236 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-06-12T02:30:30.387 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-06-12T02:30:30.390 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-06-12T02:30:30.393 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-06-12T02:30:30.518 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-06-12T02:30:30.662 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-06-12T02:30:30.674 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-06-12T02:30:30.791 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-06-12T02:30:30.862 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-06-12T02:30:30.947 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-06-12T02:30:31.024 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-06-12T02:30:31.110 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-06-12T02:30:31.185 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-06-12T02:30:31.260 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-06-12T02:30:31.332 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-06-12T02:30:31.398 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-06-12T02:30:31.475 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-06-12T02:30:31.527 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-06-12T02:30:31.632 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-06-12T02:30:31.684 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-06-12T02:30:31.798 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-06-12T02:30:31.853 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-06-12T02:30:31.948 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-06-12T02:30:32.012 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-06-12T02:30:32.096 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-06-12T02:30:32.144 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-06-12T02:30:32.266 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-06-12T02:30:32.310 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-06-12T02:30:32.424 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-06-12T02:30:32.456 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-06-12T02:30:32.593 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74 2020-06-12T02:30:32.595 INFO:teuthology.task.ansible.out:Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-06-12T02:30:32.736 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-06-12T02:30:32.759 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-06-12T02:30:32.769 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-06-12T02:30:32.883 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-06-12T02:30:32.946 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-06-12T02:30:33.026 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-06-12T02:30:33.110 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-06-12T02:30:33.183 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-06-12T02:30:33.236 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-06-12T02:30:33.341 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-06-12T02:30:33.394 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-06-12T02:30:33.506 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-06-12T02:30:33.546 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-06-12T02:30:33.640 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-06-12T02:30:33.682 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-06-12T02:30:33.776 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-06-12T02:30:33.850 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-06-12T02:30:33.966 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-06-12T02:30:34.009 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-06-12T02:30:34.112 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-06-12T02:30:34.167 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-06-12T02:30:34.252 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-06-12T02:30:34.325 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-06-12T02:30:34.400 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-06-12T02:30:34.458 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-06-12T02:30:34.460 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-06-12T02:30:34.532 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-06-12T02:30:34.609 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-06-12T02:30:34.611 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-06-12T02:30:34.661 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-06-12T02:30:34.752 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-06-12T02:30:34.811 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-06-12T02:30:34.908 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-06-12T02:30:34.940 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-06-12T02:30:34.942 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T02:30:35.048 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-06-12T02:30:35.070 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-06-12T02:30:35.207 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-06-12T02:30:35.247 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-06-12T02:30:35.355 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-06-12T02:30:35.390 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-06-12T02:30:35.516 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-06-12T02:30:35.528 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-06-12T02:30:35.674 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-06-12T02:30:35.676 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-06-12T02:30:35.816 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-06-12T02:30:35.829 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-06-12T02:30:35.957 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-06-12T02:30:35.968 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-06-12T02:30:36.119 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-06-12T02:30:36.121 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-06-12T02:30:36.261 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-06-12T02:30:36.284 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-06-12T02:30:36.421 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-06-12T02:30:36.432 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-06-12T02:30:36.573 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-06-12T02:30:36.596 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-06-12T02:30:36.713 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-06-12T02:30:36.745 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-06-12T02:30:36.854 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-06-12T02:30:36.856 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-06-12T02:30:36.924 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-06-12T02:30:37.011 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-06-12T02:30:37.062 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-06-12T02:30:37.147 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-06-12T02:30:37.214 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-06-12T02:30:37.314 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-06-12T02:30:37.370 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-06-12T02:30:37.459 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-06-12T02:30:37.516 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-06-12T02:30:37.630 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-06-12T02:30:37.684 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-06-12T02:30:37.795 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:37 +0000 (0:00:16.533) 0:00:45.373 *********** 2020-06-12T02:30:37.827 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-06-12T02:30:37.849 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:37.851 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.865 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.867 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.888 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.902 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.904 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.924 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.926 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.939 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:37.979 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T02:30:37.980 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-06-12T02:30:38.073 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-06-12T02:30:38.083 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.141 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-06-12T02:30:38.262 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-06-12T02:30:38.300 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-06-12T02:30:38.411 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:38.412 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-06-12T02:30:38.453 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T02:30:38.459 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-06-12T02:30:38.525 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi142.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-06-12T02:30:38.537 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.547 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.558 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.560 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.569 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.580 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.582 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.592 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.609 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-06-12T02:30:38.617 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc 2020-06-12T02:30:38.619 INFO:teuthology.task.ansible.out:0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.636 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.639 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.663 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.674 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.685 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.700 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.710 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.721 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.731 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.744 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.758 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-06-12T02:30:38.766 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:38.768 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.779 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.803 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.814 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.816 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.828 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.839 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.851 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.862 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.864 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.874 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.884 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.899 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.922 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.925 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.934 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.936 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-06-12T02:30:38.947 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:38.959 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.966 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.975 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.986 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.995 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:38.998 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.006 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.017 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.019 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.028 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.030 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.041 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.063 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.064 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.076 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.089 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.100 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.104 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.148 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.150 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.163 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.165 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.175 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.188 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.190 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.201 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.212 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.214 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.224 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.235 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.236 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.246 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.259 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.269 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.271 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-06-12T02:30:39.282 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:39.284 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.294 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.305 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.309 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.318 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.329 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.341 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.343 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.353 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.364 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.375 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.386 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.388 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.485 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:39 +0000 (0:00:01.689) 0:00:47.063 *********** 2020-06-12T02:30:39.495 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-06-12T02:30:39.505 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-06-12T02:30:39.545 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.602 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:39 +0000 (0:00:00.113) 0:00:47.177 *********** 2020-06-12T02:30:39.610 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-06-12T02:30:39.719 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-06-12T02:30:39.791 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:39.793 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-06-12T02:30:39.828 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:39 +0000 (0:00:00.229) 0:00:47.406 *********** 2020-06-12T02:30:39.910 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.931 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-06-12T02:30:39.932 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:39.932 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.932 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.946 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.977 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2020-06-12T02:30:39.981 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.984 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:39.997 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.059 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:40.062 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-06-12T02:30:40.123 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-06-12T02:30:40.146 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.230 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-06-12T02:30:40.305 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:40.307 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'aemerson', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-06-12T02:30:40.365 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:40.366 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-06-12T02:30:40.454 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-06-12T02:30:40.527 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:40.530 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-06-12T02:30:40.584 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:40.589 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-06-12T02:30:40.606 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.618 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.641 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.656 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.668 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.680 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.691 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.703 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.707 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.717 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.720 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:40.739 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.740 INFO:teuthology.task.ansible.out: skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.742 INFO:teuthology.task.ansible.out: skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.775 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.777 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.787 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.798 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.800 INFO:teuthology.task.ansible.out: skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.814 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.821 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.836 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:40.840 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.848 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.882 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.884 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.885 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.896 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.905 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.920 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.922 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.933 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.944 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.956 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.959 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-06-12T02:30:40.979 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.990 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:40.992 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:41.001 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.012 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.033 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.035 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.055 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.057 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.067 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.069 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.079 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.090 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.092 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.102 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:41.104 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-06-12T02:30:41.115 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.125 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.137 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.148 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.150 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.162 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.170 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.184 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.186 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.196 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.206 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.218 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.228 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.239 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.250 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.261 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:41.263 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-06-12T02:30:41.279 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:41.281 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.292 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.318 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.326 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.327 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.338 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.350 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.352 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.374 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.389 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.402 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.413 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-06-12T02:30:41.423 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:41.425 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.452 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.455 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.465 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.488 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.490 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.513 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.524 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.535 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.537 INFO:teuthology.task.ansible.out: skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.539 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:41.553 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.554 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:41.555 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.571 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:41.573 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi142.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-06-12T02:30:41.606 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-06-12T02:30:41.608 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.634 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.694 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:41 +0000 (0:00:01.865) 0:00:49.272 *********** 2020-06-12T02:30:41.716 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:41.717 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-06-12T02:30:41.744 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-06-12T02:30:41.745 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:41.788 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:41 +0000 (0:00:00.091) 0:00:49.364 *********** 2020-06-12T02:30:41.871 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:41.873 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-06-12T02:30:41.990 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-06-12T02:30:42.028 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-06-12T02:30:42.131 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-06-12T02:30:42.167 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-06-12T02:30:42.250 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-06-12T02:30:42.326 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-06-12T02:30:42.416 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-06-12T02:30:42.448 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-06-12T02:30:42.553 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-06-12T02:30:42.614 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-06-12T02:30:42.766 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-06-12T02:30:42.815 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-06-12T02:30:42.913 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-06-12T02:30:42.955 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-06-12T02:30:43.074 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-06-12T02:30:43.132 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-06-12T02:30:43.231 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-06-12T02:30:43.263 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-06-12T02:30:43.405 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-06-12T02:30:43.411 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-06-12T02:30:43.554 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} ok: [smithi142.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-06-12T02:30:43.690 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} ok: [smithi142.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-06-12T02:30:43.823 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-06-12T02:30:43.845 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-06-12T02:30:43.967 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-06-12T02:30:43.987 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-06-12T02:30:44.101 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-06-12T02:30:44.154 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-06-12T02:30:44.248 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-06-12T02:30:44.290 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-06-12T02:30:44.374 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-06-12T02:30:44.439 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-06-12T02:30:44.528 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-06-12T02:30:44.572 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-06-12T02:30:44.639 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-06-12T02:30:44.704 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-06-12T02:30:44.782 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-06-12T02:30:44.866 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-06-12T02:30:44.921 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-06-12T02:30:45.015 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-06-12T02:30:45.058 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-06-12T02:30:45.162 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-06-12T02:30:45.184 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-06-12T02:30:45.309 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-06-12T02:30:45.341 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-06-12T02:30:45.467 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-06-12T02:30:45.475 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-06-12T02:30:45.611 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-06-12T02:30:45.634 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-06-12T02:30:45.751 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-06-12T02:30:45.776 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-06-12T02:30:45.888 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-06-12T02:30:45.909 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-06-12T02:30:45.982 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:45 +0000 (0:00:04.192) 0:00:53.557 *********** 2020-06-12T02:30:46.045 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-06-12T02:30:46.196 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-06-12T02:30:46.341 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-06-12T02:30:46.445 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "checksum": "f166a1846201ae42f076bd651ad63f80375d8a1b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "594f3164ffc654444ae430b4df4334d6", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591929046.0103304-83361351641375/source", "state": "file", "uid": 0} 2020-06-12T02:30:46.481 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.502) 0:00:54.059 *********** 2020-06-12T02:30:46.523 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-06-12T02:30:46.525 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => { "msg": "Host smithi142.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-06-12T02:30:46.583 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.096) 0:00:54.156 *********** 2020-06-12T02:30:46.588 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:46.590 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-06-12T02:30:46.633 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-06-12T02:30:46.635 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-06-12T02:30:46.680 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.100) 0:00:54.257 *********** 2020-06-12T02:30:46.708 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-06-12T02:30:46.710 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:46.768 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.089) 0:00:54.346 *********** 2020-06-12T02:30:46.778 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi117.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-06-12T02:30:46.800 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:46.836 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.068) 0:00:54.414 *********** 2020-06-12T02:30:46.866 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-06-12T02:30:46.868 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:46.913 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.076) 0:00:54.491 *********** 2020-06-12T02:30:46.923 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi117.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-06-12T02:30:46.947 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-06-12T02:30:46.949 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:46.995 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:46 +0000 (0:00:00.082) 0:00:54.573 *********** 2020-06-12T02:30:47.024 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-06-12T02:30:47.026 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.071 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.075) 0:00:54.649 *********** 2020-06-12T02:30:47.085 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:47.088 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-06-12T02:30:47.108 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.146 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.074) 0:00:54.724 *********** 2020-06-12T02:30:47.187 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-06-12T02:30:47.189 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.234 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.087) 0:00:54.812 *********** 2020-06-12T02:30:47.250 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:47.252 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-06-12T02:30:47.263 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-06-12T02:30:47.264 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.339 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.100) 0:00:54.913 *********** 2020-06-12T02:30:47.358 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:47.359 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi117.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-06-12T02:30:47.381 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi142.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:47.433 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.098) 0:00:55.011 *********** 2020-06-12T02:30:47.474 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-06-12T02:30:47.477 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi117.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-06-12T02:30:47.513 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.079) 0:00:55.091 *********** 2020-06-12T02:30:47.552 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-06-12T02:30:47.554 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.610 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.097) 0:00:55.188 *********** 2020-06-12T02:30:47.641 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:47.647 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-06-12T02:30:47.655 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:47.709 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.096) 0:00:55.284 *********** 2020-06-12T02:30:47.747 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-12T02:30:47.749 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.783 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.077) 0:00:55.362 *********** 2020-06-12T02:30:47.803 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi117.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-06-12T02:30:47.837 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-06-12T02:30:47.839 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:47.873 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.089) 0:00:55.451 *********** 2020-06-12T02:30:47.919 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-12T02:30:47.921 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:47.962 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:47 +0000 (0:00:00.088) 0:00:55.540 *********** 2020-06-12T02:30:47.972 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:47.974 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-06-12T02:30:48.010 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.051 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.089) 0:00:55.629 *********** 2020-06-12T02:30:48.080 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-06-12T02:30:48.082 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.130 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.078) 0:00:55.708 *********** 2020-06-12T02:30:48.139 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:48.141 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-06-12T02:30:48.184 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.227 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.096) 0:00:55.805 *********** 2020-06-12T02:30:48.264 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:48.265 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-06-12T02:30:48.276 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-06-12T02:30:48.278 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:48.337 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.108) 0:00:55.914 *********** 2020-06-12T02:30:48.398 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-06-12T02:30:48.400 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-06-12T02:30:48.417 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-12T02:30:48.419 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.456 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.119) 0:00:56.033 *********** 2020-06-12T02:30:48.498 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.042) 0:00:56.076 *********** 2020-06-12T02:30:48.538 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-06-12T02:30:48.542 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.582 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.084) 0:00:56.160 *********** 2020-06-12T02:30:48.622 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-06-12T02:30:48.624 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.669 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.086) 0:00:56.246 *********** 2020-06-12T02:30:48.708 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-06-12T02:30:48.710 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.763 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.095) 0:00:56.342 *********** 2020-06-12T02:30:48.806 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-06-12T02:30:48.808 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.842 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.079) 0:00:56.421 *********** 2020-06-12T02:30:48.874 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:48.926 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.083) 0:00:56.504 *********** 2020-06-12T02:30:48.947 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-06-12T02:30:48.949 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "checksum": "f166a1846201ae42f076bd651ad63f80375d8a1b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "594f3164ffc654444ae430b4df4334d6", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1591929048.4986525-266652034238067/source", "state": "file", "uid": 0} 2020-06-12T02:30:48.991 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:48 +0000 (0:00:00.062) 0:00:56.567 *********** 2020-06-12T02:30:48.998 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:49.039 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.048) 0:00:56.616 *********** 2020-06-12T02:30:49.047 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi117.front.sepia.ceph.com] => { "msg": "Host smithi117.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-06-12T02:30:49.087 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.047) 0:00:56.664 *********** 2020-06-12T02:30:49.096 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.136 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.050) 0:00:56.715 *********** 2020-06-12T02:30:49.161 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-06-12T02:30:49.195 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.058) 0:00:56.773 *********** 2020-06-12T02:30:49.207 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-06-12T02:30:49.212 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.248 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.052) 0:00:56.826 *********** 2020-06-12T02:30:49.258 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-06-12T02:30:49.260 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.298 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.050) 0:00:56.876 *********** 2020-06-12T02:30:49.308 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-12T02:30:49.310 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.360 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.061) 0:00:56.938 *********** 2020-06-12T02:30:49.369 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-06-12T02:30:49.371 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.414 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.050) 0:00:56.992 *********** 2020-06-12T02:30:49.433 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.461 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.047) 0:00:57.039 *********** 2020-06-12T02:30:49.476 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.514 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.049) 0:00:57.089 *********** 2020-06-12T02:30:49.536 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi142.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.545 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.580 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.068) 0:00:57.158 *********** 2020-06-12T02:30:49.589 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-06-12T02:30:49.591 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.635 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.055) 0:00:57.213 *********** 2020-06-12T02:30:49.648 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.687 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.051) 0:00:57.265 *********** 2020-06-12T02:30:49.698 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.746 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.052) 0:00:57.317 *********** 2020-06-12T02:30:49.795 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-06-12T02:30:49.797 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.834 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.095) 0:00:57.412 *********** 2020-06-12T02:30:49.855 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-06-12T02:30:49.857 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015402", "end": "2020-06-12 02:30:49.832639", "rc": 0, "start": "2020-06-12 02:30:49.817237", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-12T02:30:49.892 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.057) 0:00:57.470 *********** 2020-06-12T02:30:49.911 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:49.955 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:49 +0000 (0:00:00.061) 0:00:57.532 *********** 2020-06-12T02:30:49.964 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-06-12T02:30:49.966 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.007 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.052) 0:00:57.585 *********** 2020-06-12T02:30:50.018 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.059 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.052) 0:00:57.638 *********** 2020-06-12T02:30:50.068 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-06-12T02:30:50.070 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.114 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.054) 0:00:57.692 *********** 2020-06-12T02:30:50.122 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-06-12T02:30:50.124 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:50.170 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.055) 0:00:57.748 *********** 2020-06-12T02:30:50.181 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.230 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.060) 0:00:57.808 *********** 2020-06-12T02:30:50.243 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.292 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.061) 0:00:57.870 *********** 2020-06-12T02:30:50.305 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-06-12T02:30:50.306 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.358 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.065) 0:00:57.936 *********** 2020-06-12T02:30:50.370 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.408 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.047) 0:00:57.983 *********** 2020-06-12T02:30:50.416 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-06-12T02:30:50.418 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.454 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.048) 0:00:58.032 *********** 2020-06-12T02:30:50.462 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-06-12T02:30:50.464 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:50.507 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.048) 0:00:58.080 *********** 2020-06-12T02:30:50.515 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.548 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.045) 0:00:58.126 *********** 2020-06-12T02:30:50.562 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-06-12T02:30:50.563 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.603 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.055) 0:00:58.182 *********** 2020-06-12T02:30:50.622 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.652 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.048) 0:00:58.230 *********** 2020-06-12T02:30:50.662 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:50.726 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.072) 0:00:58.302 *********** 2020-06-12T02:30:50.779 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-06-12T02:30:50.783 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.828 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.103) 0:00:58.406 *********** 2020-06-12T02:30:50.862 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.903 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.075) 0:00:58.481 *********** 2020-06-12T02:30:50.938 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:50.988 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:50 +0000 (0:00:00.084) 0:00:58.566 *********** 2020-06-12T02:30:51.030 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-06-12T02:30:51.032 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.072 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.084) 0:00:58.650 *********** 2020-06-12T02:30:51.112 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:51.148 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.075) 0:00:58.726 *********** 2020-06-12T02:30:51.211 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-06-12T02:30:51.212 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.259 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.107) 0:00:58.833 *********** 2020-06-12T02:30:51.299 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.335 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.079) 0:00:58.912 *********** 2020-06-12T02:30:51.363 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-06-12T02:30:51.365 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.410 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.075) 0:00:58.988 *********** 2020-06-12T02:30:51.449 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-06-12T02:30:51.451 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.486 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.076) 0:00:59.064 *********** 2020-06-12T02:30:51.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-06-12T02:30:51.529 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.736806", "end": "2020-06-12 02:30:51.500321", "rc": 0, "start": "2020-06-12 02:30:50.763515", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:30:51.534 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-06-12T02:30:51.535 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.569 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.083) 0:00:59.147 *********** 2020-06-12T02:30:51.608 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.037) 0:00:59.185 *********** 2020-06-12T02:30:51.616 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-06-12T02:30:51.618 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.654 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.047) 0:00:59.233 *********** 2020-06-12T02:30:51.664 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-06-12T02:30:51.666 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.702 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.047) 0:00:59.280 *********** 2020-06-12T02:30:51.711 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:30:51.748 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.046) 0:00:59.327 *********** 2020-06-12T02:30:51.827 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-06-12T02:30:51.829 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:51.869 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.120) 0:00:59.447 *********** 2020-06-12T02:30:51.900 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-06-12T02:30:51.904 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.060959", "end": "2020-06-12 02:30:51.881423", "rc": 0, "start": "2020-06-12 02:30:51.820464", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:30:51.940 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.070) 0:00:59.518 *********** 2020-06-12T02:30:51.976 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:51 +0000 (0:00:00.036) 0:00:59.554 *********** 2020-06-12T02:30:51.984 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-06-12T02:30:51.988 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.029 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.053) 0:00:59.607 *********** 2020-06-12T02:30:52.085 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-06-12T02:30:52.087 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.098 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.137 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.107) 0:00:59.715 *********** 2020-06-12T02:30:52.182 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi117.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.204 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.244 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.106) 0:00:59.821 *********** 2020-06-12T02:30:52.274 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.318 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.074) 0:00:59.896 *********** 2020-06-12T02:30:52.542 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.023313", "end": "2020-06-12 02:30:52.971386", "rc": 0, "start": "2020-06-12 02:30:52.948073", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-06-12T02:30:52.598 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.279) 0:01:00.176 *********** 2020-06-12T02:30:52.639 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.697 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.098) 0:01:00.274 *********** 2020-06-12T02:30:52.738 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.784 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.088) 0:01:00.363 *********** 2020-06-12T02:30:52.824 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.864 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.077) 0:01:00.441 *********** 2020-06-12T02:30:52.904 INFO:teuthology.task.ansible.out: 2020-06-12T02:30:52.906 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone] *********************************************** 2020-06-12T02:30:52.906 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:52.943 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:52 +0000 (0:00:00.080) 0:01:00.521 *********** 2020-06-12T02:30:52.986 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:53.045 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:53 +0000 (0:00:00.101) 0:01:00.623 *********** 2020-06-12T02:30:53.088 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:53.129 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:53 +0000 (0:00:00.084) 0:01:00.707 *********** 2020-06-12T02:30:53.168 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-06-12T02:30:53.171 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:53.208 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:53 +0000 (0:00:00.075) 0:01:00.783 *********** 2020-06-12T02:30:54.073 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-06-12T02:30:54.075 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.702810", "end": "2020-06-12 02:30:54.500416", "rc": 0, "start": "2020-06-12 02:30:53.797606", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:30:54.111 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:54 +0000 (0:00:00.906) 0:01:01.689 *********** 2020-06-12T02:30:54.143 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-06-12T02:30:54.148 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:54.184 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:54 +0000 (0:00:00.072) 0:01:01.762 *********** 2020-06-12T02:30:54.399 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.069188", "end": "2020-06-12 02:30:54.824737", "rc": 0, "start": "2020-06-12 02:30:54.755549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:30:54.448 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:54 +0000 (0:00:00.264) 0:01:02.026 *********** 2020-06-12T02:30:55.670 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:30:55.710 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:55 +0000 (0:00:01.258) 0:01:03.285 *********** 2020-06-12T02:30:56.558 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-12T02:30:56.560 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:30:56.601 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:56 +0000 (0:00:00.893) 0:01:04.179 *********** 2020-06-12T02:30:56.641 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-12T02:30:56.643 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:56.694 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:56 +0000 (0:00:00.091) 0:01:04.271 *********** 2020-06-12T02:30:57.428 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-06-12T02:30:57.432 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-06-12T02:30:57.466 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:57 +0000 (0:00:00.773) 0:01:05.044 *********** 2020-06-12T02:30:57.724 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-06-12T02:30:57.726 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:30:57.779 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:57 +0000 (0:00:00.312) 0:01:05.357 *********** 2020-06-12T02:30:58.340 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-12T02:30:58.343 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:30:58.415 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:58 +0000 (0:00:00.632) 0:01:05.989 *********** 2020-06-12T02:30:58.777 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-06-12T02:30:58.779 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:30:58.830 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:58 +0000 (0:00:00.418) 0:01:06.408 *********** 2020-06-12T02:30:58.860 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi142.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-06-12T02:30:58.867 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-06-12T02:30:58.870 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:30:58.920 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:58 +0000 (0:00:00.088) 0:01:06.497 *********** 2020-06-12T02:30:59.253 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi142.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-06-12T02:30:59.412 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-06-12T02:30:59.485 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:59 +0000 (0:00:00.565) 0:01:07.062 *********** 2020-06-12T02:30:59.652 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-12T02:30:59.654 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-06-12T02:30:59.702 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:59 +0000 (0:00:00.215) 0:01:07.278 *********** 2020-06-12T02:30:59.864 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:30:59.935 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:30:59 +0000 (0:00:00.233) 0:01:07.512 *********** 2020-06-12T02:31:00.339 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-12T02:31:00.341 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-06-12T02:31:00.451 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-06-12T02:31:00.454 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:00.500 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:00 +0000 (0:00:00.565) 0:01:08.078 *********** 2020-06-12T02:31:00.735 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi142.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-06-12T02:31:01.073 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-06-12T02:31:01.151 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:01 +0000 (0:00:00.651) 0:01:08.729 *********** 2020-06-12T02:31:01.228 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-06-12T02:31:01.476 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} Friday 12 June 2020 02:31:01 +0000 (0:00:00.164) 0:01:08.894 *********** TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi117.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 12 June 2020 02:31:01 +0000 (0:00:00.101) 0:01:08.995 *********** TASK [common : Check for epel] ************************************************* skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:31:01.510 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:01 +0000 (0:00:00.085) 0:01:09.081 *********** 2020-06-12T02:31:01.580 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-12T02:31:01.582 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:01.598 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:01.608 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:01.647 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:01 +0000 (0:00:00.144) 0:01:09.225 *********** 2020-06-12T02:31:01.657 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-12T02:31:01.659 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-06-12T02:31:01.704 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:01.750 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:01 +0000 (0:00:00.102) 0:01:09.328 *********** 2020-06-12T02:31:02.014 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-06-12T02:31:02.016 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-06-12T02:31:02.070 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:02 +0000 (0:00:00.315) 0:01:09.643 *********** 2020-06-12T02:31:02.227 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-06-12T02:31:02.229 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:31:02.278 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:02 +0000 (0:00:00.211) 0:01:09.855 *********** 2020-06-12T02:31:02.666 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-06-12T02:31:02.668 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:02.669 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi117.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-06-12T02:31:02.739 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:02 +0000 (0:00:00.459) 0:01:10.315 *********** 2020-06-12T02:31:03.030 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-06-12T02:31:03.136 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-06-12T02:31:03.186 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.447) 0:01:10.763 *********** 2020-06-12T02:31:03.411 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-06-12T02:31:03.413 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-06-12T02:31:03.470 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.276) 0:01:11.039 *********** 2020-06-12T02:31:03.526 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-06-12T02:31:03.572 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.111) 0:01:11.150 *********** 2020-06-12T02:31:03.594 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-06-12T02:31:03.597 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-06-12T02:31:03.646 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.073) 0:01:11.224 *********** 2020-06-12T02:31:03.656 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:03.706 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.060) 0:01:11.284 *********** 2020-06-12T02:31:03.787 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:31:03.866 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:03 +0000 (0:00:00.158) 0:01:11.442 *********** 2020-06-12T02:31:03.891 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi142.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-06-12T02:31:03.977 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-12T02:31:03.979 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:03.989 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-12T02:31:03.991 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-06-12T02:31:03.991 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-06-12T02:31:03.991 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.047 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.183) 0:01:11.626 *********** 2020-06-12T02:31:04.059 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.061 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.132 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.083) 0:01:11.710 *********** 2020-06-12T02:31:04.148 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.206 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.066) 0:01:11.776 *********** 2020-06-12T02:31:04.214 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.258 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.055) 0:01:11.831 *********** 2020-06-12T02:31:04.265 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-06-12T02:31:04.270 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:31:04.341 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.075) 0:01:11.907 *********** 2020-06-12T02:31:04.377 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-06-12T02:31:04.382 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:04.434 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.102) 0:01:12.010 *********** 2020-06-12T02:31:04.855 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-12T02:31:04.856 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-06-12T02:31:04.921 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:04 +0000 (0:00:00.484) 0:01:12.495 *********** 2020-06-12T02:31:05.190 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:05.247 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:05 +0000 (0:00:00.330) 0:01:12.825 *********** 2020-06-12T02:31:05.744 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-06-12T02:31:05.788 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:05 +0000 (0:00:00.539) 0:01:13.365 *********** 2020-06-12T02:31:05.855 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-06-12T02:31:05.857 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:39 UTC", "ActiveEnterTimestampMonotonic": "18218622", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target time-sync.target nss-lookup.target systemd-tmpfiles-setup.service local-fs.target basic.target var-run.mount sysinit.target -.mount network.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:39 UTC", "AssertTimestampMonotonic": "18217862", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:39 UTC", "ConditionTimestampMonotonic": "18217861", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-06-12T02:31:05.859 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1324", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:39 UTC", "ExecMainStartTimestampMonotonic": "18218592", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2020-06-12 02:29:39 UTC] ; stop_time=[n/a] ; pid=1324 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:39 UTC", "InactiveExitTimestampMonotonic": "18218622", "InvocationID": "2a20df3e41884ee6881c784f185b119a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-06-12T02:31:05.861 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1324", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-06-12T02:31:05.862 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:39 UTC", "StateChangeTimestampMonotonic": "18218622", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:39 UTC", "WatchdogTimestampMonotonic": "18218622", "WatchdogUSec": "0"}} 2020-06-12T02:31:05.897 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:05 +0000 (0:00:00.109) 0:01:13.474 *********** 2020-06-12T02:31:05.935 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-06-12T02:31:05.937 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:05.985 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:05 +0000 (0:00:00.088) 0:01:13.563 *********** 2020-06-12T02:31:06.038 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-06-12T02:31:06.040 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.102 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.116) 0:01:13.680 *********** 2020-06-12T02:31:06.146 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.192 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.090) 0:01:13.770 *********** 2020-06-12T02:31:06.209 INFO:teuthology.task.ansible.out: 2020-06-12T02:31:06.211 INFO:teuthology.task.ansible.out:TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-06-12T02:31:06.267 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.074) 0:01:13.845 *********** 2020-06-12T02:31:06.279 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-06-12T02:31:06.281 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.341 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.073) 0:01:13.918 *********** 2020-06-12T02:31:06.398 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.446 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.106) 0:01:14.025 *********** 2020-06-12T02:31:06.477 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-12T02:31:06.481 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-06-12T02:31:06.514 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.558 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.109) 0:01:14.134 *********** 2020-06-12T02:31:06.600 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-06-12T02:31:06.603 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.663 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.106) 0:01:14.240 *********** 2020-06-12T02:31:06.673 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-06-12T02:31:06.675 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-06-12T02:31:06.734 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.070) 0:01:14.310 *********** 2020-06-12T02:31:06.743 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.804 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.072) 0:01:14.382 *********** 2020-06-12T02:31:06.812 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-06-12T02:31:06.815 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.866 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.053) 0:01:14.436 *********** 2020-06-12T02:31:06.870 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:06.925 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.060) 0:01:14.497 *********** 2020-06-12T02:31:06.927 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-06-12T02:31:06.929 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-06-12T02:31:06.989 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:06 +0000 (0:00:00.070) 0:01:14.567 *********** 2020-06-12T02:31:07.001 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-06-12T02:31:07.008 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:07.049 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.059) 0:01:14.627 *********** 2020-06-12T02:31:07.058 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:07.121 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.072) 0:01:14.699 *********** 2020-06-12T02:31:07.131 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-12T02:31:07.133 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-06-12T02:31:07.186 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.064) 0:01:14.764 *********** 2020-06-12T02:31:07.280 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-06-12T02:31:07.346 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.156) 0:01:14.920 *********** 2020-06-12T02:31:07.443 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-12T02:31:07.445 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-06-12T02:31:07.518 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.172) 0:01:15.092 *********** 2020-06-12T02:31:07.578 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-12T02:31:07.580 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T02:31:07.636 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.121) 0:01:15.214 *********** 2020-06-12T02:31:07.650 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-06-12T02:31:07.652 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-06-12T02:31:07.698 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.061) 0:01:15.276 *********** 2020-06-12T02:31:07.806 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-06-12T02:31:07.850 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:07 +0000 (0:00:00.152) 0:01:15.428 *********** 2020-06-12T02:31:07.993 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-06-12T02:31:07.996 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ActiveEnterTimestampMonotonic": "17910755", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target sysinit.target remote-fs.target network.target systemd-tmpfiles-setup.service nss-lookup.target systemd-journald.socket system.slice var-run.mount -.mount local-fs.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:44 UTC", "AssertTimestampMonotonic": "17910061", "Before": "xdm.service shutdown.target plymouth-quit.service multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ConditionTimestampMonotonic": "17910061", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-06-12T02:31:07.998 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1311", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ExecMainStartTimestampMonotonic": "17910731", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2020-06-12 02:29:44 UTC] ; stop_time=[n/a] ; pid=1311 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:44 UTC", "InactiveExitTimestampMonotonic": "17910755", "InvocationID": "7d62119b8f874ab39c5af440076dc41f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-06-12T02:31:08.003 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1311", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-06-12T02:31:08.005 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:44 UTC", "StateChangeTimestampMonotonic": "17910755", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:44 UTC", "WatchdogTimestampMonotonic": "17910753", "WatchdogUSec": "0"}} 2020-06-12T02:31:08.045 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.194) 0:01:15.623 *********** 2020-06-12T02:31:08.057 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "name": "ubuntu", "state": "present", "system": false} 2020-06-12T02:31:08.107 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.061) 0:01:15.684 *********** 2020-06-12T02:31:08.121 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.164 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.057) 0:01:15.742 *********** 2020-06-12T02:31:08.172 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-06-12T02:31:08.174 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.221 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.056) 0:01:15.798 *********** 2020-06-12T02:31:08.230 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.278 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.057) 0:01:15.856 *********** 2020-06-12T02:31:08.286 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-06-12T02:31:08.288 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.332 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.054) 0:01:15.910 *********** 2020-06-12T02:31:08.346 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.385 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.051) 0:01:15.962 *********** 2020-06-12T02:31:08.450 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.498 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.113) 0:01:16.076 *********** 2020-06-12T02:31:08.547 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-12T02:31:08.549 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.601 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.103) 0:01:16.179 *********** 2020-06-12T02:31:08.648 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.046) 0:01:16.226 *********** 2020-06-12T02:31:08.669 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.706 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.057) 0:01:16.284 *********** 2020-06-12T02:31:08.753 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-06-12T02:31:08.754 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.800 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.092) 0:01:16.377 *********** 2020-06-12T02:31:08.842 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-06-12T02:31:08.846 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.890 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.090) 0:01:16.468 *********** 2020-06-12T02:31:08.938 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:08.988 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:08 +0000 (0:00:00.095) 0:01:16.564 *********** 2020-06-12T02:31:09.025 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:09.070 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.084) 0:01:16.649 *********** 2020-06-12T02:31:09.075 INFO:teuthology.task.ansible.out: 2020-06-12T02:31:09.110 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-06-12T02:31:09.116 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-06-12T02:31:09.160 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.089) 0:01:16.738 *********** 2020-06-12T02:31:09.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-12T02:31:09.182 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-06-12T02:31:09.247 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.086) 0:01:16.825 *********** 2020-06-12T02:31:09.262 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-06-12T02:31:09.301 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.054) 0:01:16.879 *********** 2020-06-12T02:31:09.311 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-12T02:31:09.313 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi142"}, "changed": false} 2020-06-12T02:31:09.358 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.050) 0:01:16.930 *********** 2020-06-12T02:31:09.371 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-06-12T02:31:09.373 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-06-12T02:31:09.419 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.065) 0:01:16.995 *********** 2020-06-12T02:31:09.461 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-06-12T02:31:09.463 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-06-12T02:31:09.507 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.089) 0:01:17.085 *********** 2020-06-12T02:31:09.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-06-12T02:31:09.707 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.200) 0:01:17.285 *********** 2020-06-12T02:31:09.863 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-06-12T02:31:09.865 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "name": "ubuntu", "state": "present", "system": false} 2020-06-12T02:31:09.917 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:09 +0000 (0:00:00.209) 0:01:17.495 *********** 2020-06-12T02:31:09.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:10.043 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.125) 0:01:17.621 *********** 2020-06-12T02:31:10.089 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-06-12T02:31:10.090 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:10.130 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.083) 0:01:17.704 *********** 2020-06-12T02:31:10.291 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-06-12T02:31:10.293 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-06-12T02:31:10.328 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.202) 0:01:17.906 *********** 2020-06-12T02:31:10.406 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-06-12T02:31:10.408 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi142.front.sepia.ceph.com", "ansible_hostname": "smithi142", "ansible_nodename": "smithi142"}, "changed": true, "name": "smithi142"} 2020-06-12T02:31:10.503 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.173) 0:01:18.080 *********** 2020-06-12T02:31:10.856 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-06-12T02:31:10.858 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-06-12T02:31:10.914 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.404) 0:01:18.485 *********** 2020-06-12T02:31:10.959 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-06-12T02:31:10.961 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi117"}, "changed": false} 2020-06-12T02:31:10.997 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:10 +0000 (0:00:00.090) 0:01:18.575 *********** 2020-06-12T02:31:11.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-06-12T02:31:11.010 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-06-12T02:31:11.070 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:11 +0000 (0:00:00.073) 0:01:18.648 *********** 2020-06-12T02:31:11.454 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-06-12T02:31:11.500 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:11 +0000 (0:00:00.430) 0:01:19.078 *********** 2020-06-12T02:31:11.510 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi117.front.sepia.ceph.com", "ansible_hostname": "smithi117", "ansible_nodename": "smithi117"}, "changed": true, "name": "smithi117"} 2020-06-12T02:31:11.554 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:11 +0000 (0:00:00.051) 0:01:19.130 *********** 2020-06-12T02:31:11.928 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-06-12T02:31:11.966 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:11 +0000 (0:00:00.414) 0:01:19.544 *********** 2020-06-12T02:31:12.039 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-12T02:31:12.089 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.122) 0:01:19.667 *********** 2020-06-12T02:31:12.131 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.168 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.079) 0:01:19.747 *********** 2020-06-12T02:31:12.200 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.247 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.078) 0:01:19.825 *********** 2020-06-12T02:31:12.249 INFO:teuthology.task.ansible.out: 2020-06-12T02:31:12.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T02:31:12.298 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.351 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.099) 0:01:19.925 *********** 2020-06-12T02:31:12.368 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-06-12T02:31:12.420 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.072) 0:01:19.998 *********** 2020-06-12T02:31:12.428 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T02:31:12.430 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.476 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.056) 0:01:20.055 *********** 2020-06-12T02:31:12.509 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-12T02:31:12.511 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.548 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.072) 0:01:20.127 *********** 2020-06-12T02:31:12.580 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-06-12T02:31:12.581 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.619 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.070) 0:01:20.198 *********** 2020-06-12T02:31:12.650 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T02:31:12.652 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.704 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.084) 0:01:20.282 *********** 2020-06-12T02:31:12.749 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:12.783 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.078) 0:01:20.361 *********** 2020-06-12T02:31:12.812 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-12T02:31:12.849 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.066) 0:01:20.427 *********** 2020-06-12T02:31:12.895 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-12T02:31:12.935 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.085) 0:01:20.512 *********** 2020-06-12T02:31:12.954 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi117.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-06-12T02:31:12.991 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:12 +0000 (0:00:00.057) 0:01:20.569 *********** 2020-06-12T02:31:13.001 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-06-12T02:31:13.040 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.049) 0:01:20.618 *********** 2020-06-12T02:31:13.052 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.091 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.051) 0:01:20.670 *********** 2020-06-12T02:31:13.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.142 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.050) 0:01:20.720 *********** 2020-06-12T02:31:13.151 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-06-12T02:31:13.152 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.195 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.052) 0:01:20.773 *********** 2020-06-12T02:31:13.207 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-12T02:31:13.211 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.254 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.058) 0:01:20.832 *********** 2020-06-12T02:31:13.263 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T02:31:13.265 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.308 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.053) 0:01:20.885 *********** 2020-06-12T02:31:13.317 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.354 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.046) 0:01:20.932 *********** 2020-06-12T02:31:13.362 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T02:31:13.364 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.402 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.048) 0:01:20.980 *********** 2020-06-12T02:31:13.411 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:13.413 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.451 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.048) 0:01:21.029 *********** 2020-06-12T02:31:13.462 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-12T02:31:13.464 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.508 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.056) 0:01:21.086 *********** 2020-06-12T02:31:13.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-12T02:31:13.519 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.558 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.049) 0:01:21.136 *********** 2020-06-12T02:31:13.573 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.622 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.064) 0:01:21.201 *********** 2020-06-12T02:31:13.641 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.678 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.052) 0:01:21.254 *********** 2020-06-12T02:31:13.688 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.730 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.053) 0:01:21.307 *********** 2020-06-12T02:31:13.740 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.782 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.053) 0:01:21.360 *********** 2020-06-12T02:31:13.790 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-06-12T02:31:13.792 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.835 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.053) 0:01:21.413 *********** 2020-06-12T02:31:13.845 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:13.885 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.049) 0:01:21.463 *********** 2020-06-12T02:31:13.908 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-06-12T02:31:13.945 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.059) 0:01:21.523 *********** 2020-06-12T02:31:13.956 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-12T02:31:13.958 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.001 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:13 +0000 (0:00:00.056) 0:01:21.579 *********** 2020-06-12T02:31:14.012 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-06-12T02:31:14.051 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.049) 0:01:21.629 *********** 2020-06-12T02:31:14.060 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.100 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.049) 0:01:21.678 *********** 2020-06-12T02:31:14.108 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-06-12T02:31:14.150 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.050) 0:01:21.728 *********** 2020-06-12T02:31:14.163 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.205 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.054) 0:01:21.783 *********** 2020-06-12T02:31:14.214 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.257 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.051) 0:01:21.834 *********** 2020-06-12T02:31:14.266 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.318 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.056) 0:01:21.890 *********** 2020-06-12T02:31:14.319 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-06-12T02:31:14.321 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.322 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.363 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.050) 0:01:21.941 *********** 2020-06-12T02:31:14.380 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.413 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.050) 0:01:21.992 *********** 2020-06-12T02:31:14.422 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-06-12T02:31:14.426 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.461 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.047) 0:01:22.039 *********** 2020-06-12T02:31:14.469 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T02:31:14.471 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.512 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.051) 0:01:22.090 *********** 2020-06-12T02:31:14.521 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:14.522 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.560 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.047) 0:01:22.138 *********** 2020-06-12T02:31:14.568 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-06-12T02:31:14.570 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.610 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.050) 0:01:22.188 *********** 2020-06-12T02:31:14.619 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-06-12T02:31:14.621 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.662 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.052) 0:01:22.240 *********** 2020-06-12T02:31:14.671 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-12T02:31:14.673 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.709 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.046) 0:01:22.287 *********** 2020-06-12T02:31:14.726 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.764 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.047) 0:01:22.335 *********** 2020-06-12T02:31:14.766 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-06-12T02:31:14.768 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.805 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.048) 0:01:22.383 *********** 2020-06-12T02:31:14.816 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.861 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.056) 0:01:22.440 *********** 2020-06-12T02:31:14.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-06-12T02:31:14.872 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.915 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.053) 0:01:22.493 *********** 2020-06-12T02:31:14.925 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-06-12T02:31:14.927 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:14.967 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:14 +0000 (0:00:00.052) 0:01:22.545 *********** 2020-06-12T02:31:14.981 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-12T02:31:14.990 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.022 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.055) 0:01:22.601 *********** 2020-06-12T02:31:15.035 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.077 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.054) 0:01:22.655 *********** 2020-06-12T02:31:15.086 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.139 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.062) 0:01:22.717 *********** 2020-06-12T02:31:15.147 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T02:31:15.149 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.187 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.047) 0:01:22.765 *********** 2020-06-12T02:31:15.195 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-06-12T02:31:15.197 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.237 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.050) 0:01:22.815 *********** 2020-06-12T02:31:15.245 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T02:31:15.246 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.288 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.051) 0:01:22.866 *********** 2020-06-12T02:31:15.298 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-12T02:31:15.301 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.342 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.053) 0:01:22.920 *********** 2020-06-12T02:31:15.350 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-06-12T02:31:15.352 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.389 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.046) 0:01:22.967 *********** 2020-06-12T02:31:15.418 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T02:31:15.424 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.456 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.066) 0:01:23.034 *********** 2020-06-12T02:31:15.487 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.531 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.075) 0:01:23.109 *********** 2020-06-12T02:31:15.541 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004944", "end": "2020-06-12 02:31:15.489166", "rc": 0, "start": "2020-06-12 02:31:15.484222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:15.580 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.049) 0:01:23.158 *********** 2020-06-12T02:31:15.594 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.630 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.049) 0:01:23.208 *********** 2020-06-12T02:31:15.641 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-12T02:31:15.688 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.056) 0:01:23.265 *********** 2020-06-12T02:31:15.695 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-06-12T02:31:15.697 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.742 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.048) 0:01:23.313 *********** 2020-06-12T02:31:15.787 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.822 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.087) 0:01:23.400 *********** 2020-06-12T02:31:15.852 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:15.901 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.078) 0:01:23.479 *********** 2020-06-12T02:31:15.951 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-06-12T02:31:15.953 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:16.003 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:15 +0000 (0:00:00.102) 0:01:23.581 *********** 2020-06-12T02:31:16.034 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:16.093 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.089) 0:01:23.671 *********** 2020-06-12T02:31:16.101 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-06-12T02:31:16.104 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-06-12T02:31:16.141 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.048) 0:01:23.719 *********** 2020-06-12T02:31:16.152 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-06-12T02:31:16.154 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:16.196 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.055) 0:01:23.774 *********** 2020-06-12T02:31:16.206 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:16.251 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.054) 0:01:23.829 *********** 2020-06-12T02:31:16.260 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-06-12T02:31:16.263 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:16.302 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.050) 0:01:23.880 *********** 2020-06-12T02:31:16.474 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003450", "end": "2020-06-12 02:31:16.893443", "rc": 0, "start": "2020-06-12 02:31:16.889993", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:16.513 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.208) 0:01:24.089 *********** 2020-06-12T02:31:16.566 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-06-12T02:31:16.608 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:16 +0000 (0:00:00.097) 0:01:24.186 *********** 2020-06-12T02:31:17.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-06-12T02:31:17.062 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:17 +0000 (0:00:00.453) 0:01:24.640 *********** 2020-06-12T02:31:17.114 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:17.161 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:17 +0000 (0:00:00.098) 0:01:24.739 *********** 2020-06-12T02:31:17.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-06-12T02:31:17.618 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-06-12T02:31:18.163 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-06-12T02:31:18.547 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-06-12T02:31:18.585 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:18 +0000 (0:00:01.423) 0:01:26.163 *********** 2020-06-12T02:31:19.120 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-06-12T02:31:19.160 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:19 +0000 (0:00:00.575) 0:01:26.738 *********** 2020-06-12T02:31:19.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-12T02:31:19.467 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:19.511 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:19 +0000 (0:00:00.350) 0:01:27.089 *********** 2020-06-12T02:31:19.545 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-12T02:31:19.581 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:19 +0000 (0:00:00.069) 0:01:27.159 *********** 2020-06-12T02:31:19.770 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034811", "end": "2020-06-12 02:31:19.743634", "rc": 0, "start": "2020-06-12 02:31:19.708823", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:19.810 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:19 +0000 (0:00:00.229) 0:01:27.389 *********** 2020-06-12T02:31:20.116 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-06-12T02:31:20.118 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:20.159 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:20 +0000 (0:00:00.348) 0:01:27.737 *********** 2020-06-12T02:31:20.190 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-06-12T02:31:20.225 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:20 +0000 (0:00:00.066) 0:01:27.804 *********** 2020-06-12T02:31:20.858 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-06-12T02:31:20.860 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.470484", "end": "2020-06-12 02:31:21.272613", "rc": 0, "start": "2020-06-12 02:31:20.802129", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:20.912 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:20 +0000 (0:00:00.685) 0:01:28.489 *********** 2020-06-12T02:31:22.669 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-06-12T02:31:22.671 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:22.721 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:22 +0000 (0:00:01.804) 0:01:30.294 *********** 2020-06-12T02:31:23.879 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:23.925 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:23 +0000 (0:00:01.208) 0:01:31.503 *********** 2020-06-12T02:31:33.162 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-06-12T02:31:33.164 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 4 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137549 files and directories 2020-06-12T02:31:33.166 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 4 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading 2020-06-12T02:31:33.167 INFO:teuthology.task.ansible.out:database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137549 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-06-12T02:31:33.205 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:33 +0000 (0:00:09.275) 0:01:40.778 *********** 2020-06-12T02:31:33.443 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 4 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137549 files and directories 2020-06-12T02:31:33.445 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 4 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading 2020-06-12T02:31:33.447 INFO:teuthology.task.ansible.out:database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137549 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-06-12T02:31:33.482 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:33 +0000 (0:00:00.281) 0:01:41.060 *********** 2020-06-12T02:31:34.080 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:34.120 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:34 +0000 (0:00:00.637) 0:01:41.698 *********** 2020-06-12T02:31:34.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-06-12T02:31:34.170 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:34.209 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:34 +0000 (0:00:00.089) 0:01:41.787 *********** 2020-06-12T02:31:34.368 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T02:31:34.376 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:34.421 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:34 +0000 (0:00:00.211) 0:01:41.999 *********** 2020-06-12T02:31:34.465 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-06-12T02:31:34.467 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:34.506 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:34 +0000 (0:00:00.084) 0:01:42.084 *********** 2020-06-12T02:31:43.069 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T02:31:43.071 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 4 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.5 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.5 [922 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.26 [39.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.26 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.26 [5178 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.26 [870 kB]\nFetched 10.4 MB in 1s (9573 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-06-12T02:31:43.072 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137407 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-06-12T02:31:43.074 INFO:teuthology.task.ansible.out:1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 4 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.5 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.5 [922 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.26 [39.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.26 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.26 [5178 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.26 [870 kB]", "Fetched 10.4 MB in 1s (9573 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Readi 2020-06-12T02:31:43.076 INFO:teuthology.task.ansible.out:ng database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137407 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-06-12T02:31:43.105 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:43 +0000 (0:00:08.598) 0:01:50.683 *********** 2020-06-12T02:31:43.135 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 4 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.5 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.5 [922 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.26 [39.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.26 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.26 [5178 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.26 [870 kB]\nFetched 10.4 MB in 1s (9647 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-06-12T02:31:43.137 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137407 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-06-12T02:31:43.139 INFO:teuthology.task.ansible.out:1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 4 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.5 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.5 [922 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.26 [39.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.26 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.26 [5178 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.26 [870 kB]", "Fetched 10.4 MB in 1s (9647 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Readi 2020-06-12T02:31:43.141 INFO:teuthology.task.ansible.out:ng database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137407 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.26_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.26) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.26) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-06-12T02:31:43.178 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:43 +0000 (0:00:00.073) 0:01:50.756 *********** 2020-06-12T02:31:43.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-06-12T02:31:43.996 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:44.045 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.866) 0:01:51.623 *********** 2020-06-12T02:31:44.055 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:44.096 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.050) 0:01:51.674 *********** 2020-06-12T02:31:44.198 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-06-12T02:31:44.214 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-06-12T02:31:44.262 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.166) 0:01:51.841 *********** 2020-06-12T02:31:44.272 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-06-12T02:31:44.313 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.050) 0:01:51.891 *********** 2020-06-12T02:31:44.322 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-06-12T02:31:44.324 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:44.360 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.046) 0:01:51.938 *********** 2020-06-12T02:31:44.369 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:44.417 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.056) 0:01:51.995 *********** 2020-06-12T02:31:44.536 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-06-12T02:31:44.577 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.159) 0:01:52.155 *********** 2020-06-12T02:31:44.588 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-06-12T02:31:44.628 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:44 +0000 (0:00:00.051) 0:01:52.206 *********** 2020-06-12T02:31:44.971 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-06-12T02:31:44.973 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-06-12T02:31:45.020 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.392) 0:01:52.599 *********** 2020-06-12T02:31:45.068 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.047) 0:01:52.647 *********** 2020-06-12T02:31:45.194 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi117.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1219, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-12T02:31:45.240 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.171) 0:01:52.818 *********** 2020-06-12T02:31:45.250 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1219, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-06-12T02:31:45.290 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.049) 0:01:52.868 *********** 2020-06-12T02:31:45.393 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-06-12T02:31:45.394 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:31:45.438 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.147) 0:01:53.016 *********** 2020-06-12T02:31:45.458 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:31:45.498 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.060) 0:01:53.076 *********** 2020-06-12T02:31:45.733 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-06-12T02:31:45.734 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:45 UTC", "ActiveEnterTimestampMonotonic": "18351769", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice -.mount systemd-tmpfiles-setup.service basic.target remote-fs.target network.target sysinit.target systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:44 UTC", "AssertTimestampMonotonic": "17910887", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ConditionTimestampMonotonic": "17910887", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-06-12T02:31:45.736 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1387", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:45 UTC", "ExecMainStartTimestampMonotonic": "18351751", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:44 UTC", "InactiveExitTimestampMonotonic": "17911569", "InvocationID": "66bff821f083456783e3b46ac1c7ebb1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-06-12T02:31:45.738 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1387", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-06-12T02:31:45.739 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:45 UTC", "StateChangeTimestampMonotonic": "18351769", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:45 UTC", "WatchdogTimestampMonotonic": "18351768", "WatchdogUSec": "0"}} 2020-06-12T02:31:45.772 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.274) 0:01:53.351 *********** 2020-06-12T02:31:45.804 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:40 UTC", "ActiveEnterTimestampMonotonic": "18635406", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target remote-fs.target nss-lookup.target systemd-journald.socket sysinit.target system.slice -.mount systemd-tmpfiles-setup.service network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:39 UTC", "AssertTimestampMonotonic": "18218765", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:39 UTC", "ConditionTimestampMonotonic": "18218764", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-06-12T02:31:45.806 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1411", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:40 UTC", "ExecMainStartTimestampMonotonic": "18635394", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:39 UTC", "InactiveExitTimestampMonotonic": "18219658", "InvocationID": "fdba750b72b94d39a247bdd7c6ba0956", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-06-12T02:31:45.808 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1411", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-06-12T02:31:45.809 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:40 UTC", "StateChangeTimestampMonotonic": "18635406", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:40 UTC", "WatchdogTimestampMonotonic": "18635405", "WatchdogUSec": "0"}} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:45.847 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.074) 0:01:53.425 *********** 2020-06-12T02:31:45.888 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.041) 0:01:53.466 *********** 2020-06-12T02:31:45.895 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T02:31:45.897 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:45.934 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.046) 0:01:53.513 *********** 2020-06-12T02:31:45.946 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:45.990 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:45 +0000 (0:00:00.052) 0:01:53.565 *********** 2020-06-12T02:31:45.995 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T02:31:45.997 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.035 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.047) 0:01:53.613 *********** 2020-06-12T02:31:46.043 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-06-12T02:31:46.045 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.084 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.049) 0:01:53.662 *********** 2020-06-12T02:31:46.093 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-06-12T02:31:46.095 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.132 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.048) 0:01:53.710 *********** 2020-06-12T02:31:46.141 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-06-12T02:31:46.143 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.182 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.049) 0:01:53.760 *********** 2020-06-12T02:31:46.197 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.232 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.049) 0:01:53.810 *********** 2020-06-12T02:31:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.280 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.048) 0:01:53.859 *********** 2020-06-12T02:31:46.288 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-06-12T02:31:46.290 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.327 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.046) 0:01:53.905 *********** 2020-06-12T02:31:46.346 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-06-12T02:31:46.348 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.388 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.055) 0:01:53.960 *********** 2020-06-12T02:31:46.391 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-06-12T02:31:46.393 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.436 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.047) 0:01:54.008 *********** 2020-06-12T02:31:46.450 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.492 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.061) 0:01:54.070 *********** 2020-06-12T02:31:46.501 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T02:31:46.503 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.547 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.054) 0:01:54.125 *********** 2020-06-12T02:31:46.562 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.616 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.063) 0:01:54.188 *********** 2020-06-12T02:31:46.620 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:46.621 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.665 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.054) 0:01:54.243 *********** 2020-06-12T02:31:46.673 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-06-12T02:31:46.675 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.711 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.046) 0:01:54.289 *********** 2020-06-12T02:31:46.719 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T02:31:46.722 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.758 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.046) 0:01:54.336 *********** 2020-06-12T02:31:46.768 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:46.769 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.809 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.050) 0:01:54.387 *********** 2020-06-12T02:31:46.817 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T02:31:46.818 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.857 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.046) 0:01:54.433 *********** 2020-06-12T02:31:46.864 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-06-12T02:31:46.865 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.903 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.045) 0:01:54.479 *********** 2020-06-12T02:31:46.909 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T02:31:46.910 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.947 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.045) 0:01:54.525 *********** 2020-06-12T02:31:46.955 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-06-12T02:31:46.957 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:46.994 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:46 +0000 (0:00:00.047) 0:01:54.572 *********** 2020-06-12T02:31:47.002 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T02:31:47.004 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.040 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:54.618 *********** 2020-06-12T02:31:47.049 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-06-12T02:31:47.051 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.099 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.047) 0:01:54.666 *********** TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.141 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.053) 0:01:54.719 *********** 2020-06-12T02:31:47.152 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T02:31:47.154 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.191 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.050) 0:01:54.769 *********** 2020-06-12T02:31:47.201 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T02:31:47.203 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.240 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.048) 0:01:54.818 *********** 2020-06-12T02:31:47.250 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T02:31:47.259 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.290 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.049) 0:01:54.868 *********** 2020-06-12T02:31:47.298 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T02:31:47.300 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.336 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:54.915 *********** 2020-06-12T02:31:47.345 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T02:31:47.346 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.383 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:54.961 *********** 2020-06-12T02:31:47.391 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.433 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:55.008 *********** 2020-06-12T02:31:47.438 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T02:31:47.439 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.480 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.050) 0:01:55.058 *********** 2020-06-12T02:31:47.488 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T02:31:47.490 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.529 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.048) 0:01:55.107 *********** 2020-06-12T02:31:47.538 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T02:31:47.540 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.578 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:55.154 *********** 2020-06-12T02:31:47.585 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.624 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.048) 0:01:55.202 *********** 2020-06-12T02:31:47.632 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T02:31:47.634 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.678 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.053) 0:01:55.256 *********** 2020-06-12T02:31:47.686 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T02:31:47.687 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.730 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.051) 0:01:55.308 *********** 2020-06-12T02:31:47.739 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-06-12T02:31:47.740 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.781 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.046) 0:01:55.354 *********** 2020-06-12T02:31:47.790 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.827 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.050) 0:01:55.405 *********** 2020-06-12T02:31:47.837 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T02:31:47.839 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.885 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.057) 0:01:55.463 *********** 2020-06-12T02:31:47.898 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.933 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.047) 0:01:55.511 *********** 2020-06-12T02:31:47.943 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:47.980 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:47 +0000 (0:00:00.047) 0:01:55.558 *********** 2020-06-12T02:31:47.988 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T02:31:47.990 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.026 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.045) 0:01:55.604 *********** 2020-06-12T02:31:48.035 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-06-12T02:31:48.036 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.072 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.046) 0:01:55.650 *********** 2020-06-12T02:31:48.094 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.128 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.056) 0:01:55.706 *********** 2020-06-12T02:31:48.137 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-06-12T02:31:48.138 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.176 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.047) 0:01:55.754 *********** 2020-06-12T02:31:48.189 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.222 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.046) 0:01:55.800 *********** 2020-06-12T02:31:48.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-06-12T02:31:48.232 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.269 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.047) 0:01:55.847 *********** 2020-06-12T02:31:48.277 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-12T02:31:48.283 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.323 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.053) 0:01:55.901 *********** 2020-06-12T02:31:48.332 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.370 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.047) 0:01:55.949 *********** 2020-06-12T02:31:48.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-06-12T02:31:48.404 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:48.439 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.068) 0:01:56.017 *********** 2020-06-12T02:31:48.482 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-06-12T02:31:48.530 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.090) 0:01:56.108 *********** 2020-06-12T02:31:48.592 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-06-12T02:31:48.643 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.111) 0:01:56.219 *********** 2020-06-12T02:31:48.899 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T02:31:48.901 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-06-12T02:31:48.940 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:48 +0000 (0:00:00.298) 0:01:56.518 *********** 2020-06-12T02:31:48.981 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T02:31:48.983 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:49.023 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.081) 0:01:56.600 *********** 2020-06-12T02:31:49.041 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-06-12T02:31:49.043 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-06-12T02:31:49.080 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.058) 0:01:56.659 *********** 2020-06-12T02:31:49.130 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-06-12T02:31:49.131 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:49.166 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.085) 0:01:56.744 *********** 2020-06-12T02:31:49.413 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-06-12T02:31:49.415 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-06-12T02:31:49.454 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.287) 0:01:57.032 *********** 2020-06-12T02:31:49.524 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-06-12T02:31:49.575 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.121) 0:01:57.153 *********** 2020-06-12T02:31:49.824 INFO:teuthology.task.ansible.out: 2020-06-12T02:31:49.826 INFO:teuthology.task.ansible.out:TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-06-12T02:31:49.829 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-06-12T02:31:49.875 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:49 +0000 (0:00:00.299) 0:01:57.453 *********** 2020-06-12T02:31:49.974 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-06-12T02:31:50.013 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.138) 0:01:57.591 *********** 2020-06-12T02:31:50.264 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-06-12T02:31:50.324 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.311) 0:01:57.903 *********** 2020-06-12T02:31:50.399 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-06-12T02:31:50.438 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.113) 0:01:58.016 *********** 2020-06-12T02:31:50.477 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-12T02:31:50.479 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:31:50.525 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.086) 0:01:58.103 *********** 2020-06-12T02:31:50.570 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.604 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.077) 0:01:58.180 *********** 2020-06-12T02:31:50.611 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-06-12T02:31:50.614 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:31:50.651 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.049) 0:01:58.229 *********** 2020-06-12T02:31:50.661 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-12T02:31:50.663 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.706 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.049) 0:01:58.279 *********** 2020-06-12T02:31:50.710 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.757 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.050) 0:01:58.330 *********** 2020-06-12T02:31:50.764 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.801 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.048) 0:01:58.378 *********** 2020-06-12T02:31:50.809 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-06-12T02:31:50.811 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.848 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.047) 0:01:58.426 *********** 2020-06-12T02:31:50.857 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-06-12T02:31:50.858 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.899 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.049) 0:01:58.475 *********** 2020-06-12T02:31:50.913 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.947 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.049) 0:01:58.525 *********** 2020-06-12T02:31:50.955 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-12T02:31:50.957 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:50.997 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:50 +0000 (0:00:00.050) 0:01:58.576 *********** 2020-06-12T02:31:51.010 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.048 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.050) 0:01:58.626 *********** 2020-06-12T02:31:51.058 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:51.061 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-06-12T02:31:51.100 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.051) 0:01:58.678 *********** 2020-06-12T02:31:51.109 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-06-12T02:31:51.111 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.154 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.054) 0:01:58.732 *********** 2020-06-12T02:31:51.163 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-06-12T02:31:51.165 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.166 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.189 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:31:51.191 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi117.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.225 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.070) 0:01:58.803 *********** 2020-06-12T02:31:51.237 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.247 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-12T02:31:51.249 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.260 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.262 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.272 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.323 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.097) 0:01:58.901 *********** 2020-06-12T02:31:51.335 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.336 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.337 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.338 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-06-12T02:31:51.357 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.391 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.402 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.405 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.460 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.136) 0:01:59.038 *********** 2020-06-12T02:31:51.576 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-12T02:31:51.578 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006138", "end": "2020-06-12 02:31:51.537594", "rc": 0, "start": "2020-06-12 02:31:51.531456", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-12T02:31:51.617 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.157) 0:01:59.195 *********** 2020-06-12T02:31:51.670 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.707 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.090) 0:01:59.285 *********** 2020-06-12T02:31:51.716 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-06-12T02:31:51.718 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003878", "end": "2020-06-12 02:31:51.676223", "rc": 0, "start": "2020-06-12 02:31:51.672345", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-06-12T02:31:51.757 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.050) 0:01:59.336 *********** 2020-06-12T02:31:51.771 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-12T02:31:51.773 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.823 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.060) 0:01:59.396 *********** 2020-06-12T02:31:51.832 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-06-12T02:31:51.834 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.873 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.054) 0:01:59.451 *********** 2020-06-12T02:31:51.881 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-06-12T02:31:51.883 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.919 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.045) 0:01:59.497 *********** 2020-06-12T02:31:51.927 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-06-12T02:31:51.929 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:51.973 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:51 +0000 (0:00:00.054) 0:01:59.551 *********** 2020-06-12T02:31:52.011 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-06-12T02:31:52.013 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:52.046 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:52 +0000 (0:00:00.073) 0:01:59.625 *********** 2020-06-12T02:31:52.917 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:31:52.962 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:52 +0000 (0:00:00.915) 0:02:00.540 *********** 2020-06-12T02:31:52.978 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:31:53.020 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.058) 0:02:00.598 *********** 2020-06-12T02:31:53.029 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-06-12T02:31:53.030 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:53.069 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.049) 0:02:00.648 *********** 2020-06-12T02:31:53.078 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:53.116 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.046) 0:02:00.695 *********** 2020-06-12T02:31:53.138 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi117.front.sepia.ceph.com] => (item={'block_used': 13741606, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353502, 'size_available': 927143944192, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353502, "block_size": 4096, "block_total": 240095108, "block_used": 13741606, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143944192, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}} 2020-06-12T02:31:53.175 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.058) 0:02:00.754 *********** 2020-06-12T02:31:53.185 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item={'block_used': 13741605, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353503, 'size_available': 927143948288, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353503, "block_size": 4096, "block_total": 240095108, "block_used": 13741605, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143948288, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}} 2020-06-12T02:31:53.235 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.059) 0:02:00.813 *********** 2020-06-12T02:31:53.321 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007728", "end": "2020-06-12 02:31:53.723385", "rc": 0, "start": "2020-06-12 02:31:53.715657", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:53.370 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.134) 0:02:00.948 *********** 2020-06-12T02:31:53.391 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010059", "end": "2020-06-12 02:31:53.372258", "rc": 0, "start": "2020-06-12 02:31:53.362199", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:31:53.430 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.060) 0:02:01.008 *********** 2020-06-12T02:31:53.438 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-06-12T02:31:53.440 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'block_used': 13741606, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353502, 'size_available': 927143944192, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353502, "block_size": 4096, "block_total": 240095108, "block_used": 13741606, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143944192, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:53.483 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.047) 0:02:01.055 *********** 2020-06-12T02:31:53.488 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'block_used': 13741605, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353503, 'size_available': 927143948288, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353503, "block_size": 4096, "block_total": 240095108, "block_used": 13741605, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143948288, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:53.527 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.049) 0:02:01.105 *********** 2020-06-12T02:31:53.534 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-06-12T02:31:53.587 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.060) 0:02:01.165 *********** 2020-06-12T02:31:53.635 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:31:53 +0000 (0:00:00.047) 0:02:01.213 *********** 2020-06-12T02:31:53.654 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-06-12T02:31:53.656 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:53.697 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:55.687 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg5pKErMx02K1gAUMnpfeHMDnQmV0BIt1'], 'uuids': ['ec8f2e22-a214-4abb-a7ce-11ad30ad2866']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.920666", "end": "2020-06-12 02:31:56.089944", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg5pKErMx02K1gAUMnpfeHMDnQmV0BIt1"], "labels": [], "masters": [], "uuids": ["ec8f2e22-a214-4abb-a7ce-11ad30ad2866"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:54.169278", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:55.699 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:55.715 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:55.785 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i9mKnM8pptWyIJZlULgxPYJES2IFHIx2A'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.954112", "end": "2020-06-12 02:31:55.746612", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i9mKnM8pptWyIJZlULgxPYJES2IFHIx2A"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:53.792500", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:55.808 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:56.991 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJ4VPaEC1RCenCnKh2HHYkbPM1S6scrkhO'], 'uuids': ['168aa346-7f25-42b2-bf98-32d7e48df8c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.143995", "end": "2020-06-12 02:31:57.385896", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJ4VPaEC1RCenCnKh2HHYkbPM1S6scrkhO"], "labels": [], "masters": [], "uuids": ["168aa346-7f25-42b2-bf98-32d7e48df8c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:56.241901", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:57.002 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F', 'wwn-0x5000c50091e2fc17'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F-part1', 'wwn-0x5000c50091e2fc17-part1'], 'uuids': ['d4f79be4-a7c6-4e33-96bf-04da8538ca7f']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e2fc17', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5R17F', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F", "wwn-0x5000c50091e2fc17"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F-part1", "wwn-0x5000c50091e2fc17-part1"], "labels": [], "masters": [], "uuids": ["d4f79be4-a7c6-4e33-96bf-04da8538ca7f"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R17F", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2fc17"}}, "skip_reason": 2020-06-12T02:31:57.006 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-06-12T02:31:57.099 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i35ae4ZXZX4j7sDEnYhZSuHVTUfchls7X'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.144403", "end": "2020-06-12 02:31:57.073043", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i35ae4ZXZX4j7sDEnYhZSuHVTUfchls7X"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:55.928640", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:57.110 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ', 'wwn-0x5000c5009292426c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'wwn-0x5000c5009292426c-part1'], 'uuids': ['d4f79be4-a7c6-4e33-96bf-04da8538ca7f']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009292426c', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFVQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["d4f79be4-a7c6-4e33-96bf-04da8538ca7f"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": 2020-06-12T02:31:57.114 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-06-12T02:31:58.303 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vQCAqk-ah2j-Rie3-DrLI-TdbO-l6nz-fCp3s6', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN', 'nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.188032", "end": "2020-06-12 02:31:58.696863", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vQCAqk-ah2j-Rie3-DrLI-TdbO-l6nz-fCp3s6", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN", "nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:57.508831", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-06-12T02:31:58.306 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:58.317 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:58.328 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:58.445 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-946TPB-nRG4-5P6y-9IjP-p3H1-byVg-BYlF2Y', 'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', 'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.204365", "end": "2020-06-12 02:31:58.413125", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-946TPB-nRG4-5P6y-9IjP-p3H1-byVg-BYlF2Y", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:57.208760", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-06-12T02:31:58.447 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:58.457 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:58.458 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:59.602 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJqj8quIoa2B3WkjDJtkF87ZueZgdBUhKr'], 'uuids': ['5f6ed094-48a9-4eb7-909f-59a962b5ac17']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.135135", "end": "2020-06-12 02:31:59.994327", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJqj8quIoa2B3WkjDJtkF87ZueZgdBUhKr"], "labels": [], "masters": [], "uuids": ["5f6ed094-48a9-4eb7-909f-59a962b5ac17"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:58.859192", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:59.629 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:59.630 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:59.724 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6ilbNOUdaxE4uWKyeTC4Y3CZM0Fs2vwnud'], 'uuids': ['ce37ba0b-bb8d-407a-a09e-6dac7c9df483']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.140730", "end": "2020-06-12 02:31:59.691431", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6ilbNOUdaxE4uWKyeTC4Y3CZM0Fs2vwnud"], "labels": [], "masters": [], "uuids": ["ce37ba0b-bb8d-407a-a09e-6dac7c9df483"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:58.550701", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:31:59.736 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:31:59.737 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:00.909 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg22uVklXgTgRAINcsRfcy2GYwhD36yK4'], 'uuids': ['7a53092e-3397-4003-bb00-518b14fe79f8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.138703", "end": "2020-06-12 02:32:01.292786", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg22uVklXgTgRAINcsRfcy2GYwhD36yK4"], "labels": [], "masters": [], "uuids": ["7a53092e-3397-4003-bb00-518b14fe79f8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:00.154083", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:32:00.910 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:01.090 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iXPIkhHwHafhfZyYMMuOltG1gBOEsczni'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.205479", "end": "2020-06-12 02:32:01.058278", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iXPIkhHwHafhfZyYMMuOltG1gBOEsczni"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:31:59.852799", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:32:01.102 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.167 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJcekk0dDydMnW5t7QIO5A8yPeqzk3ZNEM'], 'uuids': ['7ca8b0f3-8194-4c15-b8e1-23d1432e49ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.129142", "end": "2020-06-12 02:32:02.558883", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJcekk0dDydMnW5t7QIO5A8yPeqzk3ZNEM"], "labels": [], "masters": [], "uuids": ["7ca8b0f3-8194-4c15-b8e1-23d1432e49ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:01.429741", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:32:02.232 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:02 +0000 (0:00:08.596) 0:02:09.810 *********** 2020-06-12T02:32:02.306 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T02:32:02.308 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.377 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iak0yJpDmnrfrYkq1L9vwgyBT1yryVgs5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.142891", "end": "2020-06-12 02:32:02.341330", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iak0yJpDmnrfrYkq1L9vwgyBT1yryVgs5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:01.198439", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-06-12T02:32:02.425 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:02 +0000 (0:00:00.193) 0:02:10.003 *********** 2020-06-12T02:32:02.487 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-06-12T02:32:02.489 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.567 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg5pKErMx02K1gAUMnpfeHMDnQmV0BIt1'], 'uuids': ['ec8f2e22-a214-4abb-a7ce-11ad30ad2866']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.151038", "end": "2020-06-12 02:32:02.958873", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg5pKErMx02K1gAUMnpfeHMDnQmV0BIt1"], "labels": [], "masters": [], "uuids": ["ec8f2e22-a214-4abb-a7ce-11ad30ad2866"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:02.807835", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137043 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137043 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:02.580 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.605 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.777 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i9mKnM8pptWyIJZlULgxPYJES2IFHIx2A'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155909", "end": "2020-06-12 02:32:02.751655", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i9mKnM8pptWyIJZlULgxPYJES2IFHIx2A"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:02.595746", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144189 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144189 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:02.788 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.800 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:02.880 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJ4VPaEC1RCenCnKh2HHYkbPM1S6scrkhO'], 'uuids': ['168aa346-7f25-42b2-bf98-32d7e48df8c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.156492", "end": "2020-06-12 02:32:03.270242", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJ4VPaEC1RCenCnKh2HHYkbPM1S6scrkhO"], "labels": [], "masters": [], "uuids": ["168aa346-7f25-42b2-bf98-32d7e48df8c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.113750", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151883 s, 759 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151883 s, 759 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:02.891 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F', 'wwn-0x5000c50091e2fc17'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5R17F-part1', 'wwn-0x5000c50091e2fc17-part1'], 'uuids': ['d4f79be4-a7c6-4e33-96bf-04da8538ca7f']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e2fc17', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5R17F', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F", "wwn-0x5000c50091e2fc17"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R17F-part1", "wwn-0x5000c50091e2fc17-part1"], "labels": [], "masters": [], "uuids": ["d4f79be4-a7c6-4e33-96bf-04da8538ca7f"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R17F", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2fc17"}}, "skip_reason": 2020-06-12T02:32:02.893 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-06-12T02:32:03.079 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vQCAqk-ah2j-Rie3-DrLI-TdbO-l6nz-fCp3s6', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN', 'nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.048655", "end": "2020-06-12 02:32:03.461260", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vQCAqk-ah2j-Rie3-DrLI-TdbO-l6nz-fCp3s6", "nvme-INTEL_SSDPEDMD400G4_PHFT620400V6400BGN", "nvme-nvme.8086-50484654363230343030563634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.412605", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0442864 s, 2.6 GB/s", "std 2020-06-12T02:32:03.081 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0442864 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.106 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.109 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i35ae4ZXZX4j7sDEnYhZSuHVTUfchls7X'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.153258", "end": "2020-06-12 02:32:03.050525", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6i35ae4ZXZX4j7sDEnYhZSuHVTUfchls7X"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:02.897267", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148651 s, 776 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148651 s, 776 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": 2020-06-12T02:32:03.112 INFO:teuthology.task.ansible.out:{"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ', 'wwn-0x5000c5009292426c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1', 'wwn-0x5000c5009292426c-part1'], 'uuids': ['d4f79be4-a7c6-4e33-96bf-04da8538ca7f']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009292426c', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFVQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ", "wwn-0x5000c5009292426c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFVQ-part1", "wwn-0x5000c5009292426c-part1"], "labels": [], "masters": [], "uuids": ["d4f79be4-a7c6-4e33-96bf-04da8538ca7f"]}, "sector 2020-06-12T02:32:03.114 INFO:teuthology.task.ansible.out:s": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFVQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292426c"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.271 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-946TPB-nRG4-5P6y-9IjP-p3H1-byVg-BYlF2Y', 'nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN', 'nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.044487", "end": "2020-06-12 02:32:03.248218", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-946TPB-nRG4-5P6y-9IjP-p3H1-byVg-BYlF2Y", "nvme-INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN", "nvme-nvme.8086-43564654363330333030395934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.203731", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.041763 s, 2.8 GB/s", "stde 2020-06-12T02:32:03.273 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.041763 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.283 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.294 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.359 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJqj8quIoa2B3WkjDJtkF87ZueZgdBUhKr'], 'uuids': ['5f6ed094-48a9-4eb7-909f-59a962b5ac17']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141099", "end": "2020-06-12 02:32:03.749431", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJqj8quIoa2B3WkjDJtkF87ZueZgdBUhKr"], "labels": [], "masters": [], "uuids": ["5f6ed094-48a9-4eb7-909f-59a962b5ac17"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.608332", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139006 s, 830 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139006 s, 830 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.392 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.405 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.569 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6ilbNOUdaxE4uWKyeTC4Y3CZM0Fs2vwnud'], 'uuids': ['ce37ba0b-bb8d-407a-a09e-6dac7c9df483']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.150035", "end": "2020-06-12 02:32:03.537208", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6ilbNOUdaxE4uWKyeTC4Y3CZM0Fs2vwnud"], "labels": [], "masters": [], "uuids": ["ce37ba0b-bb8d-407a-a09e-6dac7c9df483"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.387173", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146978 s, 785 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146978 s, 785 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.581 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.603 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.681 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg22uVklXgTgRAINcsRfcy2GYwhD36yK4'], 'uuids': ['7a53092e-3397-4003-bb00-518b14fe79f8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.152998", "end": "2020-06-12 02:32:04.079755", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJg22uVklXgTgRAINcsRfcy2GYwhD36yK4"], "labels": [], "masters": [], "uuids": ["7a53092e-3397-4003-bb00-518b14fe79f8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.926757", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148404 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148404 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.694 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.869 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iXPIkhHwHafhfZyYMMuOltG1gBOEsczni'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.154752", "end": "2020-06-12 02:32:03.842233", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iXPIkhHwHafhfZyYMMuOltG1gBOEsczni"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:03.687481", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150278 s, 768 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150278 s, 768 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:03.881 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:03.955 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJcekk0dDydMnW5t7QIO5A8yPeqzk3ZNEM'], 'uuids': ['7ca8b0f3-8194-4c15-b8e1-23d1432e49ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.149232", "end": "2020-06-12 02:32:04.342349", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Uwu3Hea9uXl5edKf1TZuukeMK7jetcmJcekk0dDydMnW5t7QIO5A8yPeqzk3ZNEM"], "labels": [], "masters": [], "uuids": ["7ca8b0f3-8194-4c15-b8e1-23d1432e49ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:04.193117", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146428 s, 788 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146428 s, 788 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.019 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:01.593) 0:02:11.597 *********** 2020-06-12T02:32:04.208 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iak0yJpDmnrfrYkq1L9vwgyBT1yryVgs5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.171320", "end": "2020-06-12 02:32:04.171812", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-hA7BvFjPh4ONheLO3I8KaXgKpo7kzT6iak0yJpDmnrfrYkq1L9vwgyBT1yryVgs5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-06-12 02:32:04.000492", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166497 s, 693 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166497 s, 693 MB/s"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.257 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.237) 0:02:11.835 *********** 2020-06-12T02:32:04.286 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-06-12T02:32:04.287 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.110843", "end": "2020-06-12 02:32:04.672543", "rc": 0, "start": "2020-06-12 02:32:04.561700", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.333 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.067) 0:02:11.902 *********** 2020-06-12T02:32:04.562 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.140283", "end": "2020-06-12 02:32:04.524876", "rc": 0, "start": "2020-06-12 02:32:04.384593", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.611 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.287) 0:02:12.189 *********** 2020-06-12T02:32:04.621 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-06-12T02:32:04.623 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.075919", "end": "2020-06-12 02:32:04.967677", "rc": 0, "start": "2020-06-12 02:32:04.891758", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.666 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.054) 0:02:12.244 *********** 2020-06-12T02:32:04.706 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-12T02:32:04.751 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.084) 0:02:12.329 *********** 2020-06-12T02:32:04.791 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-06-12T02:32:04.793 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:04.794 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.038695", "end": "2020-06-12 02:32:04.775096", "rc": 0, "start": "2020-06-12 02:32:04.736401", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:04.836 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.084) 0:02:12.413 *********** 2020-06-12T02:32:04.879 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.043) 0:02:12.457 *********** 2020-06-12T02:32:04.897 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-12T02:32:04.899 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:04.934 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.054) 0:02:12.512 *********** 2020-06-12T02:32:04.945 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-06-12T02:32:04.991 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:04 +0000 (0:00:00.057) 0:02:12.570 *********** 2020-06-12T02:32:05.001 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T02:32:05.002 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.047 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.055) 0:02:12.626 *********** 2020-06-12T02:32:05.068 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.127 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.079) 0:02:12.705 *********** 2020-06-12T02:32:05.129 INFO:teuthology.task.ansible.out: 2020-06-12T02:32:05.139 INFO:teuthology.task.ansible.out: 2020-06-12T02:32:05.141 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.182 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.054) 0:02:12.760 *********** 2020-06-12T02:32:05.192 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-06-12T02:32:05.194 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.233 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.051) 0:02:12.811 *********** 2020-06-12T02:32:05.278 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T02:32:05.286 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.344 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.110) 0:02:12.922 *********** 2020-06-12T02:32:05.353 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:32:05.399 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.053) 0:02:12.976 *********** 2020-06-12T02:32:05.408 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.452 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.051) 0:02:13.027 *********** 2020-06-12T02:32:05.459 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T02:32:05.460 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'block_used': 13741606, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353502, 'size_available': 927143944192, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353502, "block_size": 4096, "block_total": 240095108, "block_used": 13741606, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143944192, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.513 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.062) 0:02:13.090 *********** 2020-06-12T02:32:05.553 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-06-12T02:32:05.564 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.591 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.078) 0:02:13.169 *********** 2020-06-12T02:32:05.601 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-06-12T02:32:05.636 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.046) 0:02:13.215 *********** 2020-06-12T02:32:05.645 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:05.647 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.692 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.054) 0:02:13.269 *********** 2020-06-12T02:32:05.700 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-06-12T02:32:05.702 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'block_used': 13741605, 'uuid': 'd4f79be4-a7c6-4e33-96bf-04da8538ca7f', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226353503, 'size_available': 927143948288, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149347, 'block_size': 4096, 'inode_available': 60905629}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226353503, "block_size": 4096, "block_total": 240095108, "block_used": 13741605, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905629, "inode_total": 61054976, "inode_used": 149347, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927143948288, "size_total": 983429562368, "uuid": "d4f79be4-a7c6-4e33-96bf-04da8538ca7f"}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.749 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.057) 0:02:13.327 *********** 2020-06-12T02:32:05.758 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:05.759 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.798 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.048) 0:02:13.376 *********** 2020-06-12T02:32:05.805 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-06-12T02:32:05.809 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.844 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.046) 0:02:13.422 *********** 2020-06-12T02:32:05.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-06-12T02:32:05.854 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.898 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.054) 0:02:13.476 *********** 2020-06-12T02:32:05.906 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:05.908 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.945 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.046) 0:02:13.523 *********** 2020-06-12T02:32:05.954 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-06-12T02:32:05.955 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:05.996 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:05 +0000 (0:00:00.048) 0:02:13.571 *********** 2020-06-12T02:32:06.006 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:06.049 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.055) 0:02:13.626 *********** 2020-06-12T02:32:06.057 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-12T02:32:06.058 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:06.104 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.055) 0:02:13.682 *********** 2020-06-12T02:32:06.117 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:06.156 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.051) 0:02:13.734 *********** 2020-06-12T02:32:06.202 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:06.235 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.079) 0:02:13.813 *********** 2020-06-12T02:32:06.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-06-12T02:32:06.295 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:06.337 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.096) 0:02:13.909 *********** 2020-06-12T02:32:06.754 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-06-12T02:32:06.754 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-12T02:32:06.807 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.475) 0:02:14.385 *********** 2020-06-12T02:32:06.821 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-06-12T02:32:06.862 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:06 +0000 (0:00:00.054) 0:02:14.440 *********** 2020-06-12T02:32:07.483 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-06-12T02:32:07.485 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:07.719 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:07.804 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:07.983 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.087 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.326 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.348 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.558 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.613 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:08 +0000 (0:00:01.750) 0:02:16.191 *********** 2020-06-12T02:32:08.634 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-06-12T02:32:08.697 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:08 +0000 (0:00:00.084) 0:02:16.275 *********** 2020-06-12T02:32:08.760 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-06-12T02:32:08.766 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-12T02:32:08.799 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:08 +0000 (0:00:00.101) 0:02:16.377 *********** 2020-06-12T02:32:08.850 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-06-12T02:32:08.893 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:08 +0000 (0:00:00.094) 0:02:16.471 *********** 2020-06-12T02:32:08.956 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-06-12T02:32:08.958 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.056 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.099 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.212 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.224 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.333 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.354 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.377 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:09.420 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.526) 0:02:16.998 *********** 2020-06-12T02:32:09.474 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-06-12T02:32:09.486 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:09.550 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.130) 0:02:17.129 *********** 2020-06-12T02:32:09.571 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:32:09.616 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.065) 0:02:17.194 *********** 2020-06-12T02:32:09.666 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-12T02:32:09.668 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-06-12T02:32:09.705 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.088) 0:02:17.283 *********** 2020-06-12T02:32:09.714 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-06-12T02:32:09.717 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:32:09.752 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.046) 0:02:17.330 *********** 2020-06-12T02:32:09.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-06-12T02:32:09.794 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-06-12T02:32:09.829 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:09 +0000 (0:00:00.077) 0:02:17.407 *********** 2020-06-12T02:32:10.270 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-06-12T02:32:10.271 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true} 2020-06-12T02:32:10.309 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:10 +0000 (0:00:00.479) 0:02:17.887 *********** 2020-06-12T02:32:10.845 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-06-12T02:32:10.846 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-12T02:32:10.888 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:10 +0000 (0:00:00.578) 0:02:18.466 *********** 2020-06-12T02:32:11.050 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-12T02:32:11.051 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T02:32:11.086 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.198) 0:02:18.664 *********** 2020-06-12T02:32:11.247 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-06-12T02:32:11.249 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:32:11.310 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.223) 0:02:18.888 *********** 2020-06-12T02:32:11.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-06-12T02:32:11.320 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true} 2020-06-12T02:32:11.364 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.053) 0:02:18.942 *********** 2020-06-12T02:32:11.588 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-06-12T02:32:11.590 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-06-12T02:32:11.656 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.291) 0:02:19.234 *********** 2020-06-12T02:32:11.716 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-12T02:32:11.718 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1219, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-06-12T02:32:11.768 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.110) 0:02:19.344 *********** 2020-06-12T02:32:11.828 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-06-12T02:32:11.834 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T02:32:11.876 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:11 +0000 (0:00:00.106) 0:02:19.451 *********** 2020-06-12T02:32:12.034 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-06-12T02:32:12.035 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-06-12T02:32:12.075 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:12 +0000 (0:00:00.202) 0:02:19.653 *********** 2020-06-12T02:32:12.174 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-06-12T02:32:12.175 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-06-12T02:32:12.214 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:12 +0000 (0:00:00.138) 0:02:19.792 *********** 2020-06-12T02:32:12.487 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-06-12T02:32:12.489 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1219, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-06-12T02:32:12.524 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:12 +0000 (0:00:00.309) 0:02:20.102 *********** 2020-06-12T02:32:12.916 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-06-12T02:32:12.917 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-06-12T02:32:12.951 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:12 +0000 (0:00:00.427) 0:02:20.529 *********** 2020-06-12T02:32:13.079 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-06-12T02:32:13.081 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:32:13.124 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:13 +0000 (0:00:00.172) 0:02:20.702 *********** 2020-06-12T02:32:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-06-12T02:32:13.318 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.036858", "end": "2020-06-12 02:32:13.703289", "rc": 0, "start": "2020-06-12 02:32:13.666431", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-06-12T02:32:13.360 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:13 +0000 (0:00:00.234) 0:02:20.936 *********** 2020-06-12T02:32:13.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-06-12T02:32:13.417 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:13.465 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:13 +0000 (0:00:00.104) 0:02:21.041 *********** 2020-06-12T02:32:13.493 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-06-12T02:32:13.496 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:13.537 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:13 +0000 (0:00:00.073) 0:02:21.115 *********** 2020-06-12T02:32:13.851 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:32:13.906 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:13 +0000 (0:00:00.369) 0:02:21.485 *********** 2020-06-12T02:32:14.092 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-06-12T02:32:14.093 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046288", "end": "2020-06-12 02:32:14.075417", "rc": 0, "start": "2020-06-12 02:32:14.029129", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-06-12T02:32:14.128 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:14 +0000 (0:00:00.221) 0:02:21.706 *********** 2020-06-12T02:32:14.169 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-06-12T02:32:14.171 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:14.205 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:14 +0000 (0:00:00.077) 0:02:21.783 *********** 2020-06-12T02:32:14.244 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-06-12T02:32:14.246 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:14.286 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:14 +0000 (0:00:00.080) 0:02:21.864 *********** 2020-06-12T02:32:14.482 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-12T02:32:14.484 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:32:14.521 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:14 +0000 (0:00:00.234) 0:02:22.099 *********** 2020-06-12T02:32:14.560 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-06-12T02:32:14.562 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:14.605 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:14 +0000 (0:00:00.084) 0:02:22.184 *********** 2020-06-12T02:32:14.979 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-12T02:32:14.981 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-06-12T02:32:15.022 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.416) 0:02:22.600 *********** 2020-06-12T02:32:15.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-12T02:32:15.056 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:15.095 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.068) 0:02:22.668 *********** 2020-06-12T02:32:15.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-06-12T02:32:15.136 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:32:15.195 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.104) 0:02:22.773 *********** 2020-06-12T02:32:15.225 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-06-12T02:32:15.227 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:15.263 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.067) 0:02:22.841 *********** 2020-06-12T02:32:15.315 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-06-12T02:32:15.316 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:50 UTC", "ActiveEnterTimestampMonotonic": "24044054", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice sysinit.target -.mount systemd-journald.socket basic.target network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:44 UTC", "AssertTimestampMonotonic": "17360151", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ConditionTimestampMonotonic": "17360151", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-06-12T02:32:15.319 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2019", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:50 UTC", "ExecMainStartTimestampMonotonic": "24044025", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:44 UTC", "InactiveExitTimestampMonotonic": "17360906", "InvocationID": "cb99f166bdbc4247afb9aa5cd11a9b9f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-06-12T02:32:15.326 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2019", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:50 UTC", "S 2020-06-12T02:32:15.327 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "24044054", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:50 UTC", "WatchdogTimestampMonotonic": "24044052", "WatchdogUSec": "0"}} 2020-06-12T02:32:15.360 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.095) 0:02:22.936 *********** 2020-06-12T02:32:15.388 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:15.390 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-12T02:32:15.431 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.072) 0:02:23.009 *********** 2020-06-12T02:32:15.488 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:15.537 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.106) 0:02:23.115 *********** 2020-06-12T02:32:15.568 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-06-12T02:32:15.570 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:15.608 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.067) 0:02:23.183 *********** 2020-06-12T02:32:15.656 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-06-12T02:32:15.657 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-06-12T02:32:15.702 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.097) 0:02:23.280 *********** 2020-06-12T02:32:15.732 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-06-12T02:32:15.734 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:15.769 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:15 +0000 (0:00:00.067) 0:02:23.347 *********** 2020-06-12T02:32:16.002 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ActiveEnterTimestampMonotonic": "23972058", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service basic.target systemd-journald.socket system.slice -.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-06-12 02:29:39 UTC", "AssertTimestampMonotonic": "17800132", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-06-12 02:29:39 UTC", "ConditionTimestampMonotonic": "17800131", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Dele 2020-06-12T02:32:16.004 INFO:teuthology.task.ansible.out:gate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1999", "ExecMainStartTimestamp": "Fri 2020-06-12 02:29:44 UTC", "ExecMainStartTimestampMonotonic": "23971994", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-06-12 02:29:39 UTC", "InactiveExitTimestampMonotonic": "17801054", "InvocationID": "866c5daa2fe14cfbbf266c3cb321ae47", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infi 2020-06-12T02:32:16.006 INFO:teuthology.task.ansible.out:nity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1999", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "Star 2020-06-12T02:32:16.007 INFO:teuthology.task.ansible.out:tupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-06-12 02:29:44 UTC", "StateChangeTimestampMonotonic": "23972058", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-06-12 02:29:44 UTC", "WatchdogTimestampMonotonic": "23972056", "WatchdogUSec": "0"}} 2020-06-12T02:32:16.055 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.285) 0:02:23.633 *********** 2020-06-12T02:32:16.085 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:16.087 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-06-12T02:32:16.134 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.079) 0:02:23.713 *********** 2020-06-12T02:32:16.175 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:16.177 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:16.220 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.085) 0:02:23.798 *********** 2020-06-12T02:32:16.253 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:16.288 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.066) 0:02:23.865 *********** 2020-06-12T02:32:16.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi117.front.sepia.ceph.com] => {"cache_update_time": 1591928834, "cache_updated": false, "changed": false} 2020-06-12T02:32:16.506 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.219) 0:02:24.085 *********** 2020-06-12T02:32:16.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:16.583 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.076) 0:02:24.161 *********** 2020-06-12T02:32:16.736 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-06-12T02:32:16.738 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T02:32:16.779 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:16 +0000 (0:00:00.195) 0:02:24.357 *********** 2020-06-12T02:32:17.145 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-12T02:32:17.147 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1219, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-06-12T02:32:17.188 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:17 +0000 (0:00:00.409) 0:02:24.767 *********** 2020-06-12T02:32:17.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-06-12T02:32:17.200 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"cache_update_time": 1591928791, "cache_updated": false, "changed": false} 2020-06-12T02:32:17.242 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:17 +0000 (0:00:00.053) 0:02:24.820 *********** 2020-06-12T02:32:17.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-06-12T02:32:17.272 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:17.313 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:17 +0000 (0:00:00.071) 0:02:24.891 *********** 2020-06-12T02:32:17.467 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-06-12T02:32:17.469 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "gid": 1219, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-06-12T02:32:17.504 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:17 +0000 (0:00:00.190) 0:02:25.082 *********** 2020-06-12T02:32:17.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-06-12T02:32:17.890 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1219, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-06-12T02:32:17.927 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:17 +0000 (0:00:00.422) 0:02:25.505 *********** 2020-06-12T02:32:18.244 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-06-12T02:32:18.246 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-12T02:32:18.284 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:18 +0000 (0:00:00.357) 0:02:25.863 *********** 2020-06-12T02:32:18.714 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-06-12T02:32:18.735 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:18 +0000 (0:00:00.450) 0:02:26.313 *********** 2020-06-12T02:32:18.865 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-06-12T02:32:18.866 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false} 2020-06-12T02:32:18.902 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:18 +0000 (0:00:00.167) 0:02:26.481 *********** 2020-06-12T02:32:18.933 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-06-12T02:32:18.934 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-06-12T02:32:18.982 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:18 +0000 (0:00:00.077) 0:02:26.558 *********** 2020-06-12T02:32:19.157 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-06-12T02:32:19.158 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1591928775.6428332, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1591928775.6388354, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 103548, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1591928775.6388354, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "2808146272", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-06-12T02:32:19.210 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.230) 0:02:26.788 *********** 2020-06-12T02:32:19.242 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-06-12T02:32:19.244 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false} 2020-06-12T02:32:19.291 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.080) 0:02:26.869 *********** 2020-06-12T02:32:19.332 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-06-12T02:32:19.334 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-06-12T02:32:19.372 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.081) 0:02:26.951 *********** 2020-06-12T02:32:19.547 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-06-12T02:32:19.549 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1591928769.4085393, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1591928769.4045413, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 103548, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1591928769.4045413, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "2808146272", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-06-12T02:32:19.585 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.212) 0:02:27.163 *********** 2020-06-12T02:32:19.662 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-06-12T02:32:19.663 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-06-12T02:32:19.699 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.114) 0:02:27.278 *********** 2020-06-12T02:32:19.732 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-06-12T02:32:19.768 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.068) 0:02:27.346 *********** 2020-06-12T02:32:19.782 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi117.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-12T02:32:19.827 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.057) 0:02:27.404 *********** 2020-06-12T02:32:19.837 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-06-12T02:32:19.880 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.052) 0:02:27.457 *********** 2020-06-12T02:32:19.887 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-06-12T02:32:19.889 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:19.931 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.052) 0:02:27.510 *********** 2020-06-12T02:32:19.941 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:19.982 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:19 +0000 (0:00:00.050) 0:02:27.560 *********** 2020-06-12T02:32:20.074 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-06-12T02:32:20.076 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-12T02:32:20.121 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.138) 0:02:27.699 *********** 2020-06-12T02:32:20.131 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-06-12T02:32:20.169 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.048) 0:02:27.748 *********** 2020-06-12T02:32:20.271 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-06-12T02:32:20.273 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-12T02:32:20.321 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.151) 0:02:27.899 *********** 2020-06-12T02:32:20.332 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-06-12T02:32:20.378 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.053) 0:02:27.953 *********** 2020-06-12T02:32:20.387 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.427 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.051) 0:02:28.005 *********** 2020-06-12T02:32:20.436 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.479 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.052) 0:02:28.057 *********** 2020-06-12T02:32:20.491 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-06-12T02:32:20.493 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.504 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.506 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.544 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.064) 0:02:28.122 *********** 2020-06-12T02:32:20.554 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.556 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.567 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.569 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.607 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.062) 0:02:28.185 *********** 2020-06-12T02:32:20.629 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.647 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.689 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.082) 0:02:28.267 *********** 2020-06-12T02:32:20.701 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.703 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi142.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.741 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.051) 0:02:28.319 *********** 2020-06-12T02:32:20.750 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-06-12T02:32:20.752 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.794 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.052) 0:02:28.372 *********** 2020-06-12T02:32:20.803 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.846 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.052) 0:02:28.424 *********** 2020-06-12T02:32:20.855 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-06-12T02:32:20.857 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.899 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.053) 0:02:28.477 *********** 2020-06-12T02:32:20.909 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:20.949 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.049) 0:02:28.527 *********** 2020-06-12T02:32:20.959 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-06-12T02:32:20.961 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.002 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:20 +0000 (0:00:00.052) 0:02:28.580 *********** 2020-06-12T02:32:21.012 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.065 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.062) 0:02:28.643 *********** 2020-06-12T02:32:21.080 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.123 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.058) 0:02:28.701 *********** 2020-06-12T02:32:21.133 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.179 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.055) 0:02:28.757 *********** 2020-06-12T02:32:21.192 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.248 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.069) 0:02:28.827 *********** 2020-06-12T02:32:21.261 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.305 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.056) 0:02:28.883 *********** 2020-06-12T02:32:21.318 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.359 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.053) 0:02:28.937 *********** 2020-06-12T02:32:21.369 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.410 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.052) 0:02:28.989 *********** 2020-06-12T02:32:21.419 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-06-12T02:32:21.422 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.468 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.057) 0:02:29.046 *********** 2020-06-12T02:32:21.479 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.525 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.057) 0:02:29.103 *********** 2020-06-12T02:32:21.534 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-06-12T02:32:21.535 INFO:teuthology.task.ansible.out:skipping: [smithi117.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.571 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.045) 0:02:29.149 *********** 2020-06-12T02:32:21.580 INFO:teuthology.task.ansible.out:skipping: [smithi142.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-06-12T02:32:21.619 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:21 +0000 (0:00:00.047) 0:02:29.197 *********** 2020-06-12T02:32:21.760 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-06-12T02:32:21.771 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.008630", "end": "2020-06-12 02:32:22.130090", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-12 02:32:22.121460", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:21.813 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010985", "end": "2020-06-12 02:32:21.777378", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-06-12 02:32:21.766393", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:21.879 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005962", "end": "2020-06-12 02:32:22.262154", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-12 02:32:22.256192", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:21.948 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006024", "end": "2020-06-12 02:32:21.907165", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-06-12 02:32:21.901141", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:22.012 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005242", "end": "2020-06-12 02:32:22.397303", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 02:32:22.392061", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:22.086 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005637", "end": "2020-06-12 02:32:22.047714", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-06-12 02:32:22.042077", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:22.240 INFO:teuthology.task.ansible.out:ok: [smithi117.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.104491", "end": "2020-06-12 02:32:22.626713", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-12 02:32:22.522222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:22.281 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:22 +0000 (0:00:00.660) 0:02:29.857 *********** 2020-06-12T02:32:22.289 INFO:teuthology.task.ansible.out:ok: [smithi142.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.035499", "end": "2020-06-12 02:32:22.224169", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-06-12 02:32:22.188670", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-06-12T02:32:22.328 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:22 +0000 (0:00:00.048) 0:02:29.906 *********** 2020-06-12T02:32:22.335 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-06-12T02:32:22.373 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:22 +0000 (0:00:00.045) 0:02:29.951 *********** 2020-06-12T02:32:22.419 INFO:teuthology.task.ansible.out:Friday 12 June 2020 02:32:22 +0000 (0:00:00.045) 0:02:29.997 *********** 2020-06-12T02:32:22.522 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-06-12T02:32:22.526 INFO:teuthology.task.ansible.out:changed: [smithi117.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-06-12T02:32:22.593 INFO:teuthology.task.ansible.out:changed: [smithi142.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-06-12T02:32:22.690 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-06-12T02:32:22.692 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-06-12T02:32:22.694 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi117.front.sepia.ceph.com : ok=114 changed=31 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 smithi142.front.sepia.ceph.com : ok=114 changed=31 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 Friday 12 June 2020 02:32:22 +0000 (0:00:00.274) 0:02:30.271 *********** =============================================================================== users : Create all admin users with sudo access. ----------------------- 18.19s 2020-06-12T02:32:22.694 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 16.53s testnode : Ensure packages are not present. ----------------------------- 9.28s testnode : Install packages --------------------------------------------- 8.60s testnode : Zap all non-root disks --------------------------------------- 8.60s users : Remove revoked users -------------------------------------------- 4.19s users : Update authorized_keys for each user with literal keys ---------- 1.87s Gathering Facts --------------------------------------------------------- 1.85s testnode : Update apt cache. -------------------------------------------- 1.80s testnode : Create logical volume(s) ------------------------------------- 1.75s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.59s testnode : Install apt keys --------------------------------------------- 1.42s common : Update apt cache ----------------------------------------------- 1.26s Gathering Facts --------------------------------------------------------- 1.03s testnode : Make sure apt dependencies are installed --------------------- 0.92s common : Set the hardware clock ----------------------------------------- 0.91s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.91s testnode : Inst 2020-06-12T02:32:22.696 INFO:teuthology.task.ansible.out:all non aarch64 packages --------------------------------- 0.87s users : Clone the keys repo --------------------------------------------- 0.81s ansible-managed : Add authorized keys for the ansible user. ------------- 0.76s 2020-06-12T02:32:23.074 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2020-06-12T02:32:23.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:32:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi142:> true 2020-06-12T02:32:23.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-06-12T02:32:23.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-06-12T02:32:23.443 INFO:teuthology.orchestra.run.smithi117:> true 2020-06-12T02:32:23.647 INFO:teuthology.run_tasks:Running task clock... 2020-06-12T02:32:23.691 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-06-12T02:32:23.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-06-12T02:32:23.693 INFO:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-12T02:32:23.757 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-06-12T02:32:23.758 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Command line: ntpd -gq 2020-06-12T02:32:23.759 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: proto: precision = 0.123 usec (-23) 2020-06-12T02:32:23.759 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-06-12T02:32:23.760 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: restrict ::: KOD does nothing without LIMITED. 2020-06-12T02:32:23.760 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen and drop on 0 v6wildcard [::]:123 2020-06-12T02:32:23.760 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-06-12T02:32:23.760 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen normally on 2 lo 127.0.0.1:123 2020-06-12T02:32:23.761 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2020-06-12T02:32:23.761 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen normally on 4 lo [::1]:123 2020-06-12T02:32:23.761 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2020-06-12T02:32:23.761 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:23 ntpd[7808]: Listening on routing socket on fd #22 for interface updates 2020-06-12T02:32:23.762 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-06-12T02:32:23.762 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2020-06-12T02:32:24.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:24.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:24.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:24.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:24.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:24.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:24.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:24.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:24.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:24.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:24.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:24.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:24 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:26.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:26.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:26.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:26.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:26.762 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:26.763 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:26 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:27 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:27 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:27 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:27 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:28.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:28.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:28.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:28.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:28.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:28.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:28.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:28.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:28.760 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:28.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:28.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:28.761 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:28 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:29 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:29.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:29 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:29.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:29 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:29.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:29 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:30.758 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:30.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:30.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:30.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-06-12T02:32:30.759 INFO:teuthology.orchestra.run.smithi142.stderr:12 Jun 02:32:30 ntpd[7808]: can't open /var/log/ntpstats/loopstats.20200612: Permission denied 2020-06-12T02:32:30.759 INFO:teuthology.orchestra.run.smithi142.stdout:12 Jun 02:32:30 ntpd[7808]: ntpd: time slew -0.001121 s 2020-06-12T02:32:30.760 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew -0.001121s 2020-06-12T02:32:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2020-06-12T02:32:30.816 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2020-06-12T02:32:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:30.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-06-12T02:32:30.818 INFO:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-06-12T02:32:30.876 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-06-12T02:32:30.876 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Command line: ntpd -gq 2020-06-12T02:32:30.878 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: proto: precision = 0.111 usec (-23) 2020-06-12T02:32:30.879 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-06-12T02:32:30.879 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: restrict ::: KOD does nothing without LIMITED. 2020-06-12T02:32:30.879 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen and drop on 0 v6wildcard [::]:123 2020-06-12T02:32:30.880 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-06-12T02:32:30.880 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen normally on 2 lo 127.0.0.1:123 2020-06-12T02:32:30.880 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2020-06-12T02:32:30.880 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen normally on 4 lo [::1]:123 2020-06-12T02:32:30.880 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2020-06-12T02:32:30.881 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:31 ntpd[7771]: Listening on routing socket on fd #22 for interface updates 2020-06-12T02:32:30.881 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-06-12T02:32:30.881 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2020-06-12T02:32:31.877 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:32 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:31.877 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:32 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:31.877 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:32 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:31.878 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:32 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:33.878 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:33.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:33.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:33.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:33.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:33.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:33.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:33.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:34 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:34.882 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:35 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:35.883 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:35.883 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:35.883 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:35.884 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:35.884 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:35.884 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:35.884 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:35.884 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:36 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:36.879 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:36.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:36.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:36.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:36.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:36.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:36.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:36.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:37.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:38 ntpd[7771]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-06-12T02:32:37.880 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:38 ntpd[7771]: can't open /var/log/ntpstats/rawstats.20200612: Permission denied 2020-06-12T02:32:37.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:38 ntpd[7771]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-06-12T02:32:37.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:38 ntpd[7771]: can't open /var/log/ntpstats/peerstats.20200612: Permission denied 2020-06-12T02:32:37.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-06-12T02:32:37.881 INFO:teuthology.orchestra.run.smithi117.stderr:12 Jun 02:32:37 ntpd[7771]: can't open /var/log/ntpstats/loopstats.20200612: Permission denied 2020-06-12T02:32:37.881 INFO:teuthology.orchestra.run.smithi117.stdout:12 Jun 02:32:37 ntpd[7771]: ntpd: time set -0.403260 s 2020-06-12T02:32:37.882 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time set -0.403260s 2020-06-12T02:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2020-06-12T02:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2020-06-12T02:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:37.953 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:37.954 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-06-12T02:32:37.955 INFO:teuthology.run_tasks:Running task install... 2020-06-12T02:32:37.966 DEBUG:teuthology.task.install:project ceph 2020-06-12T02:32:37.967 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}} 2020-06-12T02:32:37.967 DEBUG:teuthology.task.install:config {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'} 2020-06-12T02:32:37.968 INFO:teuthology.task.install:Using flavor: basic 2020-06-12T02:32:37.974 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-06-12T02:32:37.975 INFO:teuthology.task.install:extra packages: [] 2020-06-12T02:32:37.976 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-06-12T02:32:38.039 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-06-12T02:32:38.039 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:32:38.040 INFO:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2020-06-12T02:32:38.040 INFO:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2020-06-12T02:32:38.095 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2020-06-12T02:32:38.100 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:32:38.100 INFO:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2020-06-12T02:32:38.129 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-06-12T02:32:38.180 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-06-12T02:32:38.187 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-06-12T02:32:38.188 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2020-06-12T02:32:38.189 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-06-12T02:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-06-12T02:32:38.236 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2020-06-12T02:32:38.237 INFO:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2020-06-12T02:32:38.241 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-06-12T02:32:38.246 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:32:38.247 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-06-12T02:32:38.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:32:38.294 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2020-06-12T02:32:38.295 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:32:38.295 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-06-12T02:32:38.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:32:38.436 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default/ 2020-06-12T02:32:38.437 INFO:teuthology.task.install.deb:Package version is 15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:32:38.480 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default/ 2020-06-12T02:32:38.481 INFO:teuthology.task.install.deb:Package version is 15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:32:38.575 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-06-12T02:32:38.604 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-06-12T02:32:38.621 INFO:teuthology.orchestra.run.smithi142:> sudo apt-get update 2020-06-12T02:32:38.651 INFO:teuthology.orchestra.run.smithi117:> sudo apt-get update 2020-06-12T02:32:38.839 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-06-12T02:32:38.915 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic InRelease 2020-06-12T02:32:38.930 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:32:38.938 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic InRelease 2020-06-12T02:32:38.938 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic Release [7,672 B] 2020-06-12T02:32:38.961 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic Release [7,672 B] 2020-06-12T02:32:38.962 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic Release.gpg 2020-06-12T02:32:38.978 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-06-12T02:32:38.978 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-06-12T02:32:38.985 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,080 B] 2020-06-12T02:32:38.986 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic Release.gpg 2020-06-12T02:32:39.009 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-06-12T02:32:39.010 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-06-12T02:32:39.026 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-06-12T02:32:39.048 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-06-12T02:32:39.057 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,080 B] 2020-06-12T02:32:39.094 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-06-12T02:32:39.128 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-06-12T02:32:39.454 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 26.6 kB in 1s (42.8 kB/s) 2020-06-12T02:32:39.590 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 26.6 kB in 1s (36.9 kB/s) 2020-06-12T02:32:40.645 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:32:40.694 INFO:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.3-196-g91d24f4985-1bionic cephadm=15.2.3-196-g91d24f4985-1bionic ceph-mds=15.2.3-196-g91d24f4985-1bionic ceph-mgr=15.2.3-196-g91d24f4985-1bionic ceph-common=15.2.3-196-g91d24f4985-1bionic ceph-fuse=15.2.3-196-g91d24f4985-1bionic ceph-test=15.2.3-196-g91d24f4985-1bionic radosgw=15.2.3-196-g91d24f4985-1bionic python3-rados=15.2.3-196-g91d24f4985-1bionic python3-rgw=15.2.3-196-g91d24f4985-1bionic python3-cephfs=15.2.3-196-g91d24f4985-1bionic python3-rbd=15.2.3-196-g91d24f4985-1bionic libcephfs2=15.2.3-196-g91d24f4985-1bionic libcephfs-dev=15.2.3-196-g91d24f4985-1bionic librados2=15.2.3-196-g91d24f4985-1bionic librbd1=15.2.3-196-g91d24f4985-1bionic rbd-fuse=15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:32:40.767 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:32:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2020-06-12T02:32:40.815 INFO:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.3-196-g91d24f4985-1bionic cephadm=15.2.3-196-g91d24f4985-1bionic ceph-mds=15.2.3-196-g91d24f4985-1bionic ceph-mgr=15.2.3-196-g91d24f4985-1bionic ceph-common=15.2.3-196-g91d24f4985-1bionic ceph-fuse=15.2.3-196-g91d24f4985-1bionic ceph-test=15.2.3-196-g91d24f4985-1bionic radosgw=15.2.3-196-g91d24f4985-1bionic python3-rados=15.2.3-196-g91d24f4985-1bionic python3-rgw=15.2.3-196-g91d24f4985-1bionic python3-cephfs=15.2.3-196-g91d24f4985-1bionic python3-rbd=15.2.3-196-g91d24f4985-1bionic libcephfs2=15.2.3-196-g91d24f4985-1bionic libcephfs-dev=15.2.3-196-g91d24f4985-1bionic librados2=15.2.3-196-g91d24f4985-1bionic librbd1=15.2.3-196-g91d24f4985-1bionic rbd-fuse=15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:32:40.897 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2020-06-12T02:32:41.006 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2020-06-12T02:32:41.007 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2020-06-12T02:32:41.142 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2020-06-12T02:32:41.142 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2020-06-12T02:32:41.165 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2020-06-12T02:32:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-06-12T02:32:41.166 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-06-12T02:32:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-06-12T02:32:41.167 INFO:teuthology.orchestra.run.smithi142.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-06-12T02:32:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: libsnappy1v5 libxslt1.1 python-attr python-funcsigs python-pastedeploy-tpl 2020-06-12T02:32:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-06-12T02:32:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-06-12T02:32:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-06-12T02:32:41.168 INFO:teuthology.orchestra.run.smithi142.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-06-12T02:32:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: python3-httplib2 python3-joblib python3-json-pointer python3-jsonpatch 2020-06-12T02:32:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-06-12T02:32:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-06-12T02:32:41.169 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-06-12T02:32:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-06-12T02:32:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-06-12T02:32:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-06-12T02:32:41.170 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-06-12T02:32:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-06-12T02:32:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-06-12T02:32:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-06-12T02:32:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-06-12T02:32:41.171 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-06-12T02:32:41.172 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2020-06-12T02:32:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-06-12T02:32:41.172 INFO:teuthology.orchestra.run.smithi142.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-06-12T02:32:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-06-12T02:32:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-06-12T02:32:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-06-12T02:32:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-06-12T02:32:41.173 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-06-12T02:32:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-06-12T02:32:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-06-12T02:32:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-06-12T02:32:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-06-12T02:32:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-06-12T02:32:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-06-12T02:32:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-06-12T02:32:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: python3-watchdog python-werkzeug-doc 2020-06-12T02:32:41.270 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2020-06-12T02:32:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-06-12T02:32:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-06-12T02:32:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-06-12T02:32:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2020-06-12T02:32:41.274 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-06-12T02:32:41.274 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr 2020-06-12T02:32:41.274 INFO:teuthology.orchestra.run.smithi142.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-06-12T02:32:41.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-06-12T02:32:41.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-06-12T02:32:41.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-06-12T02:32:41.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-06-12T02:32:41.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-httplib2 python3-joblib python3-json-pointer python3-jsonpatch 2020-06-12T02:32:41.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-06-12T02:32:41.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-06-12T02:32:41.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-06-12T02:32:41.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-06-12T02:32:41.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-06-12T02:32:41.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-06-12T02:32:41.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados python3-rbd python3-repoze.lru python3-rgw python3-routes 2020-06-12T02:32:41.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa python3-scipy python3-setuptools python3-simplegeneric 2020-06-12T02:32:41.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplejson python3-singledispatch python3-sklearn 2020-06-12T02:32:41.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tk python3-tz 2020-06-12T02:32:41.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob 2020-06-12T02:32:41.278 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse socat 2020-06-12T02:32:41.278 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet 2020-06-12T02:32:41.279 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2020-06-12T02:32:41.279 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 librbd1 2020-06-12T02:32:41.312 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2020-06-12T02:32:41.313 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-06-12T02:32:41.313 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-06-12T02:32:41.313 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-06-12T02:32:41.314 INFO:teuthology.orchestra.run.smithi117.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-06-12T02:32:41.315 INFO:teuthology.orchestra.run.smithi117.stdout: libsnappy1v5 libxslt1.1 python-attr python-funcsigs python-pastedeploy-tpl 2020-06-12T02:32:41.315 INFO:teuthology.orchestra.run.smithi117.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-06-12T02:32:41.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-06-12T02:32:41.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-06-12T02:32:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-06-12T02:32:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: python3-httplib2 python3-joblib python3-json-pointer python3-jsonpatch 2020-06-12T02:32:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-06-12T02:32:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-06-12T02:32:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-06-12T02:32:41.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-06-12T02:32:41.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-06-12T02:32:41.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-06-12T02:32:41.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-06-12T02:32:41.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-06-12T02:32:41.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-06-12T02:32:41.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-06-12T02:32:41.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-06-12T02:32:41.319 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-06-12T02:32:41.319 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2020-06-12T02:32:41.319 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-06-12T02:32:41.319 INFO:teuthology.orchestra.run.smithi117.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-06-12T02:32:41.319 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-06-12T02:32:41.320 INFO:teuthology.orchestra.run.smithi117.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-06-12T02:32:41.320 INFO:teuthology.orchestra.run.smithi117.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-06-12T02:32:41.320 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-06-12T02:32:41.320 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-06-12T02:32:41.320 INFO:teuthology.orchestra.run.smithi117.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-06-12T02:32:41.321 INFO:teuthology.orchestra.run.smithi117.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-06-12T02:32:41.322 INFO:teuthology.orchestra.run.smithi117.stdout: python3-watchdog python-werkzeug-doc 2020-06-12T02:32:41.409 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2020-06-12T02:32:41.409 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-06-12T02:32:41.410 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-06-12T02:32:41.410 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-06-12T02:32:41.410 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2020-06-12T02:32:41.410 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-06-12T02:32:41.412 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr 2020-06-12T02:32:41.413 INFO:teuthology.orchestra.run.smithi117.stdout: python-funcsigs python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-06-12T02:32:41.413 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-06-12T02:32:41.413 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-06-12T02:32:41.413 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-06-12T02:32:41.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-06-12T02:32:41.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-httplib2 python3-joblib python3-json-pointer python3-jsonpatch 2020-06-12T02:32:41.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-06-12T02:32:41.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-06-12T02:32:41.414 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-06-12T02:32:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-06-12T02:32:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-06-12T02:32:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-06-12T02:32:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados python3-rbd python3-repoze.lru python3-rgw python3-routes 2020-06-12T02:32:41.415 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa python3-scipy python3-setuptools python3-simplegeneric 2020-06-12T02:32:41.416 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplejson python3-singledispatch python3-sklearn 2020-06-12T02:32:41.416 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tk python3-tz 2020-06-12T02:32:41.416 INFO:teuthology.orchestra.run.smithi117.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob 2020-06-12T02:32:41.416 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse socat 2020-06-12T02:32:41.416 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet 2020-06-12T02:32:41.417 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2020-06-12T02:32:41.417 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 librbd1 2020-06-12T02:32:41.427 INFO:teuthology.orchestra.run.smithi142.stdout:2 upgraded, 109 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:32:41.428 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 157 MB of archives. 2020-06-12T02:32:41.428 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 729 MB of additional disk space will be used. 2020-06-12T02:32:41.432 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.3-196-g91d24f4985-1bionic [1,618 kB] 2020-06-12T02:32:41.464 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-06-12T02:32:41.546 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-06-12T02:32:41.575 INFO:teuthology.orchestra.run.smithi117.stdout:2 upgraded, 109 newly installed, 0 to remove and 4 not upgraded. 2020-06-12T02:32:41.575 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 157 MB of archives. 2020-06-12T02:32:41.576 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 729 MB of additional disk space will be used. 2020-06-12T02:32:41.576 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.3-196-g91d24f4985-1bionic [1,618 kB] 2020-06-12T02:32:41.593 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.3-196-g91d24f4985-1bionic [3,044 kB] 2020-06-12T02:32:41.603 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-06-12T02:32:41.686 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-06-12T02:32:41.689 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.3-196-g91d24f4985-1bionic [433 kB] 2020-06-12T02:32:41.702 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.3-196-g91d24f4985-1bionic [332 kB] 2020-06-12T02:32:41.717 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.3-196-g91d24f4985-1bionic [20.6 kB] 2020-06-12T02:32:41.717 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.3-196-g91d24f4985-1bionic [132 kB] 2020-06-12T02:32:41.718 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.3-196-g91d24f4985-1bionic [24.2 kB] 2020-06-12T02:32:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.3-196-g91d24f4985-1bionic [309 kB] 2020-06-12T02:32:41.732 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.3-196-g91d24f4985-1bionic [5,348 kB] 2020-06-12T02:32:41.805 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-06-12T02:32:41.812 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-06-12T02:32:41.822 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-06-12T02:32:41.922 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.3-196-g91d24f4985-1bionic [99.2 kB] 2020-06-12T02:32:41.922 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.3-196-g91d24f4985-1bionic [335 kB] 2020-06-12T02:32:41.929 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-06-12T02:32:41.931 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.3-196-g91d24f4985-1bionic [18.6 MB] 2020-06-12T02:32:41.933 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-06-12T02:32:41.949 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-06-12T02:32:41.954 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-06-12T02:32:41.960 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-06-12T02:32:41.965 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-06-12T02:32:41.973 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-06-12T02:32:41.981 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-06-12T02:32:41.992 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-06-12T02:32:42.003 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-06-12T02:32:42.028 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-06-12T02:32:42.032 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-06-12T02:32:42.050 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-06-12T02:32:42.060 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-06-12T02:32:42.062 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-06-12T02:32:42.066 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-06-12T02:32:42.069 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-06-12T02:32:42.108 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-06-12T02:32:42.116 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-06-12T02:32:42.125 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-06-12T02:32:42.130 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-06-12T02:32:42.131 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-06-12T02:32:42.133 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-06-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-06-12T02:32:42.134 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-06-12T02:32:42.136 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-06-12T02:32:42.137 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-06-12T02:32:42.139 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-06-12T02:32:42.146 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-06-12T02:32:42.174 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-06-12T02:32:42.178 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-06-12T02:32:42.195 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-06-12T02:32:42.205 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-06-12T02:32:42.207 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-06-12T02:32:42.211 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-06-12T02:32:42.212 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-06-12T02:32:42.233 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-06-12T02:32:42.275 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-06-12T02:32:42.276 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-06-12T02:32:42.279 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-06-12T02:32:42.280 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-06-12T02:32:42.281 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-06-12T02:32:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-06-12T02:32:42.287 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-06-12T02:32:42.292 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-06-12T02:32:42.292 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-06-12T02:32:42.293 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-06-12T02:32:42.297 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-06-12T02:32:42.305 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-06-12T02:32:42.306 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-06-12T02:32:42.307 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-06-12T02:32:42.356 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-06-12T02:32:42.357 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-06-12T02:32:42.371 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-06-12T02:32:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-06-12T02:32:42.398 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-06-12T02:32:42.437 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-06-12T02:32:42.438 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-06-12T02:32:42.439 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-06-12T02:32:42.444 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-06-12T02:32:42.448 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-06-12T02:32:42.448 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-06-12T02:32:42.449 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-06-12T02:32:42.534 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.3-196-g91d24f4985-1bionic [3,044 kB] 2020-06-12T02:32:42.542 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-06-12T02:32:42.543 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-06-12T02:32:42.610 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.3-196-g91d24f4985-1bionic [5,134 kB] 2020-06-12T02:32:42.678 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-06-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-06-12T02:32:42.718 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-06-12T02:32:42.761 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-06-12T02:32:42.761 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-06-12T02:32:42.762 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-06-12T02:32:42.762 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-06-12T02:32:42.763 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-06-12T02:32:42.763 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-06-12T02:32:42.764 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-06-12T02:32:42.799 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.3-196-g91d24f4985-1bionic [139 kB] 2020-06-12T02:32:42.803 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.3-196-g91d24f4985-1bionic [1,279 kB] 2020-06-12T02:32:42.811 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-06-12T02:32:42.841 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-06-12T02:32:42.843 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-06-12T02:32:42.845 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.3-196-g91d24f4985-1bionic [5,943 kB] 2020-06-12T02:32:42.871 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-06-12T02:32:42.873 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-06-12T02:32:42.899 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-06-12T02:32:42.900 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-06-12T02:32:42.900 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-06-12T02:32:42.900 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-06-12T02:32:42.900 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-06-12T02:32:42.901 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-06-12T02:32:42.901 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-06-12T02:32:42.922 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-06-12T02:32:42.923 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-06-12T02:32:42.926 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-06-12T02:32:42.926 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-06-12T02:32:42.927 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-06-12T02:32:42.929 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-06-12T02:32:42.931 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-06-12T02:32:42.932 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-06-12T02:32:42.975 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-06-12T02:32:42.976 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-06-12T02:32:43.003 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-06-12T02:32:43.005 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-06-12T02:32:43.055 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-06-12T02:32:43.057 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-06-12T02:32:43.059 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-06-12T02:32:43.060 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-06-12T02:32:43.060 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-06-12T02:32:43.061 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-06-12T02:32:43.062 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-06-12T02:32:43.063 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-06-12T02:32:43.077 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.3-196-g91d24f4985-1bionic [22.7 MB] 2020-06-12T02:32:43.083 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-06-12T02:32:43.085 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-06-12T02:32:43.086 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-06-12T02:32:43.086 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-06-12T02:32:43.086 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-06-12T02:32:43.089 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-06-12T02:32:43.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-06-12T02:32:43.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-06-12T02:32:43.136 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-06-12T02:32:43.140 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-06-12T02:32:43.164 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-06-12T02:32:43.165 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-06-12T02:32:43.216 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-06-12T02:32:43.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-06-12T02:32:43.218 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-06-12T02:32:43.219 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-06-12T02:32:43.220 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-06-12T02:32:43.224 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-06-12T02:32:43.225 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-06-12T02:32:43.225 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-06-12T02:32:43.245 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-06-12T02:32:43.245 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-06-12T02:32:43.246 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-06-12T02:32:43.297 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-06-12T02:32:43.300 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-06-12T02:32:43.342 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-06-12T02:32:43.343 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-06-12T02:32:43.344 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.2 [329 kB] 2020-06-12T02:32:43.346 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-06-12T02:32:43.347 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-06-12T02:32:43.347 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-06-12T02:32:43.348 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-06-12T02:32:43.380 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-06-12T02:32:43.381 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-06-12T02:32:43.381 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-06-12T02:32:43.406 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-06-12T02:32:43.408 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.3-196-g91d24f4985-1bionic [433 kB] 2020-06-12T02:32:43.408 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-06-12T02:32:43.482 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-06-12T02:32:43.482 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-06-12T02:32:43.483 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.2 [329 kB] 2020-06-12T02:32:43.486 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-06-12T02:32:43.486 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-06-12T02:32:43.487 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-06-12T02:32:43.487 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-06-12T02:32:43.517 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.3-196-g91d24f4985-1bionic [332 kB] 2020-06-12T02:32:43.539 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-06-12T02:32:43.540 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-06-12T02:32:43.574 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.3-196-g91d24f4985-1bionic [20.6 kB] 2020-06-12T02:32:43.574 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.3-196-g91d24f4985-1bionic [132 kB] 2020-06-12T02:32:43.579 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.3-196-g91d24f4985-1bionic [24.2 kB] 2020-06-12T02:32:43.580 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.3-196-g91d24f4985-1bionic [309 kB] 2020-06-12T02:32:43.634 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.3-196-g91d24f4985-1bionic [5,348 kB] 2020-06-12T02:32:44.033 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.3-196-g91d24f4985-1bionic [3,852 B] 2020-06-12T02:32:44.033 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.3-196-g91d24f4985-1bionic [513 kB] 2020-06-12T02:32:44.067 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.3-196-g91d24f4985-1bionic [1,836 kB] 2020-06-12T02:32:44.147 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.3-196-g91d24f4985-1bionic [41.1 kB] 2020-06-12T02:32:44.148 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.3-196-g91d24f4985-1bionic [39.0 kB] 2020-06-12T02:32:44.149 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.3-196-g91d24f4985-1bionic [2,961 kB] 2020-06-12T02:32:44.298 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.3-196-g91d24f4985-1bionic [34.2 kB] 2020-06-12T02:32:44.299 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.3-196-g91d24f4985-1bionic [7,886 kB] 2020-06-12T02:32:44.318 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.3-196-g91d24f4985-1bionic [99.2 kB] 2020-06-12T02:32:44.320 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.3-196-g91d24f4985-1bionic [335 kB] 2020-06-12T02:32:44.386 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.3-196-g91d24f4985-1bionic [18.6 MB] 2020-06-12T02:32:44.704 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.3-196-g91d24f4985-1bionic [3,964 B] 2020-06-12T02:32:44.705 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.3-196-g91d24f4985-1bionic [22.4 kB] 2020-06-12T02:32:44.705 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.3-196-g91d24f4985-1bionic [43.4 MB] 2020-06-12T02:32:45.953 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.3-196-g91d24f4985-1bionic [5,134 kB] 2020-06-12T02:32:46.346 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.3-196-g91d24f4985-1bionic [139 kB] 2020-06-12T02:32:46.349 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.3-196-g91d24f4985-1bionic [1,279 kB] 2020-06-12T02:32:46.469 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.3-196-g91d24f4985-1bionic [5,943 kB] 2020-06-12T02:32:46.900 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.3-196-g91d24f4985-1bionic [22.7 MB] 2020-06-12T02:32:47.345 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.3-196-g91d24f4985-1bionic [17.9 kB] 2020-06-12T02:32:47.346 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.3-196-g91d24f4985-1bionic [8,489 kB] 2020-06-12T02:32:47.895 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.3-196-g91d24f4985-1bionic [62.4 kB] 2020-06-12T02:32:48.256 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.3-196-g91d24f4985-1bionic [3,852 B] 2020-06-12T02:32:48.257 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.3-196-g91d24f4985-1bionic [513 kB] 2020-06-12T02:32:48.273 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.3-196-g91d24f4985-1bionic [1,836 kB] 2020-06-12T02:32:48.342 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.3-196-g91d24f4985-1bionic [41.1 kB] 2020-06-12T02:32:48.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.3-196-g91d24f4985-1bionic [39.0 kB] 2020-06-12T02:32:48.344 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.3-196-g91d24f4985-1bionic [2,961 kB] 2020-06-12T02:32:48.454 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.3-196-g91d24f4985-1bionic [34.2 kB] 2020-06-12T02:32:48.455 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.3-196-g91d24f4985-1bionic [7,886 kB] 2020-06-12T02:32:48.603 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 157 MB in 7s (23.7 MB/s) 2020-06-12T02:32:48.745 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-uritemplate. 2020-06-12T02:32:48.749 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.3-196-g91d24f4985-1bionic [3,964 B] 2020-06-12T02:32:48.750 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.3-196-g91d24f4985-1bionic [22.4 kB] 2020-06-12T02:32:48.750 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.3-196-g91d24f4985-1bionic [43.4 MB] 2020-06-12T02:32:48.795 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137550 files and directories currently installed.) 2020-06-12T02:32:48.799 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-06-12T02:32:48.843 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-06-12T02:32:49.121 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-06-12T02:32:49.134 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-06-12T02:32:49.196 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-06-12T02:32:49.556 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-librbd1_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:49.684 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (15.2.3-196-g91d24f4985-1bionic) over (12.2.12-0ubuntu0.18.04.5) ... 2020-06-12T02:32:50.227 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-librados2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:50.354 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (15.2.3-196-g91d24f4985-1bionic) over (12.2.12-0ubuntu0.18.04.5) ... 2020-06-12T02:32:50.386 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.3-196-g91d24f4985-1bionic [17.9 kB] 2020-06-12T02:32:50.387 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.3-196-g91d24f4985-1bionic [8,489 kB] 2020-06-12T02:32:50.701 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/91d24f498556f86f6d1318d2efd5210c35b36762/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.3-196-g91d24f4985-1bionic [62.4 kB] 2020-06-12T02:32:50.944 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2020-06-12T02:32:50.954 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-libcephfs2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:50.991 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:51.335 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2020-06-12T02:32:51.349 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-python3-rados_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:51.387 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 157 MB in 9s (16.9 MB/s) 2020-06-12T02:32:51.394 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:51.514 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-uritemplate. 2020-06-12T02:32:51.563 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137550 files and directories currently installed.) 2020-06-12T02:32:51.568 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-06-12T02:32:51.612 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-06-12T02:32:51.746 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-06-12T02:32:51.762 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:32:51.804 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:51.848 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-06-12T02:32:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-06-12T02:32:51.949 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-06-12T02:32:52.049 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2020-06-12T02:32:52.063 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-python3-cephfs_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:52.099 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:52.332 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-librbd1_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:52.452 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2020-06-12T02:32:52.452 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (15.2.3-196-g91d24f4985-1bionic) over (12.2.12-0ubuntu0.18.04.5) ... 2020-06-12T02:32:52.467 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:32:52.510 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:52.821 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2020-06-12T02:32:52.836 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-06-12T02:32:52.898 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-06-12T02:32:52.971 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-librados2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:53.073 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (15.2.3-196-g91d24f4985-1bionic) over (12.2.12-0ubuntu0.18.04.5) ... 2020-06-12T02:32:53.149 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2020-06-12T02:32:53.162 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-python3-rbd_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:53.199 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:53.577 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-06-12T02:32:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-06-12T02:32:53.635 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-06-12T02:32:53.728 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2020-06-12T02:32:53.742 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-libcephfs2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:53.778 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:53.954 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-06-12T02:32:53.970 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-06-12T02:32:54.012 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-06-12T02:32:54.056 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2020-06-12T02:32:54.071 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-python3-rados_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:54.106 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:54.349 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2020-06-12T02:32:54.362 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-librgw2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:54.392 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-06-12T02:32:54.399 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:54.407 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:32:54.442 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:54.761 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2020-06-12T02:32:54.776 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-python3-cephfs_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:54.819 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:55.043 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2020-06-12T02:32:55.056 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-python3-rgw_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:55.139 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2020-06-12T02:32:55.154 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:32:55.197 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:55.429 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-06-12T02:32:55.444 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-06-12T02:32:55.475 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2020-06-12T02:32:55.487 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-06-12T02:32:55.488 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-06-12T02:32:55.525 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-06-12T02:32:55.761 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2020-06-12T02:32:55.776 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-python3-rbd_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:55.819 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:55.823 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-06-12T02:32:55.836 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-06-12T02:32:55.882 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-06-12T02:32:56.201 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0. 2020-06-12T02:32:56.216 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-06-12T02:32:56.222 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-06-12T02:32:56.236 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-06-12T02:32:56.251 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-06-12T02:32:56.280 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-06-12T02:32:56.579 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2020-06-12T02:32:56.592 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-libradosstriper1_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:56.616 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-06-12T02:32:56.630 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-06-12T02:32:56.654 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:56.666 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-06-12T02:32:56.961 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2020-06-12T02:32:56.976 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-librgw2_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:57.011 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:57.132 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2020-06-12T02:32:57.147 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-ceph-common_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:57.190 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:57.696 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2020-06-12T02:32:57.709 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-rgw_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:57.746 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:58.082 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-06-12T02:32:58.096 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-06-12T02:32:58.140 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-06-12T02:32:58.421 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-06-12T02:32:58.434 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-06-12T02:32:58.469 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-06-12T02:32:58.863 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0. 2020-06-12T02:32:58.878 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-06-12T02:32:58.922 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-06-12T02:32:58.951 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2020-06-12T02:32:58.960 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-ceph-base_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:59.015 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:59.240 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2020-06-12T02:32:59.255 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-libradosstriper1_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:59.298 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:59.694 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2020-06-12T02:32:59.707 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-ceph-common_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:32:59.736 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:32:59.901 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-dateutil. 2020-06-12T02:32:59.917 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-06-12T02:32:59.959 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-06-12T02:33:00.295 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asn1crypto. 2020-06-12T02:33:00.309 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-06-12T02:33:00.346 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-06-12T02:33:00.606 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cffi-backend. 2020-06-12T02:33:00.620 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-06-12T02:33:00.666 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-06-12T02:33:01.001 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cryptography. 2020-06-12T02:33:01.016 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-06-12T02:33:01.059 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-06-12T02:33:01.413 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2020-06-12T02:33:01.433 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-06-12T02:33:01.471 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-06-12T02:33:01.474 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2020-06-12T02:33:01.489 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-ceph-base_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:01.540 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:01.740 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-06-12T02:33:01.756 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:01.799 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-modules-core (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:02.186 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2020-06-12T02:33:02.199 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-06-12T02:33:02.244 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-06-12T02:33:02.378 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-dateutil. 2020-06-12T02:33:02.392 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-06-12T02:33:02.429 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-06-12T02:33:02.547 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2020-06-12T02:33:02.566 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-06-12T02:33:02.605 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-06-12T02:33:03.001 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jwt. 2020-06-12T02:33:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-06-12T02:33:03.023 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asn1crypto. 2020-06-12T02:33:03.039 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-06-12T02:33:03.051 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-06-12T02:33:03.081 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-06-12T02:33:03.343 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cffi-backend. 2020-06-12T02:33:03.356 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-06-12T02:33:03.393 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-06-12T02:33:03.437 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2020-06-12T02:33:03.450 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-06-12T02:33:03.495 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-06-12T02:33:03.687 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cryptography. 2020-06-12T02:33:03.703 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-06-12T02:33:03.745 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-06-12T02:33:03.815 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2020-06-12T02:33:03.834 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-06-12T02:33:03.898 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-06-12T02:33:04.107 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2020-06-12T02:33:04.121 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-06-12T02:33:04.166 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-06-12T02:33:04.193 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2020-06-12T02:33:04.207 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-06-12T02:33:04.243 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-06-12T02:33:04.443 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-06-12T02:33:04.456 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:04.501 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:04.571 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2020-06-12T02:33:04.586 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-06-12T02:33:04.629 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-06-12T02:33:04.839 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2020-06-12T02:33:04.855 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-06-12T02:33:04.897 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-06-12T02:33:04.931 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2020-06-12T02:33:04.945 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-06-12T02:33:04.981 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-06-12T02:33:05.225 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2020-06-12T02:33:05.243 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-06-12T02:33:05.274 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-06-12T02:33:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2020-06-12T02:33:05.324 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-06-12T02:33:05.368 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-06-12T02:33:05.645 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jwt. 2020-06-12T02:33:05.660 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-06-12T02:33:05.703 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-06-12T02:33:05.729 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bs4. 2020-06-12T02:33:05.745 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-06-12T02:33:05.787 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-06-12T02:33:06.007 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2020-06-12T02:33:06.022 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-06-12T02:33:06.089 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-06-12T02:33:06.115 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2020-06-12T02:33:06.130 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-06-12T02:33:06.173 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-06-12T02:33:06.400 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2020-06-12T02:33:06.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-06-12T02:33:06.450 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-06-12T02:33:06.518 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2020-06-12T02:33:06.532 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-06-12T02:33:06.576 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-06-12T02:33:06.753 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2020-06-12T02:33:06.768 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-06-12T02:33:06.811 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-06-12T02:33:06.887 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2020-06-12T02:33:06.904 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-06-12T02:33:06.949 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-06-12T02:33:07.122 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2020-06-12T02:33:07.137 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-06-12T02:33:07.181 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-06-12T02:33:07.240 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-06-12T02:33:07.257 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-06-12T02:33:07.299 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-06-12T02:33:07.509 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2020-06-12T02:33:07.524 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-06-12T02:33:07.567 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-06-12T02:33:07.627 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2020-06-12T02:33:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-06-12T02:33:07.685 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-06-12T02:33:07.886 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2020-06-12T02:33:07.903 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-06-12T02:33:07.945 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-06-12T02:33:08.239 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bs4. 2020-06-12T02:33:08.254 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-06-12T02:33:08.296 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2020-06-12T02:33:08.297 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-06-12T02:33:08.311 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-06-12T02:33:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-06-12T02:33:08.658 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2020-06-12T02:33:08.679 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-06-12T02:33:08.724 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2020-06-12T02:33:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-06-12T02:33:08.740 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-06-12T02:33:08.794 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-06-12T02:33:09.045 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2020-06-12T02:33:09.060 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-06-12T02:33:09.103 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-06-12T02:33:09.162 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2020-06-12T02:33:09.178 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-06-12T02:33:09.220 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-06-12T02:33:09.406 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2020-06-12T02:33:09.420 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-06-12T02:33:09.464 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-06-12T02:33:09.590 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2020-06-12T02:33:09.604 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-ceph-mgr_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:09.674 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:09.809 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-06-12T02:33:09.830 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-06-12T02:33:09.867 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-06-12T02:33:10.127 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2020-06-12T02:33:10.140 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-ceph-mon_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:10.178 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2020-06-12T02:33:10.184 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:10.192 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-06-12T02:33:10.237 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-06-12T02:33:10.533 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2020-06-12T02:33:10.545 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-06-12T02:33:10.590 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-06-12T02:33:10.959 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2020-06-12T02:33:10.974 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-06-12T02:33:11.017 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-06-12T02:33:11.080 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2020-06-12T02:33:11.097 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-ceph-osd_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:11.130 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:11.347 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2020-06-12T02:33:11.362 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-06-12T02:33:11.405 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-06-12T02:33:11.783 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2020-06-12T02:33:11.794 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-ceph-mgr_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:11.833 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:12.311 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2020-06-12T02:33:12.327 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-ceph-mon_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:12.369 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:12.943 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2020-06-12T02:33:12.958 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-ceph_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:13.003 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:13.946 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2020-06-12T02:33:13.962 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-ceph-fuse_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:13.996 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:14.006 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2020-06-12T02:33:14.020 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-ceph-osd_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:14.056 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:14.393 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2020-06-12T02:33:14.409 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-ceph-mds_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:14.451 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:14.912 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2020-06-12T02:33:14.928 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-cephadm_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:14.979 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:15.248 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-06-12T02:33:15.264 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:15.307 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:15.643 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2020-06-12T02:33:15.658 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-1_all.deb ... 2020-06-12T02:33:15.701 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-06-12T02:33:15.878 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2020-06-12T02:33:15.891 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-ceph_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:15.928 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:16.007 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2020-06-12T02:33:16.018 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-python3-routes_2.4.1-1_all.deb ... 2020-06-12T02:33:16.062 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-06-12T02:33:16.230 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2020-06-12T02:33:16.246 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-ceph-fuse_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:16.280 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:16.373 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-06-12T02:33:16.389 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-ceph-mgr-dashboard_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:16.423 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:16.650 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2020-06-12T02:33:16.669 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-ceph-mds_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:16.709 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:17.195 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2020-06-12T02:33:17.209 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-cephadm_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:17.253 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:17.329 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-06-12T02:33:17.344 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-ceph-mgr-diskprediction-cloud_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:17.387 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:17.623 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-06-12T02:33:17.638 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:17.673 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:17.699 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-numpy. 2020-06-12T02:33:17.712 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-06-12T02:33:17.756 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-06-12T02:33:17.967 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2020-06-12T02:33:17.983 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-1_all.deb ... 2020-06-12T02:33:18.017 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-06-12T02:33:18.337 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2020-06-12T02:33:18.352 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-routes_2.4.1-1_all.deb ... 2020-06-12T02:33:18.354 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-decorator. 2020-06-12T02:33:18.370 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-python3-decorator_4.1.2-1_all.deb ... 2020-06-12T02:33:18.396 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-06-12T02:33:18.404 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-06-12T02:33:18.689 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-06-12T02:33:18.703 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-ceph-mgr-dashboard_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:18.731 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-scipy. 2020-06-12T02:33:18.747 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-06-12T02:33:18.747 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:18.789 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-06-12T02:33:19.663 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-06-12T02:33:19.677 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-ceph-mgr-diskprediction-cloud_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:19.713 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:19.974 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-numpy. 2020-06-12T02:33:19.990 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-06-12T02:33:20.024 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-06-12T02:33:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-06-12T02:33:20.107 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-06-12T02:33:20.148 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-06-12T02:33:20.609 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2020-06-12T02:33:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-decorator. 2020-06-12T02:33:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-python3-decorator_4.1.2-1_all.deb ... 2020-06-12T02:33:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-06-12T02:33:20.724 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-python3-joblib_0.11-1_all.deb ... 2020-06-12T02:33:20.724 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.11-1) ... 2020-06-12T02:33:20.916 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-scipy. 2020-06-12T02:33:20.929 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-06-12T02:33:20.966 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-06-12T02:33:21.038 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2020-06-12T02:33:21.054 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-python3-sklearn_0.19.1-3_all.deb ... 2020-06-12T02:33:21.096 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-06-12T02:33:21.652 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-06-12T02:33:21.668 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:21.711 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:22.174 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-06-12T02:33:22.189 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-06-12T02:33:22.225 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-06-12T02:33:22.686 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2020-06-12T02:33:22.704 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-python3-joblib_0.11-1_all.deb ... 2020-06-12T02:33:22.744 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.11-1) ... 2020-06-12T02:33:22.821 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-monotonic. 2020-06-12T02:33:22.839 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-python3-monotonic_1.1-2_all.deb ... 2020-06-12T02:33:22.880 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-06-12T02:33:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2020-06-12T02:33:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-python3-sklearn_0.19.1-3_all.deb ... 2020-06-12T02:33:23.190 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-fasteners. 2020-06-12T02:33:23.198 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-06-12T02:33:23.205 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-python3-fasteners_0.12.0-3_all.deb ... 2020-06-12T02:33:23.273 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-06-12T02:33:23.627 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-httplib2. 2020-06-12T02:33:23.641 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-06-12T02:33:23.685 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-06-12T02:33:23.730 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-06-12T02:33:23.747 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:24.013 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2020-06-12T02:33:24.034 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3_all.deb ... 2020-06-12T02:33:24.071 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-06-12T02:33:24.399 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-06-12T02:33:24.414 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-06-12T02:33:24.449 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-06-12T02:33:24.744 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2020-06-12T02:33:24.757 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-python3-rsa_3.4.2-1_all.deb ... 2020-06-12T02:33:24.793 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-06-12T02:33:24.849 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-monotonic. 2020-06-12T02:33:24.862 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-python3-monotonic_1.1-2_all.deb ... 2020-06-12T02:33:24.907 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-06-12T02:33:25.106 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-06-12T02:33:25.114 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-06-12T02:33:25.154 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-06-12T02:33:25.185 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-fasteners. 2020-06-12T02:33:25.200 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-python3-fasteners_0.12.0-3_all.deb ... 2020-06-12T02:33:25.248 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-06-12T02:33:25.531 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-httplib2. 2020-06-12T02:33:25.550 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-06-12T02:33:25.587 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-06-12T02:33:25.634 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-oauth2client. 2020-06-12T02:33:25.650 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-python3-oauth2client_4.1.2-3_all.deb ... 2020-06-12T02:33:25.692 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-06-12T02:33:25.923 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2020-06-12T02:33:25.937 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3_all.deb ... 2020-06-12T02:33:25.982 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-06-12T02:33:26.036 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-setuptools. 2020-06-12T02:33:26.052 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-setuptools_39.0.1-2_all.deb ... 2020-06-12T02:33:26.116 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-06-12T02:33:26.285 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-06-12T02:33:26.298 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-06-12T02:33:26.335 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-06-12T02:33:26.523 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2020-06-12T02:33:26.539 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-06-12T02:33:26.581 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-06-12T02:33:26.604 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2020-06-12T02:33:26.620 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-python3-rsa_3.4.2-1_all.deb ... 2020-06-12T02:33:26.654 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-06-12T02:33:26.916 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-06-12T02:33:26.928 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2020-06-12T02:33:26.932 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-06-12T02:33:26.941 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-06-12T02:33:26.974 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-06-12T02:33:26.984 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-06-12T02:33:27.421 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-06-12T02:33:27.438 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:27.453 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-oauth2client. 2020-06-12T02:33:27.468 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python3-oauth2client_4.1.2-3_all.deb ... 2020-06-12T02:33:27.482 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:27.512 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-06-12T02:33:27.782 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-json-pointer. 2020-06-12T02:33:27.798 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-python3-json-pointer_1.10-1_all.deb ... 2020-06-12T02:33:27.840 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-setuptools. 2020-06-12T02:33:27.840 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-06-12T02:33:27.855 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-setuptools_39.0.1-2_all.deb ... 2020-06-12T02:33:27.898 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-06-12T02:33:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jsonpatch. 2020-06-12T02:33:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-06-12T02:33:28.271 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-06-12T02:33:28.318 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2020-06-12T02:33:28.333 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-06-12T02:33:28.382 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-06-12T02:33:28.629 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-06-12T02:33:28.644 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-ceph-mgr-rook_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:28.688 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2020-06-12T02:33:28.702 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-rook (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:28.705 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-06-12T02:33:28.738 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-06-12T02:33:29.057 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig4:amd64. 2020-06-12T02:33:29.072 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-06-12T02:33:29.115 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-06-12T02:33:29.158 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-06-12T02:33:29.175 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:29.216 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:29.468 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2020-06-12T02:33:29.486 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-06-12T02:33:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-json-pointer. 2020-06-12T02:33:29.576 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-json-pointer_1.10-1_all.deb ... 2020-06-12T02:33:29.619 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-06-12T02:33:29.634 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-06-12T02:33:29.922 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2020-06-12T02:33:29.938 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-06-12T02:33:29.964 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jsonpatch. 2020-06-12T02:33:29.981 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-06-12T02:33:29.981 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-06-12T02:33:30.025 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-06-12T02:33:30.266 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2020-06-12T02:33:30.286 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-06-12T02:33:30.325 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-06-12T02:33:30.327 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-06-12T02:33:30.340 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-ceph-mgr-rook_15.2.3-196-g91d24f4985-1bionic_all.deb ... 2020-06-12T02:33:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-rook (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:30.729 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-06-12T02:33:30.738 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig4:amd64. 2020-06-12T02:33:30.744 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-06-12T02:33:30.757 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-06-12T02:33:30.805 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-06-12T02:33:30.813 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-06-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2020-06-12T02:33:31.115 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-06-12T02:33:31.156 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-06-12T02:33:31.166 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2020-06-12T02:33:31.182 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-06-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-06-12T02:33:31.518 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2020-06-12T02:33:31.533 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-ceph-test_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:31.570 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2020-06-12T02:33:31.576 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:31.579 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-06-12T02:33:31.621 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-06-12T02:33:31.890 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2020-06-12T02:33:31.904 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-06-12T02:33:31.949 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-06-12T02:33:32.311 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-06-12T02:33:32.325 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-06-12T02:33:32.369 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-06-12T02:33:32.647 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2020-06-12T02:33:32.661 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-06-12T02:33:32.705 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-06-12T02:33:33.051 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2020-06-12T02:33:33.068 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-ceph-test_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:33.110 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:34.813 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2020-06-12T02:33:34.827 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:34.896 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:35.207 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-attr. 2020-06-12T02:33:35.223 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2020-06-12T02:33:35.265 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-attr (17.4.0-2) ... 2020-06-12T02:33:35.610 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-funcsigs. 2020-06-12T02:33:35.624 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-python-funcsigs_1.0.2-4_all.deb ... 2020-06-12T02:33:35.668 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-06-12T02:33:35.971 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pluggy. 2020-06-12T02:33:35.985 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-python-pluggy_0.6.0-1_all.deb ... 2020-06-12T02:33:36.029 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-06-12T02:33:36.357 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-py. 2020-06-12T02:33:36.374 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-python-py_1.5.2-1_all.deb ... 2020-06-12T02:33:36.415 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-py (1.5.2-1) ... 2020-06-12T02:33:36.421 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2020-06-12T02:33:36.436 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:36.479 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:36.751 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pytest. 2020-06-12T02:33:36.767 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-python-pytest_3.3.2-2_all.deb ... 2020-06-12T02:33:36.798 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-attr. 2020-06-12T02:33:36.810 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-06-12T02:33:36.815 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2020-06-12T02:33:36.865 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-attr (17.4.0-2) ... 2020-06-12T02:33:37.130 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-attr. 2020-06-12T02:33:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-python3-attr_17.4.0-2_all.deb ... 2020-06-12T02:33:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-06-12T02:33:37.192 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-funcsigs. 2020-06-12T02:33:37.210 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-python-funcsigs_1.0.2-4_all.deb ... 2020-06-12T02:33:37.251 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-06-12T02:33:37.507 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cycler. 2020-06-12T02:33:37.527 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-python3-cycler_0.10.0-1_all.deb ... 2020-06-12T02:33:37.573 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-06-12T02:33:37.587 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pluggy. 2020-06-12T02:33:37.601 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-python-pluggy_0.6.0-1_all.deb ... 2020-06-12T02:33:37.645 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-06-12T02:33:37.893 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webencodings. 2020-06-12T02:33:37.910 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-python3-webencodings_0.5-2_all.deb ... 2020-06-12T02:33:37.951 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-06-12T02:33:37.956 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-py. 2020-06-12T02:33:37.972 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-python-py_1.5.2-1_all.deb ... 2020-06-12T02:33:38.014 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-py (1.5.2-1) ... 2020-06-12T02:33:38.254 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-html5lib. 2020-06-12T02:33:38.268 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-python3-html5lib_0.999999999-1_all.deb ... 2020-06-12T02:33:38.320 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-06-12T02:33:38.343 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pytest. 2020-06-12T02:33:38.357 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-python-pytest_3.3.2-2_all.deb ... 2020-06-12T02:33:38.402 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-06-12T02:33:38.758 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-attr. 2020-06-12T02:33:38.769 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-python3-attr_17.4.0-2_all.deb ... 2020-06-12T02:33:38.813 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-06-12T02:33:39.107 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-06-12T02:33:39.122 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-06-12T02:33:39.149 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cycler. 2020-06-12T02:33:39.164 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-python3-cycler_0.10.0-1_all.deb ... 2020-06-12T02:33:39.165 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-06-12T02:33:39.207 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-06-12T02:33:39.502 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webencodings. 2020-06-12T02:33:39.518 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-python3-webencodings_0.5-2_all.deb ... 2020-06-12T02:33:39.560 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-06-12T02:33:39.584 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyparsing. 2020-06-12T02:33:39.601 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-06-12T02:33:39.643 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-06-12T02:33:39.888 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-html5lib. 2020-06-12T02:33:39.903 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-python3-html5lib_0.999999999-1_all.deb ... 2020-06-12T02:33:39.946 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-06-12T02:33:39.979 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tz. 2020-06-12T02:33:39.996 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-python3-tz_2018.3-2_all.deb ... 2020-06-12T02:33:40.037 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tz (2018.3-2) ... 2020-06-12T02:33:40.291 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-06-12T02:33:40.305 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-06-12T02:33:40.349 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-06-12T02:33:40.357 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-matplotlib. 2020-06-12T02:33:40.372 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-06-12T02:33:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-06-12T02:33:40.769 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyparsing. 2020-06-12T02:33:40.786 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-06-12T02:33:40.827 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-06-12T02:33:41.120 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-olefile. 2020-06-12T02:33:41.134 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-python3-olefile_0.45.1-1_all.deb ... 2020-06-12T02:33:41.178 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-06-12T02:33:41.196 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tz. 2020-06-12T02:33:41.212 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-python3-tz_2018.3-2_all.deb ... 2020-06-12T02:33:41.255 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tz (2018.3-2) ... 2020-06-12T02:33:41.507 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2020-06-12T02:33:41.520 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-2_all.deb ... 2020-06-12T02:33:41.558 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-matplotlib. 2020-06-12T02:33:41.564 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-06-12T02:33:41.573 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-06-12T02:33:41.616 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-06-12T02:33:41.918 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pil:amd64. 2020-06-12T02:33:41.933 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-python3-pil_5.1.0-1ubuntu0.2_amd64.deb ... 2020-06-12T02:33:42.001 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-06-12T02:33:42.347 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-olefile. 2020-06-12T02:33:42.363 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-python3-olefile_0.45.1-1_all.deb ... 2020-06-12T02:33:42.371 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2020-06-12T02:33:42.385 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-python3-pluggy_0.6.0-1_all.deb ... 2020-06-12T02:33:42.413 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-06-12T02:33:42.429 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-06-12T02:33:42.724 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2020-06-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-2_all.deb ... 2020-06-12T02:33:42.765 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2020-06-12T02:33:42.782 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-python3-py_1.5.2-1_all.deb ... 2020-06-12T02:33:42.783 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-06-12T02:33:42.823 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.5.2-1) ... 2020-06-12T02:33:43.163 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pil:amd64. 2020-06-12T02:33:43.178 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-python3-pil_5.1.0-1ubuntu0.2_amd64.deb ... 2020-06-12T02:33:43.184 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2020-06-12T02:33:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1_all.deb ... 2020-06-12T02:33:43.220 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-06-12T02:33:43.242 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-06-12T02:33:43.572 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2020-06-12T02:33:43.587 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2020-06-12T02:33:43.589 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-python3-pluggy_0.6.0-1_all.deb ... 2020-06-12T02:33:43.601 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-python3-pytest_3.3.2-2_all.deb ... 2020-06-12T02:33:43.630 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-06-12T02:33:43.645 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-06-12T02:33:43.925 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2020-06-12T02:33:43.946 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python3-py_1.5.2-1_all.deb ... 2020-06-12T02:33:43.983 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.5.2-1) ... 2020-06-12T02:33:44.048 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2020-06-12T02:33:44.064 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-python3-simplejson_3.13.2-1_amd64.deb ... 2020-06-12T02:33:44.106 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-06-12T02:33:44.337 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2020-06-12T02:33:44.354 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1_all.deb ... 2020-06-12T02:33:44.403 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-06-12T02:33:44.468 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tk:amd64. 2020-06-12T02:33:44.483 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-06-12T02:33:44.526 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-06-12T02:33:44.698 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2020-06-12T02:33:44.714 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-pytest_3.3.2-2_all.deb ... 2020-06-12T02:33:44.756 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-06-12T02:33:45.013 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2020-06-12T02:33:45.028 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-radosgw_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:45.072 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:45.109 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2020-06-12T02:33:45.124 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-simplejson_3.13.2-1_amd64.deb ... 2020-06-12T02:33:45.167 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-06-12T02:33:45.546 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tk:amd64. 2020-06-12T02:33:45.560 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-06-12T02:33:45.603 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-06-12T02:33:45.958 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2020-06-12T02:33:45.972 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-rbd-fuse_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:46.007 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:46.082 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2020-06-12T02:33:46.098 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-radosgw_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:46.156 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:46.328 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-06-12T02:33:46.661 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-06-12T02:33:47.047 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-06-12T02:33:47.052 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2020-06-12T02:33:47.070 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-rbd-fuse_15.2.3-196-g91d24f4985-1bionic_amd64.deb ... 2020-06-12T02:33:47.110 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:47.173 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-06-12T02:33:47.405 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-06-12T02:33:47.724 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-06-12T02:33:47.767 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-06-12T02:33:48.125 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-06-12T02:33:48.126 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-06-12T02:33:48.243 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-06-12T02:33:48.411 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webencodings (0.5-2) ... 2020-06-12T02:33:48.729 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-attr (17.4.0-2) ... 2020-06-12T02:33:48.845 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.2) ... 2020-06-12T02:33:48.938 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-06-12T02:33:49.089 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.5.2-1) ... 2020-06-12T02:33:49.255 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-06-12T02:33:49.436 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-06-12T02:33:49.556 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webencodings (0.5-2) ... 2020-06-12T02:33:49.741 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-06-12T02:33:49.857 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-attr (17.4.0-2) ... 2020-06-12T02:33:50.050 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-06-12T02:33:50.051 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-06-12T02:33:50.198 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.5.2-1) ... 2020-06-12T02:33:50.344 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:50.528 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-06-12T02:33:50.645 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-06-12T02:33:50.851 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-06-12T02:33:50.946 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-06-12T02:33:51.072 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-06-12T02:33:51.156 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-06-12T02:33:51.491 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:51.791 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-06-12T02:33:52.023 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-06-12T02:33:52.093 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-06-12T02:33:52.225 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-06-12T02:33:52.318 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-06-12T02:33:52.594 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-py (1.5.2-1) ... 2020-06-12T02:33:52.820 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-06-12T02:33:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-06-12T02:33:53.188 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-06-12T02:33:53.278 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-06-12T02:33:53.464 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-06-12T02:33:53.514 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-06-12T02:33:53.615 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-06-12T02:33:53.816 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-06-12T02:33:53.882 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-py (1.5.2-1) ... 2020-06-12T02:33:54.109 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-06-12T02:33:54.126 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-06-12T02:33:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-06-12T02:33:54.444 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-06-12T02:33:54.533 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-06-12T02:33:54.736 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-06-12T02:33:54.778 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-06-12T02:33:54.905 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-06-12T02:33:55.097 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-06-12T02:33:55.112 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-06-12T02:33:55.390 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-06-12T02:33:55.472 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-06-12T02:33:55.699 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-06-12T02:33:55.773 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:55.992 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-06-12T02:33:56.360 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-06-12T02:33:56.417 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2020-06-12T02:33:56.600 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-06-12T02:33:56.703 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-06-12T02:33:56.890 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-06-12T02:33:57.008 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-06-12T02:33:57.021 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:57.334 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-06-12T02:33:57.618 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-06-12T02:33:57.705 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2020-06-12T02:33:57.769 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-06-12T02:33:57.869 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-06-12T02:33:58.104 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:58.179 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-06-12T02:33:58.305 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-06-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-monotonic (1.1-2) ... 2020-06-12T02:33:58.648 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-06-12T02:33:58.698 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-06-12T02:33:58.816 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-06-12T02:33:58.940 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-06-12T02:33:59.067 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-06-12T02:33:59.167 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-06-12T02:33:59.240 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-06-12T02:33:59.281 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-06-12T02:33:59.393 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:33:59.494 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-06-12T02:33:59.703 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-monotonic (1.1-2) ... 2020-06-12T02:33:59.795 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-06-12T02:33:59.996 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-06-12T02:34:00.087 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-06-12T02:34:00.138 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-06-12T02:34:00.414 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-attr (17.4.0-2) ... 2020-06-12T02:34:00.481 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-06-12T02:34:00.588 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-06-12T02:34:00.628 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-06-12T02:34:00.721 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-06-12T02:34:00.875 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-06-12T02:34:00.899 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-06-12T02:34:01.168 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-06-12T02:34:01.292 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-06-12T02:34:01.365 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-06-12T02:34:01.469 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-06-12T02:34:01.618 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0 (2.6.1-1) ... 2020-06-12T02:34:01.813 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-attr (17.4.0-2) ... 2020-06-12T02:34:01.828 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-06-12T02:34:01.954 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-06-12T02:34:02.121 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-06-12T02:34:02.205 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-06-12T02:34:02.322 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-06-12T02:34:02.356 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-06-12T02:34:02.754 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-06-12T02:34:02.758 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-06-12T02:34:02.850 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-06-12T02:34:02.858 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-06-12T02:34:03.101 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0 (2.6.1-1) ... 2020-06-12T02:34:03.151 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tz (2018.3-2) ... 2020-06-12T02:34:03.277 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-06-12T02:34:03.404 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-06-12T02:34:03.445 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-06-12T02:34:03.646 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-06-12T02:34:03.773 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-06-12T02:34:03.778 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-06-12T02:34:04.088 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.11-1) ... 2020-06-12T02:34:04.182 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-06-12T02:34:04.325 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-06-12T02:34:04.448 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.4.1-1) ... 2020-06-12T02:34:04.617 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tz (2018.3-2) ... 2020-06-12T02:34:04.757 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-06-12T02:34:04.919 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-06-12T02:34:05.066 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-06-12T02:34:05.211 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-06-12T02:34:05.367 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-06-12T02:34:05.521 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.11-1) ... 2020-06-12T02:34:05.710 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-06-12T02:34:05.906 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.4.1-1) ... 2020-06-12T02:34:06.037 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.5+dfsg-2) ... 2020-06-12T02:34:06.163 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-06-12T02:34:06.238 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-06-12T02:34:06.558 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-06-12T02:34:06.884 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-06-12T02:34:07.244 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-06-12T02:34:07.335 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-06-12T02:34:07.554 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.5+dfsg-2) ... 2020-06-12T02:34:07.644 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-06-12T02:34:07.680 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-06-12T02:34:07.970 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-06-12T02:34:08.096 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-06-12T02:34:08.489 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pytest (3.3.2-2) ... 2020-06-12T02:34:08.757 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-06-12T02:34:08.835 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-06-12T02:34:08.866 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-06-12T02:34:08.968 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:09.069 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-06-12T02:34:09.428 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-06-12T02:34:09.797 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:09.946 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-06-12T02:34:09.953 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:10.072 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-06-12T02:34:10.079 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:10.207 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-06-12T02:34:10.448 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pytest (3.3.2-2) ... 2020-06-12T02:34:10.514 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-06-12T02:34:10.708 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-06-12T02:34:10.818 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-06-12T02:34:10.851 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-06-12T02:34:10.977 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:11.103 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-06-12T02:34:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-06-12T02:34:11.437 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:11.563 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:11.689 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:11.832 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-06-12T02:34:11.978 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-06-12T02:34:12.158 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-06-12T02:34:12.468 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-06-12T02:34:12.815 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-06-12T02:34:12.847 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-06-12T02:34:13.168 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:13.612 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-06-12T02:34:13.737 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:13.953 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-06-12T02:34:13.953 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-06-12T02:34:14.214 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:14.340 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-06-12T02:34:14.431 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-06-12T02:34:14.499 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-06-12T02:34:14.535 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-06-12T02:34:14.793 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-06-12T02:34:14.913 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.039 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.323 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.445 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-modules-core (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.483 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.571 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-06-12T02:34:15.697 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-06-12T02:34:15.698 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-06-12T02:34:15.922 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:15.984 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:16.048 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:16.110 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-06-12T02:34:16.197 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:16.200 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-06-12T02:34:16.241 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-06-12T02:34:16.300 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:16.538 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-06-12T02:34:16.800 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2020-06-12T02:34:17.211 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2020-06-12T02:34:17.224 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:17.350 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-06-12T02:34:17.404 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2020-06-12T02:34:17.562 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-06-12T02:34:17.668 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:17.790 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-06-12T02:34:17.819 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:17.945 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:18.071 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:18.111 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:18.342 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-06-12T02:34:18.342 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-06-12T02:34:18.608 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2020-06-12T02:34:18.753 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:18.879 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:19.027 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2020-06-12T02:34:19.211 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-06-12T02:34:19.223 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2020-06-12T02:34:19.383 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-06-12T02:34:19.489 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:19.603 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-06-12T02:34:19.710 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-06-12T02:34:19.711 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-06-12T02:34:19.884 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:20.016 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:20.150 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:20.159 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-06-12T02:34:20.159 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-06-12T02:34:20.584 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-06-12T02:34:20.585 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-06-12T02:34:20.586 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:20.716 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:20.885 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.035 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-06-12T02:34:21.036 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.187 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-rook (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.319 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.330 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.531 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-06-12T02:34:21.531 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-06-12T02:34:21.546 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-06-12T02:34:21.546 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-06-12T02:34:21.810 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.811 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:21.941 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.021 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-06-12T02:34:22.021 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-06-12T02:34:22.299 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-06-12T02:34:22.703 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-06-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.704 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for systemd (237-3ubuntu10.41) ... 2020-06-12T02:34:22.811 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:22.853 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-06-12T02:34:22.954 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-rook (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:23.105 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:23.331 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-06-12T02:34:23.331 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-06-12T02:34:23.598 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:23.830 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-06-12T02:34:23.830 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-06-12T02:34:24.058 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-06-12T02:34:24.090 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:24.098 INFO:teuthology.orchestra.run.smithi142.stdout:ureadahead will be reprofiled on next reboot 2020-06-12T02:34:24.156 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-06-12T02:34:24.225 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:24.368 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (15.2.3-196-g91d24f4985-1bionic) ... 2020-06-12T02:34:24.495 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for systemd (237-3ubuntu10.41) ... 2020-06-12T02:34:24.624 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-06-12T02:34:24.627 DEBUG:teuthology.parallel:result is None 2020-06-12T02:34:24.687 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-06-12T02:34:25.890 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-06-12T02:34:25.944 INFO:teuthology.orchestra.run.smithi117.stdout:ureadahead will be reprofiled on next reboot 2020-06-12T02:34:25.999 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-06-12T02:34:26.439 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-06-12T02:34:26.442 DEBUG:teuthology.parallel:result is None 2020-06-12T02:34:26.443 INFO:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2020-06-12T02:34:26.502 INFO:teuthology.orchestra.run.smithi142.stdout:Ubuntu 2020-06-12T02:34:26.508 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:34:26.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:34:26.689 INFO:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2020-06-12T02:34:26.715 INFO:teuthology.orchestra.run.smithi142.stdout:15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:34:26.716 INFO:teuthology.packaging:The installed version of ceph is 15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:34:26.717 INFO:teuthology.task.install:The correct ceph version 15.2.3-196-g91d24f4985-1bionic is installed. 2020-06-12T02:34:26.718 INFO:teuthology.orchestra.run.smithi117:> sudo lsb_release -is 2020-06-12T02:34:26.778 INFO:teuthology.orchestra.run.smithi117.stdout:Ubuntu 2020-06-12T02:34:26.784 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-06-12T02:34:26.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=91d24f498556f86f6d1318d2efd5210c35b36762 2020-06-12T02:34:26.957 INFO:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2020-06-12T02:34:26.984 INFO:teuthology.orchestra.run.smithi117.stdout:15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:34:26.985 INFO:teuthology.packaging:The installed version of ceph is 15.2.3-196-g91d24f4985-1bionic 2020-06-12T02:34:26.985 INFO:teuthology.task.install:The correct ceph version 15.2.3-196-g91d24f4985-1bionic is installed. 2020-06-12T02:34:26.986 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-06-12T02:34:26.986 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-12T02:34:27.002 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-06-12T02:34:27.041 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-06-12T02:34:27.042 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-12T02:34:27.061 INFO:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-12T02:34:27.118 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-06-12T02:34:27.135 INFO:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-06-12T02:34:27.194 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-06-12T02:34:27.194 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-12T02:34:27.248 INFO:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-12T02:34:27.304 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-06-12T02:34:27.352 INFO:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-06-12T02:34:27.412 INFO:teuthology.run_tasks:Running task ceph... 2020-06-12T02:34:27.528 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-06-12T02:34:27.529 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2020-06-12T02:34:27.532 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2020-06-12T02:34:27.548 INFO:tasks.ceph:Disabling ceph logrotate... 2020-06-12T02:34:27.548 INFO:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2020-06-12T02:34:27.597 INFO:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2020-06-12T02:34:27.612 INFO:tasks.ceph:Creating extra log directories... 2020-06-12T02:34:27.613 INFO:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-06-12T02:34:27.655 INFO:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-06-12T02:34:27.675 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-06-12T02:34:27.676 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 2, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': '*', 'mon client directed command retry': 5, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-06-12T02:34:27.677 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi/5138027', 'branch': 'octopus', 'description': 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml}', 'email': 'tchaikov@gmail.com', 'first_in_suite': False, 'job_id': '5138027', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kchai-2020-06-11_10:13:29-rados-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': '*', 'mon client directed command retry': 5, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 2, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'create_rbd_pool': False, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force'], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'disable_objectstore_tool_tests': True}, 'workunit': {'branch': 'octopus-py3', 'sha1': '1e0d5d60071d5554f87a2be72ea0bcccb272aab3'}}, 'owner': 'scheduled_kchai@teuthology', 'priority': 90, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'octopus-py3', 'suite_path': '/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/tchaikov/ceph.git', 'suite_sha1': '1e0d5d60071d5554f87a2be72ea0bcccb272aab3', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 2, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'enable experimental unrecoverable data corrupting features': '*', 'mon client directed command retry': 5, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'create_rbd_pool': False, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force'], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762', 'cluster': 'ceph'}}, {'thrashosds': {'chance_test_min_size': 3, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_use_overwrites': True, 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.8463', 'targets': {'smithi142.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcZCHhPvTlDmeMXHJYX4Ngg/3hDNaKEJP/Oax7P4WM361db5mpRSaaUoU7PP9UOAxhPYNs298IdY/LgV5UWAXcsTxX9fs437t4pqpbpjTKoTjqOjMpQLRDxtbX7O/mes++0SzJ1DgmL0LTnnia7w8QaKu0JhVVJbAmwWarvANbc+KEKs9ICqCKrmmZhoE9yxU+fiQm7HZ6D/97dTnzX86XGeIxnT033lLpzlNqvgEqUEt/zOI5aScvQsEsdS1RCa0Cl9TETVhMQYz5wayzxT+vFEmXA5g/oQtvxpYKpyDKaB7bNJMwqksvVZ/iBrtxe4+5BsEznW/+KGpV8J+kdqRn', 'smithi117.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC99cai4valUcmR5vgSmhUVGkNsbWrGei6z1qACoMzBOr+H8C5nKeRaByOyf/y4A/t/fE4NMc1+qCK7Pku/nWAQ+OubzIMv3e2VXN8MGwsjayE3l50LUw+Wd+qg2ckOmdZa+ldj2mbXIwyZSwUCS1SKHZp84ImvYK5gJSS35Xki3GiqacVvFvXr0Tfq9rZRkcDy2H5QNZMsz6xI5LOXUyhHc53tdy+5WqoRGvVUDwZopKj8OXCPk8hHgVp/l3JX9CkTHZg+qh3HBzdzhCDe3dpinLG+B6GIMxiASQEPBYBrH9q1edjnaHbis7sbVUWyHAuVWJArkAT2K+NcgoD5EUBp'}} 2020-06-12T02:34:27.679 INFO:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-06-12T02:34:27.719 INFO:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-06-12T02:34:27.726 INFO:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2020-06-12T02:34:27.768 INFO:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2020-06-12T02:34:27.845 DEBUG:teuthology.orchestra.remote:smithi142:/scratch_devs is 72B 2020-06-12T02:34:27.899 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-12T02:34:27.899 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-12T02:34:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-12T02:34:27.907 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:27.907 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-06-12T02:34:27.907 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:27.908 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-06-12 02:32:07.629407830 +0000 2020-06-12T02:34:27.908 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-06-12 02:32:07.465407834 +0000 2020-06-12T02:34:27.908 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-06-12 02:32:07.465407834 +0000 2020-06-12T02:34:27.908 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-06-12T02:34:27.916 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-06-12T02:34:27.916 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-06-12T02:34:27.916 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000391983 s, 1.3 MB/s 2020-06-12T02:34:27.920 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-12T02:34:27.968 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-12T02:34:27.968 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 347 Links: 1 2020-06-12T02:34:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-06-12 02:32:07.945407823 +0000 2020-06-12T02:34:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-06-12 02:32:07.773407827 +0000 2020-06-12T02:34:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-06-12 02:32:07.773407827 +0000 2020-06-12T02:34:27.970 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-06-12T02:34:27.977 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-06-12T02:34:27.977 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-06-12T02:34:27.978 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000319183 s, 1.6 MB/s 2020-06-12T02:34:27.982 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-12T02:34:28.032 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-12T02:34:28.032 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 353 Links: 1 2020-06-12T02:34:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-06-12 02:32:08.201407817 +0000 2020-06-12T02:34:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-06-12 02:32:08.101407820 +0000 2020-06-12T02:34:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-06-12 02:32:08.101407820 +0000 2020-06-12T02:34:28.033 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-06-12T02:34:28.051 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-06-12T02:34:28.052 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-06-12T02:34:28.052 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000381901 s, 1.3 MB/s 2020-06-12T02:34:28.052 INFO:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-12T02:34:28.101 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-12T02:34:28.102 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.102 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 359 Links: 1 2020-06-12T02:34:28.102 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.102 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2020-06-12 02:32:08.485407811 +0000 2020-06-12T02:34:28.103 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2020-06-12 02:32:08.349407814 +0000 2020-06-12T02:34:28.103 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2020-06-12 02:32:08.349407814 +0000 2020-06-12T02:34:28.103 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2020-06-12T02:34:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2020-06-12T02:34:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2020-06-12T02:34:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000366009 s, 1.4 MB/s 2020-06-12T02:34:28.119 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:28.137 DEBUG:teuthology.orchestra.remote:smithi117:/scratch_devs is 72B 2020-06-12T02:34:28.149 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-06-12T02:34:28.150 INFO:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-06-12T02:34:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-06-12T02:34:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.158 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 344 Links: 1 2020-06-12T02:34:28.158 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.158 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2020-06-12 02:32:07.911494838 +0000 2020-06-12T02:34:28.159 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2020-06-12 02:32:07.907496837 +0000 2020-06-12T02:34:28.159 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2020-06-12 02:32:07.907496837 +0000 2020-06-12T02:34:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2020-06-12T02:34:28.167 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2020-06-12T02:34:28.167 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2020-06-12T02:34:28.167 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000312592 s, 1.6 MB/s 2020-06-12T02:34:28.170 INFO:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-06-12T02:34:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-06-12T02:34:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.221 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 351 Links: 1 2020-06-12T02:34:28.221 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.221 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2020-06-12 02:32:08.279310829 +0000 2020-06-12T02:34:28.221 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2020-06-12 02:32:08.151374832 +0000 2020-06-12T02:34:28.222 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2020-06-12 02:32:08.151374832 +0000 2020-06-12T02:34:28.222 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2020-06-12T02:34:28.228 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2020-06-12T02:34:28.229 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2020-06-12T02:34:28.229 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000371857 s, 1.4 MB/s 2020-06-12T02:34:28.233 INFO:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-06-12T02:34:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-06-12T02:34:28.282 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.283 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 357 Links: 1 2020-06-12T02:34:28.283 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.283 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2020-06-12 02:32:08.407246826 +0000 2020-06-12T02:34:28.284 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2020-06-12 02:32:08.403248827 +0000 2020-06-12T02:34:28.285 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2020-06-12 02:32:08.403248827 +0000 2020-06-12T02:34:28.285 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2020-06-12T02:34:28.295 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2020-06-12T02:34:28.296 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2020-06-12T02:34:28.297 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000392743 s, 1.3 MB/s 2020-06-12T02:34:28.297 INFO:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-06-12T02:34:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-06-12T02:34:28.344 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-06-12T02:34:28.345 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 363 Links: 1 2020-06-12T02:34:28.345 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-06-12T02:34:28.345 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2020-06-12 02:32:08.855022817 +0000 2020-06-12T02:34:28.345 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2020-06-12 02:32:08.719090819 +0000 2020-06-12T02:34:28.345 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2020-06-12 02:32:08.719090819 +0000 2020-06-12T02:34:28.346 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2020-06-12T02:34:28.353 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2020-06-12T02:34:28.354 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2020-06-12T02:34:28.354 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000396364 s, 1.3 MB/s 2020-06-12T02:34:28.357 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:28.358 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-06-12T02:34:28.358 INFO:tasks.ceph:Generating config... 2020-06-12T02:34:28.360 INFO:tasks.ceph:[osd] debug monc = 20 2020-06-12T02:34:28.361 INFO:tasks.ceph:[osd] bdev async discard = True 2020-06-12T02:34:28.361 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-06-12T02:34:28.361 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-06-12T02:34:28.361 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-06-12T02:34:28.362 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-06-12T02:34:28.362 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-06-12T02:34:28.363 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-06-12T02:34:28.363 INFO:tasks.ceph:[osd] debug filestore = 20 2020-06-12T02:34:28.363 INFO:tasks.ceph:[osd] debug journal = 20 2020-06-12T02:34:28.364 INFO:tasks.ceph:[osd] debug ms = 20 2020-06-12T02:34:28.364 INFO:tasks.ceph:[osd] debug osd = 25 2020-06-12T02:34:28.364 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-06-12T02:34:28.365 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-06-12T02:34:28.365 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-06-12T02:34:28.365 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-06-12T02:34:28.366 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2020-06-12T02:34:28.366 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2020-06-12T02:34:28.366 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2020-06-12T02:34:28.367 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-06-12T02:34:28.367 INFO:tasks.ceph:[osd] osd max backfills = 2 2020-06-12T02:34:28.367 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2020-06-12T02:34:28.367 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-06-12T02:34:28.368 INFO:tasks.ceph:[osd] osd op queue = debug_random 2020-06-12T02:34:28.368 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2020-06-12T02:34:28.368 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2020-06-12T02:34:28.369 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2020-06-12T02:34:28.369 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-06-12T02:34:28.370 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = * 2020-06-12T02:34:28.371 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-06-12T02:34:28.371 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2020-06-12T02:34:28.371 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2020-06-12T02:34:28.372 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-06-12T02:34:28.372 INFO:tasks.ceph:[mgr] debug ms = 1 2020-06-12T02:34:28.374 INFO:tasks.ceph:[mon] debug mon = 20 2020-06-12T02:34:28.375 INFO:tasks.ceph:[mon] debug ms = 1 2020-06-12T02:34:28.375 INFO:tasks.ceph:[mon] debug paxos = 20 2020-06-12T02:34:28.375 INFO:tasks.ceph:Setting up mon.a... 2020-06-12T02:34:28.376 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-06-12T02:34:28.408 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2020-06-12T02:34:28.410 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-06-12T02:34:28.485 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T02:34:28.544 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'), ('mon.b', '172.21.15.117')] 2020-06-12T02:34:28.545 INFO:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --add b 172.21.15.117 --print /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:28.621 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:28.622 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid c120ba75-2438-45f0-aa6e-10a350976a3c 2020-06-12T02:34:28.622 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2020-06-12T02:34:28.622 INFO:teuthology.orchestra.run.smithi142.stdout:fsid c120ba75-2438-45f0-aa6e-10a350976a3c 2020-06-12T02:34:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2020-06-12T02:34:28.622804+0000 2020-06-12T02:34:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:created 2020-06-12T02:34:28.622804+0000 2020-06-12T02:34:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 0 (unknown) 2020-06-12T02:34:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2020-06-12T02:34:28.623 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2020-06-12T02:34:28.624 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2020-06-12T02:34:28.624 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-06-12T02:34:28.625 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c120ba75-2438-45f0-aa6e-10a350976a3c... 2020-06-12T02:34:28.630 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-06-12T02:34:28.634 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-06-12T02:34:28.670 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2020-06-12T02:34:28.670 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2020-06-12T02:34:28.670 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-06-12T02:34:28.670 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2020-06-12T02:34:28.671 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.671 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2020-06-12T02:34:28.671 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.671 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2020-06-12T02:34:28.671 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.672 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2020-06-12T02:34:28.672 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2020-06-12T02:34:28.672 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.672 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2020-06-12T02:34:28.672 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2020-06-12T02:34:28.673 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.673 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2020-06-12T02:34:28.673 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2020-06-12T02:34:28.673 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.673 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2020-06-12T02:34:28.674 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2020-06-12T02:34:28.674 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.674 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2020-06-12T02:34:28.675 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.675 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2020-06-12T02:34:28.675 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2020-06-12T02:34:28.675 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2020-06-12T02:34:28.675 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2020-06-12T02:34:28.676 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2020-06-12T02:34:28.676 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2020-06-12T02:34:28.676 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2020-06-12T02:34:28.676 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-06-12T02:34:28.676 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2020-06-12T02:34:28.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.677 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-06-12T02:34:28.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.677 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2020-06-12T02:34:28.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.117" 2020-06-12T02:34:28.678 INFO:teuthology.orchestra.run.smithi117.stdout: enable experimental unrecoverable data corrupting features = * 2020-06-12T02:34:28.679 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2020-06-12T02:34:28.679 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 2500 2020-06-12T02:34:28.679 INFO:teuthology.orchestra.run.smithi117.stdout: ms tcp read timeout = 5 2020-06-12T02:34:28.679 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = c120ba75-2438-45f0-aa6e-10a350976a3c 2020-06-12T02:34:28.679 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.680 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2020-06-12T02:34:28.680 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2020-06-12T02:34:28.681 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.681 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2020-06-12T02:34:28.681 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 120 2020-06-12T02:34:28.681 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.681 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2020-06-12T02:34:28.682 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2020-06-12T02:34:28.682 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.682 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2020-06-12T02:34:28.682 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2020-06-12T02:34:28.682 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2020-06-12T02:34:28.683 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.684 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2020-06-12T02:34:28.684 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.684 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2020-06-12T02:34:28.684 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.684 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2020-06-12T02:34:28.685 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2020-06-12T02:34:28.685 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.685 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2020-06-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2020-06-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi117.stdout: debug monc = 20 2020-06-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2020-06-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2020-06-12T02:34:28.686 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug filestore = 20 2020-06-12T02:34:28.687 INFO:teuthology.orchestra.run.smithi117.stdout: debug journal = 20 2020-06-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 20 2020-06-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 25 2020-06-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2020-06-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2020-06-12T02:34:28.688 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug reject backfill probability = 0.3 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify cached snaps = True 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify missing on start = True 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2020-06-12T02:34:28.689 INFO:teuthology.orchestra.run.smithi117.stdout: osd max backfills = 2 2020-06-12T02:34:28.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd max markdown count = 1000 2020-06-12T02:34:28.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2020-06-12T02:34:28.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue = debug_random 2020-06-12T02:34:28.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue cut off = debug_random 2020-06-12T02:34:28.690 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub min interval = 60 2020-06-12T02:34:28.691 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2020-06-12T02:34:28.691 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.691 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2020-06-12T02:34:28.691 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2020-06-12T02:34:28.691 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2020-06-12T02:34:28.692 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.693 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2020-06-12T02:34:28.693 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2020-06-12T02:34:28.693 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2020-06-12T02:34:28.693 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2020-06-12T02:34:28.693 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2020-06-12T02:34:28.694 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2020-06-12T02:34:28.695 INFO:teuthology.orchestra.run.smithi117.stdout: 2020-06-12T02:34:28.695 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2020-06-12T02:34:28.695 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2020-06-12T02:34:28.695 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2020-06-12T02:34:28.695 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2020-06-12T02:34:28.696 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-06-12T02:34:28.696 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-06-12T02:34:28.696 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2020-06-12T02:34:28.696 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2020-06-12T02:34:28.696 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2020-06-12T02:34:28.702 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2020-06-12T02:34:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2020-06-12T02:34:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-06-12T02:34:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2020-06-12T02:34:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2020-06-12T02:34:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2020-06-12T02:34:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2020-06-12T02:34:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2020-06-12T02:34:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2020-06-12T02:34:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2020-06-12T02:34:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2020-06-12T02:34:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2020-06-12T02:34:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2020-06-12T02:34:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2020-06-12T02:34:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2020-06-12T02:34:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2020-06-12T02:34:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2020-06-12T02:34:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2020-06-12T02:34:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2020-06-12T02:34:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2020-06-12T02:34:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2020-06-12T02:34:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2020-06-12T02:34:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-06-12T02:34:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2020-06-12T02:34:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-06-12T02:34:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2020-06-12T02:34:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2020-06-12T02:34:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2020-06-12T02:34:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2020-06-12T02:34:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.117" 2020-06-12T02:34:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: enable experimental unrecoverable data corrupting features = * 2020-06-12T02:34:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: mon client directed command retry = 5 2020-06-12T02:34:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject socket failures = 2500 2020-06-12T02:34:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: ms tcp read timeout = 5 2020-06-12T02:34:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = c120ba75-2438-45f0-aa6e-10a350976a3c 2020-06-12T02:34:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.716 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2020-06-12T02:34:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2020-06-12T02:34:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2020-06-12T02:34:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 120 2020-06-12T02:34:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2020-06-12T02:34:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2020-06-12T02:34:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2020-06-12T02:34:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2020-06-12T02:34:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2020-06-12T02:34:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2020-06-12T02:34:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2020-06-12T02:34:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2020-06-12T02:34:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2020-06-12T02:34:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2020-06-12T02:34:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2020-06-12T02:34:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2020-06-12T02:34:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2020-06-12T02:34:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2020-06-12T02:34:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: debug monc = 20 2020-06-12T02:34:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2020-06-12T02:34:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2020-06-12T02:34:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2020-06-12T02:34:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2020-06-12T02:34:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2020-06-12T02:34:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2020-06-12T02:34:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2020-06-12T02:34:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: debug filestore = 20 2020-06-12T02:34:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: debug journal = 20 2020-06-12T02:34:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 20 2020-06-12T02:34:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 25 2020-06-12T02:34:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2020-06-12T02:34:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2020-06-12T02:34:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2020-06-12T02:34:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2020-06-12T02:34:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug reject backfill probability = 0.3 2020-06-12T02:34:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify cached snaps = True 2020-06-12T02:34:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify missing on start = True 2020-06-12T02:34:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2020-06-12T02:34:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd max backfills = 2 2020-06-12T02:34:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: osd max markdown count = 1000 2020-06-12T02:34:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2020-06-12T02:34:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue = debug_random 2020-06-12T02:34:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue cut off = debug_random 2020-06-12T02:34:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub min interval = 60 2020-06-12T02:34:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2020-06-12T02:34:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.734 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2020-06-12T02:34:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-06-12T02:34:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2020-06-12T02:34:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2020-06-12T02:34:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2020-06-12T02:34:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2020-06-12T02:34:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2020-06-12T02:34:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2020-06-12T02:34:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.736 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2020-06-12T02:34:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2020-06-12T02:34:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2020-06-12T02:34:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2020-06-12T02:34:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2020-06-12T02:34:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2020-06-12T02:34:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2020-06-12T02:34:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2020-06-12T02:34:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2020-06-12T02:34:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2020-06-12T02:34:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2020-06-12T02:34:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:34:28.739 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2020-06-12T02:34:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2020-06-12T02:34:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2020-06-12T02:34:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2020-06-12T02:34:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-06-12T02:34:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-06-12T02:34:28.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2020-06-12T02:34:28.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2020-06-12T02:34:28.741 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2020-06-12T02:34:28.743 INFO:tasks.ceph:Creating admin key on mon.a... 2020-06-12T02:34:28.743 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-06-12T02:34:28.831 INFO:tasks.ceph:Copying monmap to all nodes... 2020-06-12T02:34:28.839 DEBUG:teuthology.orchestra.remote:smithi142:/etc/ceph/ceph.keyring is 206B 2020-06-12T02:34:28.860 DEBUG:teuthology.orchestra.remote:smithi142:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-06-12T02:34:28.876 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:34:28.877 INFO:teuthology.orchestra.run.smithi142:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T02:34:28.933 INFO:teuthology.orchestra.run.smithi142:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:29.023 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:34:29.024 INFO:teuthology.orchestra.run.smithi117:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-06-12T02:34:29.082 INFO:teuthology.orchestra.run.smithi117:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:29.171 INFO:tasks.ceph:Setting up mon nodes... 2020-06-12T02:34:29.172 INFO:tasks.ceph:Setting up mgr nodes... 2020-06-12T02:34:29.172 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-06-12T02:34:29.214 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-06-12T02:34:29.221 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-06-12T02:34:29.266 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-06-12T02:34:29.268 INFO:tasks.ceph:Setting up mds nodes... 2020-06-12T02:34:29.268 INFO:tasks.ceph_client:Setting up client nodes... 2020-06-12T02:34:29.269 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-06-12T02:34:29.303 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-06-12T02:34:29.314 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-06-12T02:34:29.347 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-06-12T02:34:29.376 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-06-12T02:34:29.377 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-06-12T02:34:29.377 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-06-12T02:34:29.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:29.402 INFO:tasks.ceph:role: osd.0 2020-06-12T02:34:29.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:34:29.403 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-06-12T02:34:29.951 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:29.951 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:29.952 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:29.952 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:29.952 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:29.952 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:29.952 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:29.953 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:29.953 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:29.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-06-12T02:34:29.954 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-06-12T02:34:30.025 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-06-12T02:34:30.043 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:30.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:30.045 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-06-12T02:34:30.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:30.098 INFO:tasks.ceph:role: osd.1 2020-06-12T02:34:30.098 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:34:30.099 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-06-12T02:34:30.612 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:30.613 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:30.613 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:30.613 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:30.613 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:30.614 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:30.614 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:30.614 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:30.614 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:30.615 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-06-12T02:34:30.616 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-06-12T02:34:30.664 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-06-12T02:34:30.676 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:30.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:30.678 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-06-12T02:34:30.736 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:30.736 INFO:tasks.ceph:role: osd.2 2020-06-12T02:34:30.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:34:30.737 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-06-12T02:34:31.240 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:31.241 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:31.241 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:31.241 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:31.241 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:31.242 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:31.242 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:31.242 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:31.242 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:31.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-06-12T02:34:31.243 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-06-12T02:34:31.295 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-06-12T02:34:31.307 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:31.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:31.308 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-06-12T02:34:31.365 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:31.375 INFO:tasks.ceph:role: osd.3 2020-06-12T02:34:31.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2020-06-12T02:34:31.376 INFO:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-06-12T02:34:31.881 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:31.887 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:31.888 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:31.892 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:31.893 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:31.893 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:31.893 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:31.894 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:31.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2020-06-12T02:34:31.895 INFO:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-06-12T02:34:31.939 INFO:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-06-12T02:34:31.997 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:31.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:31.998 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:32.104 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.100+0000 7f3fc01b8d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:32.104 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.100+0000 7f3fc01b8d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:32.105 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.100+0000 7f3fc01b8d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:32.106 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.104+0000 7f3fc01b8d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-06-12T02:34:32.110 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.108+0000 7f3fc01b8d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-06-12T02:34:32.110 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.108+0000 7f3fc01b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T02:34:32.111 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.108+0000 7f3fc01b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T02:34:32.111 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.108+0000 7f3fc01b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-06-12T02:34:32.118 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.116+0000 7f3fc01b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-06-12T02:34:32.152 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:32.148+0000 7f3fc01b8d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:34.569 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-06-12T02:34:34.586 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:34.667 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.664+0000 7f44c3040d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:34.668 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.664+0000 7f44c3040d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:34.669 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.664+0000 7f44c3040d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:34.670 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-06-12T02:34:34.673 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-06-12T02:34:34.673 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T02:34:34.673 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T02:34:34.673 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-06-12T02:34:34.674 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.668+0000 7f44c3040d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-06-12T02:34:34.690 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:34.684+0000 7f44c3040d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:37.144 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-06-12T02:34:37.200 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:37.277 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.272+0000 7f80eda63d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:37.277 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.272+0000 7f80eda63d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:37.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:37.279 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-06-12T02:34:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-06-12T02:34:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T02:34:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T02:34:37.280 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-06-12T02:34:37.281 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.276+0000 7f80eda63d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-06-12T02:34:37.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:37.296+0000 7f80eda63d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:39.744 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-06-12T02:34:39.800 INFO:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:39.875 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.872+0000 7fceeb70fd80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:39.876 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.872+0000 7fceeb70fd80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:39.877 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.872+0000 7fceeb70fd80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:39.877 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-06-12T02:34:39.878 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-06-12T02:34:39.879 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T02:34:39.879 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T02:34:39.879 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-06-12T02:34:39.880 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.876+0000 7fceeb70fd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-06-12T02:34:39.901 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:39.896+0000 7fceeb70fd80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:42.340 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-06-12T02:34:42.397 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-06-12T02:34:42.413 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:42.413 INFO:tasks.ceph:role: osd.4 2020-06-12T02:34:42.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:34:42.414 INFO:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-06-12T02:34:42.930 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:42.931 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:42.931 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:42.931 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:42.932 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:42.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2020-06-12T02:34:42.934 INFO:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-06-12T02:34:43.029 INFO:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-06-12T02:34:43.042 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:43.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:43.043 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-06-12T02:34:43.099 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:43.099 INFO:tasks.ceph:role: osd.5 2020-06-12T02:34:43.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:34:43.100 INFO:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-06-12T02:34:43.618 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:43.618 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:43.618 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:43.619 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:43.619 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:43.619 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:43.619 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:43.619 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:43.620 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:43.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2020-06-12T02:34:43.621 INFO:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-06-12T02:34:43.682 INFO:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-06-12T02:34:43.695 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:43.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:43.696 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-06-12T02:34:43.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:43.754 INFO:tasks.ceph:role: osd.6 2020-06-12T02:34:43.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:34:43.755 INFO:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-06-12T02:34:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:44.245 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:44.246 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:44.246 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:44.246 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:44.247 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2020-06-12T02:34:44.248 INFO:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-06-12T02:34:44.290 INFO:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-06-12T02:34:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:44.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:44.349 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-06-12T02:34:44.405 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-06-12T02:34:44.406 INFO:tasks.ceph:role: osd.7 2020-06-12T02:34:44.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2020-06-12T02:34:44.407 INFO:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-06-12T02:34:44.948 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-06-12T02:34:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2020-06-12T02:34:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-06-12T02:34:44.948 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-06-12T02:34:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2020-06-12T02:34:44.949 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-06-12T02:34:44.949 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-06-12T02:34:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-06-12T02:34:44.950 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-06-12T02:34:44.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2020-06-12T02:34:44.951 INFO:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-06-12T02:34:44.981 INFO:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-06-12T02:34:45.037 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2020-06-12T02:34:45.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:34:45.039 INFO:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:45.139 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.139+0000 7f69eb0e9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:45.140 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.139+0000 7f69eb0e9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.139+0000 7f69eb0e9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.139+0000 7f69eb0e9d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-06-12T02:34:45.143 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.143+0000 7f69eb0e9d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-06-12T02:34:45.143 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.143+0000 7f69eb0e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T02:34:45.143 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.143+0000 7f69eb0e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T02:34:45.144 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.143+0000 7f69eb0e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-06-12T02:34:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.151+0000 7f69eb0e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-06-12T02:34:45.192 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:45.191+0000 7f69eb0e9d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:47.606 INFO:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-06-12T02:34:47.622 INFO:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:47.699 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.699+0000 7fad3a6c3d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:47.699 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.699+0000 7fad3a6c3d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:47.702 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.699+0000 7fad3a6c3d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:47.703 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.699+0000 7fad3a6c3d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-06-12T02:34:47.703 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.703+0000 7fad3a6c3d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-06-12T02:34:47.703 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.703+0000 7fad3a6c3d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T02:34:47.704 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.703+0000 7fad3a6c3d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T02:34:47.704 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.703+0000 7fad3a6c3d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-06-12T02:34:47.705 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.703+0000 7fad3a6c3d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-06-12T02:34:47.721 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:47.719+0000 7fad3a6c3d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:50.172 INFO:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-06-12T02:34:50.229 INFO:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:50.315 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.307+0000 7fa30fa51d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:50.315 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.307+0000 7fa30fa51d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:50.315 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:50.316 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-06-12T02:34:50.316 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-06-12T02:34:50.316 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T02:34:50.318 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T02:34:50.318 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-06-12T02:34:50.319 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.311+0000 7fa30fa51d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-06-12T02:34:50.328 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:50.327+0000 7fa30fa51d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:52.796 INFO:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-06-12T02:34:52.853 INFO:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:52.937 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.931+0000 7feaa8d31d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.931+0000 7feaa8d31d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:52.938 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-06-12T02:34:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-06-12T02:34:52.939 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T02:34:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T02:34:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-06-12T02:34:52.940 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.935+0000 7feaa8d31d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-06-12T02:34:52.956 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:52.955+0000 7feaa8d31d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-06-12T02:34:55.412 INFO:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-06-12T02:34:55.470 INFO:tasks.ceph:Reading keys from all nodes... 2020-06-12T02:34:55.471 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:34:55.486 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.IICyFGh3iQ 2020-06-12T02:34:55.486 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.IICyFGh3iQ 2020-06-12T02:34:55.544 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.IICyFGh3iQ 2020-06-12T02:34:55.649 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.IICyFGh3iQ is 56B 2020-06-12T02:34:55.659 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.IICyFGh3iQ 2020-06-12T02:34:55.666 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:34:55.719 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.b08xh7ACtf 2020-06-12T02:34:55.719 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.b08xh7ACtf 2020-06-12T02:34:55.776 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.b08xh7ACtf 2020-06-12T02:34:55.886 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.b08xh7ACtf is 56B 2020-06-12T02:34:55.937 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.b08xh7ACtf 2020-06-12T02:34:55.944 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:34:55.990 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.KUrgG5O2Ue 2020-06-12T02:34:55.991 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.KUrgG5O2Ue 2020-06-12T02:34:56.047 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.KUrgG5O2Ue 2020-06-12T02:34:56.165 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.KUrgG5O2Ue is 56B 2020-06-12T02:34:56.187 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.KUrgG5O2Ue 2020-06-12T02:34:56.193 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:34:56.242 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.S4rN7MYOj0 2020-06-12T02:34:56.243 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.S4rN7MYOj0 2020-06-12T02:34:56.302 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.S4rN7MYOj0 2020-06-12T02:34:56.409 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.S4rN7MYOj0 is 56B 2020-06-12T02:34:56.420 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.S4rN7MYOj0 2020-06-12T02:34:56.427 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:34:56.474 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.pjlzxgSp99 2020-06-12T02:34:56.475 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.pjlzxgSp99 2020-06-12T02:34:56.530 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.pjlzxgSp99 2020-06-12T02:34:56.637 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.pjlzxgSp99 is 56B 2020-06-12T02:34:56.690 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.pjlzxgSp99 2020-06-12T02:34:56.701 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:34:56.708 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.5tuEEgF6fI 2020-06-12T02:34:56.708 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.5tuEEgF6fI 2020-06-12T02:34:56.772 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.5tuEEgF6fI 2020-06-12T02:34:56.878 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.5tuEEgF6fI is 56B 2020-06-12T02:34:56.890 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.5tuEEgF6fI 2020-06-12T02:34:56.914 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:34:56.963 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.Klp8vFJYdz 2020-06-12T02:34:56.963 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Klp8vFJYdz 2020-06-12T02:34:57.020 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.Klp8vFJYdz 2020-06-12T02:34:57.125 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.Klp8vFJYdz is 56B 2020-06-12T02:34:57.137 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.Klp8vFJYdz 2020-06-12T02:34:57.143 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:34:57.191 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.lJe2FxnEXU 2020-06-12T02:34:57.192 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.lJe2FxnEXU 2020-06-12T02:34:57.248 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.lJe2FxnEXU 2020-06-12T02:34:57.355 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.lJe2FxnEXU is 56B 2020-06-12T02:34:57.406 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.lJe2FxnEXU 2020-06-12T02:34:57.415 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:34:57.462 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.JEGUNd3CVJ 2020-06-12T02:34:57.463 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.JEGUNd3CVJ 2020-06-12T02:34:57.521 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.JEGUNd3CVJ 2020-06-12T02:34:57.625 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.JEGUNd3CVJ is 56B 2020-06-12T02:34:57.638 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.JEGUNd3CVJ 2020-06-12T02:34:57.648 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:34:57.694 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.qhLInJaKpm 2020-06-12T02:34:57.695 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.qhLInJaKpm 2020-06-12T02:34:57.752 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.qhLInJaKpm 2020-06-12T02:34:57.860 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.qhLInJaKpm is 56B 2020-06-12T02:34:57.911 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.qhLInJaKpm 2020-06-12T02:34:57.942 DEBUG:teuthology.orchestra.remote:smithi142:/etc/ceph/ceph.client.0.keyring is 59B 2020-06-12T02:34:57.968 DEBUG:teuthology.orchestra.remote:smithi117:/etc/ceph/ceph.client.1.keyring is 59B 2020-06-12T02:34:57.979 INFO:tasks.ceph:Adding keys to all mons... 2020-06-12T02:34:57.979 INFO:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2020-06-12T02:34:57.982 INFO:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2020-06-12T02:34:58.029 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2020-06-12T02:34:58.030 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC16eJeKiHmDBAAQt65Yv1QTuY8q4Q0UGM9hA== 2020-06-12T02:34:58.030 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2020-06-12T02:34:58.030 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC46eJeE314BhAA8WQ4d8lhZOCATjfGF8v4oQ== 2020-06-12T02:34:58.030 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2020-06-12T02:34:58.030 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC66eJed0EaKBAAfmL6HDfJEuXISuuYDAUMAQ== 2020-06-12T02:34:58.031 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2020-06-12T02:34:58.031 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC96eJeqOrNEBAAKNfEsrTI90Tkngb2kL43qg== 2020-06-12T02:34:58.031 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2020-06-12T02:34:58.031 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC/6eJeYFV7NBAAh1qtEFP6gyk1+LM3i9bUqQ== 2020-06-12T02:34:58.031 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2020-06-12T02:34:58.032 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC16eJe5Bz8DxAAmYYUeuQMqYhA+G3sDJ1tlw== 2020-06-12T02:34:58.032 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2020-06-12T02:34:58.032 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDF6eJefBacCBAAasX+50OzDyvL0K3ok2u1Fg== 2020-06-12T02:34:58.032 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2020-06-12T02:34:58.032 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDH6eJe/Qr8KRAAqPAdL+XdeCEkqWDZIsilsQ== 2020-06-12T02:34:58.033 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2020-06-12T02:34:58.033 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDK6eJe1RO0EhAAWRMAEoOeKHsu7colSRSipw== 2020-06-12T02:34:58.033 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2020-06-12T02:34:58.033 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDM6eJeCkn1NxAAgvwq5/ZFhjGWYpL1VTK4Ig== 2020-06-12T02:34:58.033 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2020-06-12T02:34:58.034 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC16eJef3I3EhAAwX2J6fyQel//wjYI6XGfYQ== 2020-06-12T02:34:58.034 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2020-06-12T02:34:58.034 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQC16eJe6iDdFBAAsR0jrdo6cM+Jk3ZHg7KvMQ== 2020-06-12T02:34:58.037 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2020-06-12T02:34:58.037 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC16eJeKiHmDBAAQt65Yv1QTuY8q4Q0UGM9hA== 2020-06-12T02:34:58.038 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2020-06-12T02:34:58.038 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC46eJeE314BhAA8WQ4d8lhZOCATjfGF8v4oQ== 2020-06-12T02:34:58.038 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2020-06-12T02:34:58.038 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC66eJed0EaKBAAfmL6HDfJEuXISuuYDAUMAQ== 2020-06-12T02:34:58.038 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2020-06-12T02:34:58.039 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC96eJeqOrNEBAAKNfEsrTI90Tkngb2kL43qg== 2020-06-12T02:34:58.039 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2020-06-12T02:34:58.039 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC/6eJeYFV7NBAAh1qtEFP6gyk1+LM3i9bUqQ== 2020-06-12T02:34:58.039 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2020-06-12T02:34:58.039 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC16eJe5Bz8DxAAmYYUeuQMqYhA+G3sDJ1tlw== 2020-06-12T02:34:58.040 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2020-06-12T02:34:58.040 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDF6eJefBacCBAAasX+50OzDyvL0K3ok2u1Fg== 2020-06-12T02:34:58.040 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2020-06-12T02:34:58.040 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDH6eJe/Qr8KRAAqPAdL+XdeCEkqWDZIsilsQ== 2020-06-12T02:34:58.040 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2020-06-12T02:34:58.041 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDK6eJe1RO0EhAAWRMAEoOeKHsu7colSRSipw== 2020-06-12T02:34:58.041 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2020-06-12T02:34:58.041 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDM6eJeCkn1NxAAgvwq5/ZFhjGWYpL1VTK4Ig== 2020-06-12T02:34:58.041 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2020-06-12T02:34:58.041 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC16eJef3I3EhAAwX2J6fyQel//wjYI6XGfYQ== 2020-06-12T02:34:58.042 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2020-06-12T02:34:58.042 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC16eJe6iDdFBAAsR0jrdo6cM+Jk3ZHg7KvMQ== 2020-06-12T02:34:58.042 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T02:34:58.079 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T02:34:58.121 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.163 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.207 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.259 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.302 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.339 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.386 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.428 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.470 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T02:34:58.511 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-06-12T02:34:58.554 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.595 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.638 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.675 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.723 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.759 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.805 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.843 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-06-12T02:34:58.889 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T02:34:58.927 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T02:34:58.977 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T02:34:59.012 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-06-12T02:34:59.065 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-06-12T02:34:59.065 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-06-12T02:34:59.123 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T02:34:59.202 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:59.200+0000 7f8133dfd540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.203 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:59.200+0000 7f8133dfd540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.226 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-06-12T02:34:59.284 INFO:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-06-12T02:34:59.338 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T02:34:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:59.412+0000 7fdf10c64540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:34:59.412+0000 7fdf10c64540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.440 INFO:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-06-12T02:34:59.495 INFO:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-06-12T02:34:59.511 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-06-12T02:34:59.593 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:59.591+0000 7f338a462540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.593 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:34:59.591+0000 7f338a462540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.632 INFO:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-06-12T02:34:59.690 INFO:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:59.735 INFO:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-06-12T02:34:59.746 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-06-12T02:34:59.746 INFO:tasks.ceph.mon.a:Restarting daemon 2020-06-12T02:34:59.747 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-06-12T02:34:59.790 INFO:tasks.ceph.mon.a:Started 2020-06-12T02:34:59.791 INFO:tasks.ceph.mon.c:Restarting daemon 2020-06-12T02:34:59.791 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-06-12T02:34:59.794 INFO:tasks.ceph.mon.c:Started 2020-06-12T02:34:59.794 INFO:tasks.ceph.mon.b:Restarting daemon 2020-06-12T02:34:59.795 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-06-12T02:34:59.800 INFO:tasks.ceph.mon.b:Started 2020-06-12T02:34:59.801 INFO:teuthology.orchestra.run.smithi142:> sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force 2020-06-12T02:34:59.871 INFO:tasks.ceph.mon.c.smithi142.stderr:2020-06-12T02:34:59.868+0000 7faf603d6540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.872 INFO:tasks.ceph.mon.c.smithi142.stderr:2020-06-12T02:34:59.868+0000 7faf603d6540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.872 INFO:tasks.ceph.mon.c.smithi142.stderr:2020-06-12T02:34:59.868+0000 7faf603d6540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.874 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:34:59.875+0000 7fabb536f540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.874 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:34:59.875+0000 7fabb536f540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.875 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:34:59.875+0000 7fabb536f540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.882 INFO:tasks.ceph.mon.a.smithi142.stderr:2020-06-12T02:34:59.880+0000 7f248d865540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.883 INFO:tasks.ceph.mon.a.smithi142.stderr:2020-06-12T02:34:59.880+0000 7f248d865540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:34:59.883 INFO:tasks.ceph.mon.a.smithi142.stderr:2020-06-12T02:34:59.880+0000 7f248d865540 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:00.040+0000 7f97c1f14700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.162 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:00.160+0000 7f97c0cb2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.263 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-06-12T02:35:00.263 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-06-12T02:35:00.264 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-06-12T02:35:00.266 INFO:tasks.ceph.mgr.y:Started 2020-06-12T02:35:00.266 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-06-12T02:35:00.267 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-06-12T02:35:00.269 INFO:tasks.ceph.mgr.x:Started 2020-06-12T02:35:00.269 INFO:tasks.ceph:Setting crush tunables to default 2020-06-12T02:35:00.270 INFO:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2020-06-12T02:35:00.359 INFO:tasks.ceph.mgr.y.smithi142.stderr:2020-06-12T02:35:00.356+0000 7fec111cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.363 INFO:tasks.ceph.mgr.y.smithi142.stderr:2020-06-12T02:35:00.360+0000 7fec111cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.363 INFO:tasks.ceph.mgr.y.smithi142.stderr:2020-06-12T02:35:00.360+0000 7fec111cbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.384 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:00.368+0000 7f3e0e963700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.384 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:00.376+0000 7f3e0e963700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.488 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2020-06-12T02:35:00.501 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-06-12T02:35:00.510 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:35:00.533 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.XZHzH4Zosd 2020-06-12T02:35:00.533 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.XZHzH4Zosd 2020-06-12T02:35:00.594 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.XZHzH4Zosd 2020-06-12T02:35:00.622 INFO:tasks.ceph.mgr.x.smithi117.stderr:2020-06-12T02:35:00.623+0000 7f883df24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.626 INFO:tasks.ceph.mgr.x.smithi117.stderr:2020-06-12T02:35:00.627+0000 7f883df24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.626 INFO:tasks.ceph.mgr.x.smithi117.stderr:2020-06-12T02:35:00.627+0000 7f883df24ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:00.706 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.XZHzH4Zosd is 37B 2020-06-12T02:35:00.718 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.XZHzH4Zosd 2020-06-12T02:35:00.724 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:35:00.774 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.fnBcvXkAbz 2020-06-12T02:35:00.775 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.fnBcvXkAbz 2020-06-12T02:35:00.840 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.fnBcvXkAbz 2020-06-12T02:35:00.944 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.fnBcvXkAbz is 37B 2020-06-12T02:35:00.958 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.fnBcvXkAbz 2020-06-12T02:35:00.966 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:35:01.014 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.79bMdpB5Fb 2020-06-12T02:35:01.014 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.79bMdpB5Fb 2020-06-12T02:35:01.071 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.79bMdpB5Fb 2020-06-12T02:35:01.179 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.79bMdpB5Fb is 37B 2020-06-12T02:35:01.230 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.79bMdpB5Fb 2020-06-12T02:35:01.238 INFO:teuthology.orchestra.run.smithi142:> mktemp 2020-06-12T02:35:01.286 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.8rRMXckRhC 2020-06-12T02:35:01.287 INFO:teuthology.orchestra.run.smithi142:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.8rRMXckRhC 2020-06-12T02:35:01.343 INFO:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.8rRMXckRhC 2020-06-12T02:35:01.455 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.8rRMXckRhC is 37B 2020-06-12T02:35:01.523 INFO:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.8rRMXckRhC 2020-06-12T02:35:01.554 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:35:01.561 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.VqsRqC8ZNN 2020-06-12T02:35:01.561 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.VqsRqC8ZNN 2020-06-12T02:35:01.617 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.VqsRqC8ZNN 2020-06-12T02:35:01.742 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.VqsRqC8ZNN is 37B 2020-06-12T02:35:01.761 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.VqsRqC8ZNN 2020-06-12T02:35:01.768 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:35:01.815 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.HTAg9cI1kh 2020-06-12T02:35:01.816 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.HTAg9cI1kh 2020-06-12T02:35:01.870 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.HTAg9cI1kh 2020-06-12T02:35:01.976 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.HTAg9cI1kh is 37B 2020-06-12T02:35:01.987 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.HTAg9cI1kh 2020-06-12T02:35:01.993 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:35:02.044 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.FjzAZig2hX 2020-06-12T02:35:02.045 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.FjzAZig2hX 2020-06-12T02:35:02.098 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.FjzAZig2hX 2020-06-12T02:35:02.205 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.FjzAZig2hX is 37B 2020-06-12T02:35:02.219 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.FjzAZig2hX 2020-06-12T02:35:02.225 INFO:teuthology.orchestra.run.smithi117:> mktemp 2020-06-12T02:35:02.271 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.dLhVL6Alqq 2020-06-12T02:35:02.271 INFO:teuthology.orchestra.run.smithi117:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.dLhVL6Alqq 2020-06-12T02:35:02.328 INFO:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.dLhVL6Alqq 2020-06-12T02:35:02.436 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.dLhVL6Alqq is 37B 2020-06-12T02:35:02.446 INFO:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.dLhVL6Alqq 2020-06-12T02:35:02.458 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c 0 2020-06-12T02:35:02.632 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:02.615+0000 7f754ced7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:02.632 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:02.631+0000 7f754759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:02.721 INFO:teuthology.orchestra.run.smithi117.stdout:0 2020-06-12T02:35:02.733 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 74343e4c-0406-4803-8619-520cbc1c60db 1 2020-06-12T02:35:02.847 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:02.831+0000 7fa3bd902700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:02.848 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:02.847+0000 7fa3b7fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:02.939 INFO:teuthology.orchestra.run.smithi117.stdout:1 2020-06-12T02:35:02.954 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 18348953-2ab3-44d7-9812-308a4e504ffd 2 2020-06-12T02:35:03.070 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.055+0000 7fc15f19c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.070 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.071+0000 7fc15df3a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.172 INFO:teuthology.orchestra.run.smithi117.stdout:2 2020-06-12T02:35:03.183 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 318d0252-36b6-489c-8cc7-eb5245346db4 3 2020-06-12T02:35:03.304 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.287+0000 7fa225892700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.304 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.303+0000 7fa21ffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.388 INFO:teuthology.orchestra.run.smithi117.stdout:3 2020-06-12T02:35:03.410 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new e622cde1-ff3b-4df8-9e70-640bb7ce27fd 4 2020-06-12T02:35:03.518 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.503+0000 7fc4951a7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.519 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.519+0000 7fc4949a6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.607 INFO:teuthology.orchestra.run.smithi117.stdout:4 2020-06-12T02:35:03.619 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f7d22a59-77a8-4264-888e-3e486a4c0d82 5 2020-06-12T02:35:03.737 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.723+0000 7f90e6063700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.738 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.739+0000 7f90e4e01700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.826 INFO:teuthology.orchestra.run.smithi117.stdout:5 2020-06-12T02:35:03.834 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 60e271cc-4c4c-4397-87be-8c52ffab68d4 6 2020-06-12T02:35:03.930 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.919+0000 7f1fbe9e6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:03.930 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:03.931+0000 7f1fbd784700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.032 INFO:teuthology.orchestra.run.smithi117.stdout:6 2020-06-12T02:35:04.045 INFO:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 0f243681-edad-4e3d-9980-cfc55c5f93ab 7 2020-06-12T02:35:04.151 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:04.135+0000 7f5955283700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.152 INFO:teuthology.orchestra.run.smithi117.stderr:2020-06-12T02:35:04.151+0000 7f5955283700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.250 INFO:teuthology.orchestra.run.smithi117.stdout:7 2020-06-12T02:35:04.267 INFO:tasks.ceph.osd.0:Restarting daemon 2020-06-12T02:35:04.267 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-06-12T02:35:04.270 INFO:tasks.ceph.osd.0:Started 2020-06-12T02:35:04.271 INFO:tasks.ceph.osd.1:Restarting daemon 2020-06-12T02:35:04.271 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-06-12T02:35:04.274 INFO:tasks.ceph.osd.1:Started 2020-06-12T02:35:04.278 INFO:tasks.ceph.osd.2:Restarting daemon 2020-06-12T02:35:04.278 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-06-12T02:35:04.281 INFO:tasks.ceph.osd.2:Started 2020-06-12T02:35:04.282 INFO:tasks.ceph.osd.3:Restarting daemon 2020-06-12T02:35:04.282 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-06-12T02:35:04.285 INFO:tasks.ceph.osd.3:Started 2020-06-12T02:35:04.285 INFO:tasks.ceph.osd.4:Restarting daemon 2020-06-12T02:35:04.286 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-06-12T02:35:04.288 INFO:tasks.ceph.osd.4:Started 2020-06-12T02:35:04.288 INFO:tasks.ceph.osd.5:Restarting daemon 2020-06-12T02:35:04.289 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-06-12T02:35:04.291 INFO:tasks.ceph.osd.5:Started 2020-06-12T02:35:04.292 INFO:tasks.ceph.osd.6:Restarting daemon 2020-06-12T02:35:04.292 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-06-12T02:35:04.295 INFO:tasks.ceph.osd.6:Started 2020-06-12T02:35:04.296 INFO:tasks.ceph.osd.7:Restarting daemon 2020-06-12T02:35:04.296 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-06-12T02:35:04.298 INFO:tasks.ceph.osd.7:Started 2020-06-12T02:35:04.298 INFO:tasks.ceph:Waiting for OSDs to come up 2020-06-12T02:35:04.337 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:04.336+0000 7f143e188d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.348 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:04.344+0000 7fb652678d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.354 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:04.352+0000 7fb652678d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.354 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:04.352+0000 7fb652678d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.354 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:04.352+0000 7f143e188d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.355 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:04.352+0000 7f143e188d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:04.359+0000 7f0273b11d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.359 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:04.356+0000 7fcd6cbe0d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.360 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:04.356+0000 7f924e8d9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:04.363+0000 7f0273b11d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.362 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:04.363+0000 7f0273b11d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:04.363+0000 7fbcb77fad80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.364 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:04.360+0000 7fcd6cbe0d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.364 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:04.360+0000 7fcd6cbe0d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.365 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:04.364+0000 7f924e8d9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.365 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:04.364+0000 7f924e8d9d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:04.367+0000 7fbcb77fad80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.366 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:04.367+0000 7fbcb77fad80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:04.367+0000 7fc42c691d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.367 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:04.367+0000 7f4145957d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.369 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:04.371+0000 7fc42c691d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.370 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:04.371+0000 7fc42c691d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:04.371+0000 7f4145957d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.371 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:04.371+0000 7f4145957d80 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:04.671 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:04.671+0000 7fbcb77fad80 -1 Falling back to public interface 2020-06-12T02:35:04.674 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:04.672+0000 7fcd6cbe0d80 -1 Falling back to public interface 2020-06-12T02:35:04.878 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:04.876+0000 7f143e188d80 -1 Falling back to public interface 2020-06-12T02:35:04.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:04.911+0000 7f0273b11d80 -1 Falling back to public interface 2020-06-12T02:35:04.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:04.911+0000 7f4145957d80 -1 Falling back to public interface 2020-06-12T02:35:04.916 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:04.911+0000 7fc42c691d80 -1 Falling back to public interface 2020-06-12T02:35:04.916 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:04.908+0000 7fb652678d80 -1 Falling back to public interface 2020-06-12T02:35:04.931 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:04.916+0000 7f924e8d9d80 -1 Falling back to public interface 2020-06-12T02:35:05.120 INFO:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-12T02:35:05.226 INFO:teuthology.misc.health.smithi142.stderr:2020-06-12T02:35:05.212+0000 7f37d52ae700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:05.227 INFO:teuthology.misc.health.smithi142.stderr:2020-06-12T02:35:05.224+0000 7f37cffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:05.366 INFO:teuthology.misc.health.smithi142.stdout: 2020-06-12T02:35:05.366 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":10,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:35:04.246542+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:35:05.381 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-06-12T02:35:05.862 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:05.860+0000 7fcd6cbe0d80 -1 osd.1 0 log_to_monitors {default=true} 2020-06-12T02:35:05.864 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:05.863+0000 7f0273b11d80 -1 osd.5 0 log_to_monitors {default=true} 2020-06-12T02:35:05.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:05.871+0000 7fbcb77fad80 -1 osd.4 0 log_to_monitors {default=true} 2020-06-12T02:35:06.041 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:06.040+0000 7f143e188d80 -1 osd.0 0 log_to_monitors {default=true} 2020-06-12T02:35:06.069 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:06.071+0000 7fc42c691d80 -1 osd.7 0 log_to_monitors {default=true} 2020-06-12T02:35:06.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:06.071+0000 7f4145957d80 -1 osd.6 0 log_to_monitors {default=true} 2020-06-12T02:35:06.126 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:06.124+0000 7fb652678d80 -1 osd.2 0 log_to_monitors {default=true} 2020-06-12T02:35:06.130 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:06.128+0000 7f924e8d9d80 -1 osd.3 0 log_to_monitors {default=true} 2020-06-12T02:35:06.937 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:06.935+0000 7fbca0a46700 -1 osd.4 0 waiting for initial osdmap 2020-06-12T02:35:06.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:06.939+0000 7f025cd5d700 -1 osd.5 0 waiting for initial osdmap 2020-06-12T02:35:06.941 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:06.936+0000 7fcd55e2c700 -1 osd.1 0 waiting for initial osdmap 2020-06-12T02:35:07.936 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:07.935+0000 7fc4158dd700 -1 osd.7 0 waiting for initial osdmap 2020-06-12T02:35:07.937 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:07.935+0000 7f412eba3700 -1 osd.6 0 waiting for initial osdmap 2020-06-12T02:35:07.942 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:07.940+0000 7f14273d4700 -1 osd.0 0 waiting for initial osdmap 2020-06-12T02:35:07.943 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:07.940+0000 7fb63b8c4700 -1 osd.2 0 waiting for initial osdmap 2020-06-12T02:35:07.943 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:07.940+0000 7f9237b25700 -1 osd.3 0 waiting for initial osdmap 2020-06-12T02:35:12.189 INFO:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-06-12T02:35:12.299 INFO:teuthology.misc.health.smithi142.stderr:2020-06-12T02:35:12.284+0000 7f422f1a7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:12.300 INFO:teuthology.misc.health.smithi142.stderr:2020-06-12T02:35:12.296+0000 7f422df45700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:12.443 INFO:teuthology.misc.health.smithi142.stdout: 2020-06-12T02:35:12.443 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":15,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:35:09.953002+0000","last_up_change":"2020-06-12T02:35:08.937742+0000","last_in_change":"2020-06-12T02:35:08.937742+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists","up"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.062298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.896452+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.113001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.092632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.886001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.878867+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.116299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.109814+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:35:12.454 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-06-12T02:35:12.455 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-06-12T02:35:12.456 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T02:35:12.456 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-06-12T02:35:12.562 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:12.552+0000 7f6351733700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:12.566 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:12.564+0000 7f634bfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:12.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:12.715 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:35:09.953002+0000","last_up_change":"2020-06-12T02:35:08.937742+0000","last_in_change":"2020-06-12T02:35:08.937742+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists","up"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.062298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.896452+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.113001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.092632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.886001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.878867+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.116299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.109814+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:35:12.728 INFO:tasks.ceph.ceph_manager.ceph:[] 2020-06-12T02:35:12.728 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-06-12T02:35:12.729 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-06-12T02:35:12.729 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-06-12T02:35:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:12.828+0000 7f2a20895700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:12.836+0000 7f2a20895700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.027 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:13.039 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":4,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":11859},{"type":"v1","addr":"172.21.15.142:6801","nonce":11859}]},"active_addr":"172.21.15.142:6801/11859","active_change":"2020-06-12T02:35:03.906957+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4131,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1383121243}]},{"addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2550268617}]}]}} 2020-06-12T02:35:13.047 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-06-12T02:35:13.047 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-06-12T02:35:13.048 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T02:35:13.157 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.148+0000 7f243b17a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.160+0000 7f2439f18700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:35:09.953002+0000","last_up_change":"2020-06-12T02:35:08.937742+0000","last_in_change":"2020-06-12T02:35:08.937742+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists","up"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.062298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.896452+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.113001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.092632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.886001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.878867+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.116299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.109814+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:35:13.323 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-06-12T02:35:13.324 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T02:35:13.437 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.428+0000 7f1f3324b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.440 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.436+0000 7f1f31fe9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:13.578 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:35:09.953002+0000","last_up_change":"2020-06-12T02:35:08.937742+0000","last_in_change":"2020-06-12T02:35:08.937742+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists","up"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.062298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.896452+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.113001+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.092632+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.886001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:06.878867+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.116299+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:35:07.109814+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:35:13.598 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-06-12T02:35:13.712 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.700+0000 7f2d96dcd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.716 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.712+0000 7f2d95b6b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.758 INFO:teuthology.orchestra.run.smithi142.stdout:60129542146 2020-06-12T02:35:13.758 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-06-12T02:35:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.856+0000 7f3eb6ee2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:13.868+0000 7f3eb5c80700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:13.917 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2020-06-12T02:35:13.917 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-06-12T02:35:14.045 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.032+0000 7f5944753700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.052 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.044+0000 7f59434f1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.089 INFO:teuthology.orchestra.run.smithi142.stdout:60129542146 2020-06-12T02:35:14.090 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-06-12T02:35:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.212+0000 7fa7e5f9d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.228+0000 7fa7e4d3b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.270 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2020-06-12T02:35:14.271 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-06-12T02:35:14.392 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.380+0000 7f05d7258700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.396 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.392+0000 7f05d7258700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.451 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2020-06-12T02:35:14.452 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-06-12T02:35:14.582 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.560+0000 7f0f47162700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.583 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.576+0000 7f0f45f00700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.624 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2020-06-12T02:35:14.624 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-06-12T02:35:14.734 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.720+0000 7f706b3db700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.737 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.736+0000 7f706b3db700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.781 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2020-06-12T02:35:14.781 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-06-12T02:35:14.896 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.884+0000 7feeca131700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.903 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:14.900+0000 7feeca131700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:60129542147 2020-06-12T02:35:14.951 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-06-12T02:35:15.067 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.052+0000 7ff8fedec700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.072 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.068+0000 7ff8fdb8a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.213 INFO:teuthology.orchestra.run.smithi142.stdout:60129542146 2020-06-12T02:35:15.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.0 2020-06-12T02:35:15.232 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-06-12T02:35:15.341 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.328+0000 7ff368c7c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.351 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.344+0000 7ff36359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.487 INFO:teuthology.orchestra.run.smithi142.stdout:55834574851 2020-06-12T02:35:15.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2020-06-12T02:35:15.501 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-06-12T02:35:15.614 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.600+0000 7fb682042700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.633 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:15.616+0000 7fb680de0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:15.765 INFO:teuthology.orchestra.run.smithi142.stdout:60129542145 2020-06-12T02:35:15.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.2 2020-06-12T02:35:16.780 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-06-12T02:35:16.904 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:16.892+0000 7f3d031f6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:16.914 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:16.904+0000 7f3d01f94700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.055 INFO:teuthology.orchestra.run.smithi142.stdout:60129542147 2020-06-12T02:35:17.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542147 for osd.2 2020-06-12T02:35:17.070 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-06-12T02:35:17.183 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.172+0000 7fd3115f8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.184+0000 7fd30bfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.323 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2020-06-12T02:35:17.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.3 2020-06-12T02:35:17.351 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-06-12T02:35:17.461 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.448+0000 7f6dfb239700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.466 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.464+0000 7f6df9fd7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.609 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2020-06-12T02:35:17.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2020-06-12T02:35:17.622 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-06-12T02:35:17.739 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.728+0000 7f1d8a56e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:17.740+0000 7f1d8a56e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:17.892 INFO:teuthology.orchestra.run.smithi142.stdout:55834574852 2020-06-12T02:35:17.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2020-06-12T02:35:17.906 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-06-12T02:35:18.011 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.004+0000 7f875628c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.018 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.012+0000 7f875502a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.151 INFO:teuthology.orchestra.run.smithi142.stdout:60129542149 2020-06-12T02:35:18.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.6 2020-06-12T02:35:18.164 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-06-12T02:35:18.274 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.260+0000 7f2e343c2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.278 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.276+0000 7f2e33160700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.421 INFO:teuthology.orchestra.run.smithi142.stdout:60129542148 2020-06-12T02:35:18.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.7 2020-06-12T02:35:18.438 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-12T02:35:18.439 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:18.546 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.536+0000 7f0dbd5dc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.550 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.548+0000 7f0db7fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:18.694 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:18.705 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2020-06-12T02:35:17.919472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":754974720,"kb_used":8389760,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584960,"statfs":{"total":773094113280,"available":764502999040,"internally_reserved":8589934592,"allocated":1114112,"data_stored":305712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2280000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.464}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6429999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.665}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.548}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.085}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.778}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]}]}]}} 2020-06-12T02:35:18.707 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:18.813 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.804+0000 7f52e72c8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.817 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:18.816+0000 7f52e72c8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:18.966 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:18.969 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:18.986 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2020-06-12T02:35:17.919472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":754974720,"kb_used":8389760,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584960,"statfs":{"total":773094113280,"available":764502999040,"internally_reserved":8589934592,"allocated":1114112,"data_stored":305712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2280000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.464}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6429999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.665}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.548}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.085}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.778}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]}]}]}} 2020-06-12T02:35:18.987 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-12T02:35:18.988 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-06-12T02:35:18.988 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-06-12T02:35:18.988 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-06-12T02:35:19.098 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.092+0000 7f6dff409700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.101 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.100+0000 7f6dfe1a7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.286 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:19.306 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-06-12T02:35:19.306 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-06-12T02:35:19.307 INFO:teuthology.run_tasks:Running task thrashosds... 2020-06-12T02:35:19.336 INFO:tasks.thrashosds:config is {'chance_test_min_size': 3, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2020-06-12T02:35:19.337 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': '*', 'mon client directed command retry': 5, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 2, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'create_rbd_pool': False, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force'], 'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '91d24f498556f86f6d1318d2efd5210c35b36762'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'disable_objectstore_tool_tests': True}, 'workunit': {'branch': 'octopus-py3', 'sha1': '1e0d5d60071d5554f87a2be72ea0bcccb272aab3'}} 2020-06-12T02:35:19.337 INFO:tasks.thrashosds:config is {'chance_test_min_size': 3, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'disable_objectstore_tool_tests': True} 2020-06-12T02:35:19.338 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mgr mgr_debug_aggressive_pg_num_changes true 2020-06-12T02:35:19.462 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.444+0000 7fa62e871700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.465 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.464+0000 7fa62d60f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.643 INFO:tasks.thrashosds:Beginning thrashosds... 2020-06-12T02:35:19.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-12T02:35:19.644 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:19.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.748+0000 7f1eea5d1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.762 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:19.760+0000 7f1ee936f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:19.907 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:19.909 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:19.920 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2020-06-12T02:35:17.919472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":754974720,"kb_used":8389760,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584960,"statfs":{"total":773094113280,"available":764502999040,"internally_reserved":8589934592,"allocated":1114112,"data_stored":305712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.456}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2280000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.464}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6429999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.665}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.548}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.085}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.778}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]}]}]}} 2020-06-12T02:35:19.921 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:20.043 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:20.024+0000 7f456c6e9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:20.043 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:20.036+0000 7f456b487700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:20.180 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:20.190 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2020-06-12T02:35:19.920044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":754974720,"kb_used":8389760,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584960,"statfs":{"total":773094113280,"available":764502999040,"internally_reserved":8589934592,"allocated":1114112,"data_stored":305712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.589}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1980000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7770000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.968}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2360000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7949999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.665}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.548}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.085}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.778}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]}]}]}} 2020-06-12T02:35:20.191 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-12T02:35:20.192 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump 2020-06-12T02:35:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:20.296+0000 7f7bed2d4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:20.309 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:20.308+0000 7f7be7fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:20.455 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 15 2020-06-12T02:35:20.456 INFO:teuthology.orchestra.run.smithi142.stdout:fsid c120ba75-2438-45f0-aa6e-10a350976a3c 2020-06-12T02:35:20.456 INFO:teuthology.orchestra.run.smithi142.stdout:created 2020-06-12T02:35:00.134323+0000 2020-06-12T02:35:20.456 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2020-06-12T02:35:09.953002+0000 2020-06-12T02:35:20.457 INFO:teuthology.orchestra.run.smithi142.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2020-06-12T02:35:20.457 INFO:teuthology.orchestra.run.smithi142.stdout:crush_version 5 2020-06-12T02:35:20.457 INFO:teuthology.orchestra.run.smithi142.stdout:full_ratio 0.95 2020-06-12T02:35:20.457 INFO:teuthology.orchestra.run.smithi142.stdout:backfillfull_ratio 0.9 2020-06-12T02:35:20.457 INFO:teuthology.orchestra.run.smithi142.stdout:nearfull_ratio 0.85 2020-06-12T02:35:20.458 INFO:teuthology.orchestra.run.smithi142.stdout:require_min_compat_client jewel 2020-06-12T02:35:20.458 INFO:teuthology.orchestra.run.smithi142.stdout:min_compat_client jewel 2020-06-12T02:35:20.458 INFO:teuthology.orchestra.run.smithi142.stdout:require_osd_release octopus 2020-06-12T02:35:20.458 INFO:teuthology.orchestra.run.smithi142.stdout:max_osd 8 2020-06-12T02:35:20.458 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6810/12037,v1:172.21.15.142:6811/12037] [v2:172.21.15.142:6812/12037,v1:172.21.15.142:6813/12037] exists,up 8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c 2020-06-12T02:35:20.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6802/12047,v1:172.21.15.142:6803/12047] [v2:172.21.15.142:6804/12047,v1:172.21.15.142:6805/12047] exists,up 74343e4c-0406-4803-8619-520cbc1c60db 2020-06-12T02:35:20.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6818/12038,v1:172.21.15.142:6819/12038] [v2:172.21.15.142:6820/12038,v1:172.21.15.142:6821/12038] exists,up 18348953-2ab3-44d7-9812-308a4e504ffd 2020-06-12T02:35:20.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6826/12048,v1:172.21.15.142:6827/12048] [v2:172.21.15.142:6828/12048,v1:172.21.15.142:6829/12048] exists,up 318d0252-36b6-489c-8cc7-eb5245346db4 2020-06-12T02:35:20.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/12021,v1:172.21.15.117:6801/12021] [v2:172.21.15.117:6802/12021,v1:172.21.15.117:6803/12021] exists,up e622cde1-ff3b-4df8-9e70-640bb7ce27fd 2020-06-12T02:35:20.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/12020,v1:172.21.15.117:6811/12020] [v2:172.21.15.117:6814/12020,v1:172.21.15.117:6817/12020] exists,up f7d22a59-77a8-4264-888e-3e486a4c0d82 2020-06-12T02:35:20.460 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6809/12022,v1:172.21.15.117:6812/12022] [v2:172.21.15.117:6815/12022,v1:172.21.15.117:6818/12022] exists,up 60e271cc-4c4c-4397-87be-8c52ffab68d4 2020-06-12T02:35:20.460 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6810/12023,v1:172.21.15.117:6813/12023] [v2:172.21.15.117:6816/12023,v1:172.21.15.117:6819/12023] exists,up 0f243681-edad-4e3d-9980-cfc55c5f93ab 2020-06-12T02:35:20.469 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6810/12037,v1:172.21.15.142:6811/12037] [v2:172.21.15.142:6812/12037,v1:172.21.15.142:6813/12037] exists,up 8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c', 'osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6802/12047,v1:172.21.15.142:6803/12047] [v2:172.21.15.142:6804/12047,v1:172.21.15.142:6805/12047] exists,up 74343e4c-0406-4803-8619-520cbc1c60db', 'osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6818/12038,v1:172.21.15.142:6819/12038] [v2:172.21.15.142:6820/12038,v1:172.21.15.142:6821/12038] exists,up 18348953-2ab3-44d7-9812-308a4e504ffd', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6826/12048,v1:172.21.15.142:6827/12048] [v2:172.21.15.142:6828/12048,v1:172.21.15.142:6829/12048] exists,up 318d0252-36b6-489c-8cc7-eb5245346db4', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/12021,v1:172.21.15.117:6801/12021] [v2:172.21.15.117:6802/12021,v1:172.21.15.117:6803/12021] exists,up e622cde1-ff3b-4df8-9e70-640bb7ce27fd', 'osd.5 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/12020,v1:172.21.15.117:6811/12020] [v2:172.21.15.117:6814/12020,v1:172.21.15.117:6817/12020] exists,up f7d22a59-77a8-4264-888e-3e486a4c0d82', 'osd.6 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6809/12022,v1:172.21.15.117:6812/12022] [v2:172.21.15.117:6815/12022,v1:172.21.15.117:6818/12022] exists,up 60e271cc-4c4c-4397-87be-8c52ffab68d4', 'osd.7 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6810/12023,v1:172.21.15.117:6813/12023] [v2:172.21.15.117:6816/12023,v1:172.21.15.117:6819/12023] exists,up 0f243681-edad-4e3d-9980-cfc55c5f93ab'] 2020-06-12T02:35:20.470 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2020-06-12T02:35:20.568 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mon.a", 2020-06-12T02:35:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster": "ceph", 2020-06-12T02:35:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2020-06-12T02:35:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "admin_socket_mode": "", 2020-06-12T02:35:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_ansi": "Terminal", 2020-06-12T02:35:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_client_required": "cephx, none", 2020-06-12T02:35:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_cluster_required": "cephx", 2020-06-12T02:35:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_debug": "true", 2020-06-12T02:35:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_mon_ticket_ttl": "43200.000000", 2020-06-12T02:35:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_service_required": "cephx", 2020-06-12T02:35:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_service_ticket_ttl": "3600.000000", 2020-06-12T02:35:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "auth_supported": "cephx", 2020-06-12T02:35:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_aio": "true", 2020-06-12T02:35:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_aio_max_queue_depth": "1024", 2020-06-12T02:35:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_aio_poll_ms": "250", 2020-06-12T02:35:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_aio_reap_max": "16", 2020-06-12T02:35:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_async_discard": "false", 2020-06-12T02:35:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_block_size": "4096", 2020-06-12T02:35:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_debug_aio": "false", 2020-06-12T02:35:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_debug_aio_log_age": "5.000000", 2020-06-12T02:35:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2020-06-12T02:35:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_debug_inflight_ios": "false", 2020-06-12T02:35:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_enable_discard": "false", 2020-06-12T02:35:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_inject_crash": "0", 2020-06-12T02:35:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_inject_crash_flush_delay": "2", 2020-06-12T02:35:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_nvme_retry_count": "-1", 2020-06-12T02:35:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "bdev_nvme_unbind_from_kernel": "false", 2020-06-12T02:35:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_alloc_size": "1048576", 2020-06-12T02:35:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_allocator": "bitmap", 2020-06-12T02:35:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_buffered_io": "false", 2020-06-12T02:35:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_compact_log_sync": "false", 2020-06-12T02:35:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2020-06-12T02:35:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_log_compact_min_size": "16777216", 2020-06-12T02:35:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_log_replay_check_allocations": "true", 2020-06-12T02:35:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_max_log_runway": "4194304", 2020-06-12T02:35:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_max_prefetch": "1048576", 2020-06-12T02:35:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_min_flush_size": "524288", 2020-06-12T02:35:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_min_log_runway": "1048576", 2020-06-12T02:35:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_preextend_wal_files": "false", 2020-06-12T02:35:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_shared_alloc_size": "65536", 2020-06-12T02:35:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_sync_write": "false", 2020-06-12T02:35:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2020-06-12T02:35:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2020-06-12T02:35:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2020-06-12T02:35:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_allocator": "bitmap", 2020-06-12T02:35:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2020-06-12T02:35:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bitmapallocator_span_size": "1024", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blobid_prealloc": "10240", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_create": "true", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_db_create": "false", 2020-06-12T02:35:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_db_path": "", 2020-06-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_db_size": "0", 2020-06-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_path": "", 2020-06-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_preallocate_file": "false", 2020-06-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_size": "107374182400", 2020-06-12T02:35:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_wal_create": "false", 2020-06-12T02:35:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_wal_path": "", 2020-06-12T02:35:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_block_wal_size": "100663296", 2020-06-12T02:35:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs": "true", 2020-06-12T02:35:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2020-06-12T02:35:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_balance_interval": "1.000000", 2020-06-12T02:35:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_db_compatibility": "true", 2020-06-12T02:35:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_env_mirror": "false", 2020-06-12T02:35:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_gift_ratio": "0.020000", 2020-06-12T02:35:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_max_free": "10737418240", 2020-06-12T02:35:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_max_ratio": "0.900000", 2020-06-12T02:35:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_min": "1073741824", 2020-06-12T02:35:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_min_free": "1073741824", 2020-06-12T02:35:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_min_ratio": "0.020000", 2020-06-12T02:35:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_bluefs_reclaim_ratio": "0.200000", 2020-06-12T02:35:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_autotune": "true", 2020-06-12T02:35:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_autotune_interval": "5.000000", 2020-06-12T02:35:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_kv_ratio": "0.400000", 2020-06-12T02:35:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_ratio": "0.400000", 2020-06-12T02:35:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_size": "0", 2020-06-12T02:35:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_size_hdd": "1073741824", 2020-06-12T02:35:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_size_ssd": "3221225472", 2020-06-12T02:35:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_trim_interval": "0.050000", 2020-06-12T02:35:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_trim_max_skip_pinned": "64", 2020-06-12T02:35:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_type": "2q", 2020-06-12T02:35:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_clone_cow": "true", 2020-06-12T02:35:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_algorithm": "snappy", 2020-06-12T02:35:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_max_blob_size": "0", 2020-06-12T02:35:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_max_blob_size_hdd": "524288", 2020-06-12T02:35:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2020-06-12T02:35:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_min_blob_size": "0", 2020-06-12T02:35:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_min_blob_size_hdd": "131072", 2020-06-12T02:35:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2020-06-12T02:35:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_mode": "none", 2020-06-12T02:35:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_compression_required_ratio": "0.875000", 2020-06-12T02:35:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_csum_type": "crc32c", 2020-06-12T02:35:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_enforce_settings": "default", 2020-06-12T02:35:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_freelist": "false", 2020-06-12T02:35:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_fsck_abort": "false", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_inject_bug21040": "false", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_inject_read_err": "false", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_misc": "false", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_no_reuse_blocks": "false", 2020-06-12T02:35:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_omit_block_device_write": "false", 2020-06-12T02:35:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_omit_kv_commit": "false", 2020-06-12T02:35:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2020-06-12T02:35:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_prefill": "0.000000", 2020-06-12T02:35:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_prefragment_max": "1048576", 2020-06-12T02:35:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_random_read_err": "0.000000", 2020-06-12T02:35:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2020-06-12T02:35:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_small_allocations": "0", 2020-06-12T02:35:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2020-06-12T02:35:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_default_buffered_read": "true", 2020-06-12T02:35:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_default_buffered_write": "false", 2020-06-12T02:35:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_deferred_batch_ops": "0", 2020-06-12T02:35:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2020-06-12T02:35:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2020-06-12T02:35:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2020-06-12T02:35:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_map_shard_max_size": "1200", 2020-06-12T02:35:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_map_shard_min_size": "150", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_map_shard_target_size": "500", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_freelist_blocks_per_key": "128", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2020-06-12T02:35:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_mkfs": "true", 2020-06-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2020-06-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_mount": "false", 2020-06-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_mount_deep": "false", 2020-06-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_umount": "false", 2020-06-12T02:35:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_on_umount_deep": "false", 2020-06-12T02:35:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_quick_fix_on_mount": "true", 2020-06-12T02:35:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_quick_fix_threads": "2", 2020-06-12T02:35:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2020-06-12T02:35:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_gc_enable_blob_threshold": "0", 2020-06-12T02:35:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_gc_enable_total_threshold": "0", 2020-06-12T02:35:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_ignore_data_csum": "false", 2020-06-12T02:35:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_ioring": "false", 2020-06-12T02:35:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_kvbackend": "rocksdb", 2020-06-12T02:35:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_log_collection_list_age": "60.000000", 2020-06-12T02:35:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2020-06-12T02:35:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_log_op_age": "5.000000", 2020-06-12T02:35:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_alloc_size": "0", 2020-06-12T02:35:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_blob_size": "0", 2020-06-12T02:35:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_blob_size_hdd": "524288", 2020-06-12T02:35:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_blob_size_ssd": "65536", 2020-06-12T02:35:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_defer_interval": "3.000000", 2020-06-12T02:35:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_max_deferred_txc": "32", 2020-06-12T02:35:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_min_alloc_size": "0", 2020-06-12T02:35:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_min_alloc_size_hdd": "65536", 2020-06-12T02:35:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_min_alloc_size_ssd": "4096", 2020-06-12T02:35:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_nid_prealloc": "1024", 2020-06-12T02:35:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_prefer_deferred_size": "0", 2020-06-12T02:35:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_prefer_deferred_size_hdd": "32768", 2020-06-12T02:35:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2020-06-12T02:35:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_retry_disk_reads": "3", 2020-06-12T02:35:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_rocksdb_cf": "false", 2020-06-12T02:35:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_rocksdb_cfs": "M= P= L=", 2020-06-12T02:35:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2", 2020-06-12T02:35:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_spdk_coremask": "0x1", 2020-06-12T02:35:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_spdk_io_sleep": "5", 2020-06-12T02:35:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_spdk_max_io_completion": "0", 2020-06-12T02:35:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_spdk_mem": "512", 2020-06-12T02:35:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_sync_submit_transaction": "false", 2020-06-12T02:35:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_bytes": "67108864", 2020-06-12T02:35:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_cost_per_io": "0", 2020-06-12T02:35:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_throttle_trace_rate": "0.000000", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_tracing": "false", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_volume_selection_policy": "rocksdb_original", 2020-06-12T02:35:20.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_volume_selection_reserved": "0", 2020-06-12T02:35:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2020-06-12T02:35:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2020-06-12T02:35:20.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_warn_on_legacy_statfs": "true", 2020-06-12T02:35:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2020-06-12T02:35:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm_path": "/usr/sbin/cephadm", 2020-06-12T02:35:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_cluster_require_signatures": "false", 2020-06-12T02:35:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_cluster_require_version": "1", 2020-06-12T02:35:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_require_signatures": "false", 2020-06-12T02:35:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_require_version": "1", 2020-06-12T02:35:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_service_require_signatures": "false", 2020-06-12T02:35:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_service_require_version": "1", 2020-06-12T02:35:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "cephx_sign_messages": "true", 2020-06-12T02:35:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "chdir": "", 2020-06-12T02:35:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "client_acl_type": "", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_cache_mid": "0.750000", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_cache_size": "16384", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_caps_release_delay": "5", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_check_pool_perm": "true", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_debug_force_sync_read": "false", 2020-06-12T02:35:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_debug_getattr_caps": "false", 2020-06-12T02:35:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_debug_inject_tick_delay": "0", 2020-06-12T02:35:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_die_on_failed_dentry_invalidate": "true", 2020-06-12T02:35:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_die_on_failed_remount": "false", 2020-06-12T02:35:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_dirsize_rbytes": "true", 2020-06-12T02:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_force_lazyio": "false", 2020-06-12T02:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_fs": "", 2020-06-12T02:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_inject_fixed_oldest_tid": "false", 2020-06-12T02:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_inject_release_failure": "false", 2020-06-12T02:35:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_max_inline_size": "4096", 2020-06-12T02:35:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "client_mds_namespace": "", 2020-06-12T02:35:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "client_metadata": "", 2020-06-12T02:35:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "client_mount_gid": "-1", 2020-06-12T02:35:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "client_mount_timeout": "300.000000", 2020-06-12T02:35:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "client_mount_uid": "-1", 2020-06-12T02:35:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_mountpoint": "/", 2020-06-12T02:35:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_notify_timeout": "10", 2020-06-12T02:35:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc": "true", 2020-06-12T02:35:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc_max_dirty": "104857600", 2020-06-12T02:35:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc_max_dirty_age": "5.000000", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc_max_objects": "1000", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc_size": "209715200", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_oc_target_dirty": "8388608", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_permissions": "true", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_quota_df": "true", 2020-06-12T02:35:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_readahead_max_bytes": "0", 2020-06-12T02:35:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_readahead_max_periods": "4", 2020-06-12T02:35:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_readahead_min": "131072", 2020-06-12T02:35:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_reconnect_stale": "false", 2020-06-12T02:35:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_snapdir": ".snap", 2020-06-12T02:35:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_tick_interval": "1.000000", 2020-06-12T02:35:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client_trace": "", 2020-06-12T02:35:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client_try_dentry_invalidate": "false", 2020-06-12T02:35:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client_use_faked_inos": "false", 2020-06-12T02:35:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client_use_random_mds": "false", 2020-06-12T02:35:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_graylog": "false", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_graylog_host": "127.0.0.1", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_graylog_port": "12201", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_monitors": "default=true", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_syslog": "false", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2020-06-12T02:35:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "clog_to_syslog_level": "info", 2020-06-12T02:35:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "-", 2020-06-12T02:35:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_network": "", 2020-06-12T02:35:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_network_interface": "", 2020-06-12T02:35:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "colors": "Terminal", 2020-06-12T02:35:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "compressor_zlib_isal": "false", 2020-06-12T02:35:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "compressor_zlib_level": "5", 2020-06-12T02:35:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image": "docker.io/ceph/ceph:v15", 2020-06-12T02:35:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "continuation_prompt": ">", 2020-06-12T02:35:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "crash_dir": "/var/lib/ceph/crash", 2020-06-12T02:35:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "crimson_osd_obc_lru_size": "10", 2020-06-12T02:35:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_location": "", 2020-06-12T02:35:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_location_hook": "", 2020-06-12T02:35:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_location_hook_timeout": "10", 2020-06-12T02:35:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "daemonize": "false", 2020-06-12T02:35:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_allow_any_pool_priority": "false", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_asok": "1/5", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_asok_assert_abort": "false", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_asserts_on_shutdown": "true", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_auth": "20/20", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_bdev": "1/3", 2020-06-12T02:35:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_bluefs": "1/5", 2020-06-12T02:35:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_bluestore": "1/5", 2020-06-12T02:35:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_buffer": "0/1", 2020-06-12T02:35:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_civetweb": "1/10", 2020-06-12T02:35:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_client": "0/5", 2020-06-12T02:35:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_compressor": "1/5", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_context": "0/1", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_crush": "1/1", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_crypto": "1/5", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_deliberately_leak_memory": "false", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_disable_randomized_ping": "false", 2020-06-12T02:35:20.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_dpdk": "1/5", 2020-06-12T02:35:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_eventtrace": "1/5", 2020-06-12T02:35:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_filer": "0/1", 2020-06-12T02:35:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_filestore": "1/3", 2020-06-12T02:35:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_finisher": "1/1", 2020-06-12T02:35:20.646 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_fuse": "1/5", 2020-06-12T02:35:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_heartbeat_testing_span": "0", 2020-06-12T02:35:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_heartbeatmap": "1/5", 2020-06-12T02:35:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_immutable_obj_cache": "0/5", 2020-06-12T02:35:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_javaclient": "1/5", 2020-06-12T02:35:20.647 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_journal": "1/3", 2020-06-12T02:35:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_journaler": "0/5", 2020-06-12T02:35:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_kstore": "1/5", 2020-06-12T02:35:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_leveldb": "4/5", 2020-06-12T02:35:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_lockdep": "0/1", 2020-06-12T02:35:20.648 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds_balancer": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds_locker": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds_log": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds_log_expire": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mds_migrator": "1/5", 2020-06-12T02:35:20.649 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_memdb": "4/5", 2020-06-12T02:35:20.657 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mgr": "1/5", 2020-06-12T02:35:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mgrc": "1/5", 2020-06-12T02:35:20.658 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_mon": "20/20", 2020-06-12T02:35:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_monc": "0/10", 2020-06-12T02:35:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_ms": "1/1", 2020-06-12T02:35:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_none": "0/5", 2020-06-12T02:35:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_objclass": "0/5", 2020-06-12T02:35:20.659 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_objectcacher": "0/5", 2020-06-12T02:35:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_objecter": "0/1", 2020-06-12T02:35:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_optracker": "0/5", 2020-06-12T02:35:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_osd": "1/5", 2020-06-12T02:35:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_paxos": "20/20", 2020-06-12T02:35:20.660 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_perfcounter": "1/5", 2020-06-12T02:35:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_prioritycache": "1/5", 2020-06-12T02:35:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rados": "0/5", 2020-06-12T02:35:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rbd": "0/5", 2020-06-12T02:35:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rbd_mirror": "0/5", 2020-06-12T02:35:20.661 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rbd_replay": "0/5", 2020-06-12T02:35:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rbd_rwl": "0/5", 2020-06-12T02:35:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_refs": "0/0", 2020-06-12T02:35:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_reserver": "1/1", 2020-06-12T02:35:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rgw": "1/5", 2020-06-12T02:35:20.662 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rgw_sync": "1/5", 2020-06-12T02:35:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_rocksdb": "4/5", 2020-06-12T02:35:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_shell": "false", 2020-06-12T02:35:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_striper": "0/1", 2020-06-12T02:35:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_test": "0/5", 2020-06-12T02:35:20.663 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_throttle": "1/1", 2020-06-12T02:35:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_timer": "0/1", 2020-06-12T02:35:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "debug_tp": "0/5", 2020-06-12T02:35:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "device_failure_prediction_mode": "none", 2020-06-12T02:35:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "echo": "false", 2020-06-12T02:35:20.664 INFO:teuthology.orchestra.run.smithi142.stdout: "editor": "vim", 2020-06-12T02:35:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "*", 2020-06-12T02:35:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2020-06-12T02:35:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "err_to_graylog": "false", 2020-06-12T02:35:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "err_to_stderr": "true", 2020-06-12T02:35:20.665 INFO:teuthology.orchestra.run.smithi142.stdout: "err_to_syslog": "false", 2020-06-12T02:35:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event_tracing": "false", 2020-06-12T02:35:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "fake_statfs_for_testing": "0", 2020-06-12T02:35:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "fatal_signal_handlers": "true", 2020-06-12T02:35:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "feedback_to_output": "false", 2020-06-12T02:35:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: "filer_max_purge_ops": "10", 2020-06-12T02:35:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "filer_max_truncate_ops": "128", 2020-06-12T02:35:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_apply_finisher_threads": "1", 2020-06-12T02:35:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_blackhole": "false", 2020-06-12T02:35:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_btrfs_clone_range": "true", 2020-06-12T02:35:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_btrfs_snap": "true", 2020-06-12T02:35:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_caller_concurrency": "10", 2020-06-12T02:35:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_collect_device_partition_information": "true", 2020-06-12T02:35:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_commit_timeout": "600.000000", 2020-06-12T02:35:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_debug_inject_read_err": "false", 2020-06-12T02:35:20.668 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_debug_omap_check": "false", 2020-06-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_debug_random_read_err": "0.000000", 2020-06-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_debug_verify_split": "false", 2020-06-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_dump_file": "", 2020-06-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2020-06-12T02:35:20.669 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_expected_throughput_ops": "200.000000", 2020-06-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fadvise": "true", 2020-06-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fail_eio": "true", 2020-06-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fd_cache_shards": "16", 2020-06-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fd_cache_size": "128", 2020-06-12T02:35:20.670 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fiemap": "false", 2020-06-12T02:35:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fiemap_threshold": "4096", 2020-06-12T02:35:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_fsync_flushes_journal_data": "false", 2020-06-12T02:35:20.672 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_index_retry_probability": "0.000000", 2020-06-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_inject_stall": "0", 2020-06-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_journal_parallel": "false", 2020-06-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_journal_trailing": "false", 2020-06-12T02:35:20.673 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_journal_writeahead": "false", 2020-06-12T02:35:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_kill_at": "0", 2020-06-12T02:35:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_alloc_hint_size": "1048576", 2020-06-12T02:35:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattr_size": "0", 2020-06-12T02:35:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2020-06-12T02:35:20.674 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattr_size_other": "512", 2020-06-12T02:35:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2020-06-12T02:35:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattrs": "0", 2020-06-12T02:35:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2020-06-12T02:35:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattrs_other": "2", 2020-06-12T02:35:20.675 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_inline_xattrs_xfs": "10", 2020-06-12T02:35:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_sync_interval": "5.000000", 2020-06-12T02:35:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_xattr_value_size": "0", 2020-06-12T02:35:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2020-06-12T02:35:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_xattr_value_size_other": "1024", 2020-06-12T02:35:20.676 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2020-06-12T02:35:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_merge_threshold": "-10", 2020-06-12T02:35:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_min_sync_interval": "0.010000", 2020-06-12T02:35:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_odsync_write": "false", 2020-06-12T02:35:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_omap_backend": "rocksdb", 2020-06-12T02:35:20.677 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_omap_backend_path": "", 2020-06-12T02:35:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_omap_header_cache_size": "1024", 2020-06-12T02:35:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_ondisk_finisher_threads": "1", 2020-06-12T02:35:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_op_thread_suicide_timeout": "180", 2020-06-12T02:35:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_op_thread_timeout": "60", 2020-06-12T02:35:20.678 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_op_threads": "2", 2020-06-12T02:35:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_punch_hole": "false", 2020-06-12T02:35:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2020-06-12T02:35:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2020-06-12T02:35:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2020-06-12T02:35:20.679 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_high_threshhold": "0.900000", 2020-06-12T02:35:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_low_threshhold": "0.300000", 2020-06-12T02:35:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_max_bytes": "104857600", 2020-06-12T02:35:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2020-06-12T02:35:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2020-06-12T02:35:20.680 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2020-06-12T02:35:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_queue_max_ops": "50", 2020-06-12T02:35:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2020-06-12T02:35:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_seek_data_hole": "false", 2020-06-12T02:35:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_sloppy_crc": "false", 2020-06-12T02:35:20.681 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_sloppy_crc_block_size": "65536", 2020-06-12T02:35:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_splice": "false", 2020-06-12T02:35:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_split_multiple": "2", 2020-06-12T02:35:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_split_rand_factor": "20", 2020-06-12T02:35:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_update_to": "1000", 2020-06-12T02:35:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2020-06-12T02:35:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2020-06-12T02:35:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2020-06-12T02:35:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2020-06-12T02:35:20.683 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2020-06-12T02:35:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2020-06-12T02:35:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_enable": "true", 2020-06-12T02:35:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2020-06-12T02:35:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2020-06-12T02:35:20.684 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2020-06-12T02:35:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2020-06-12T02:35:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2020-06-12T02:35:20.685 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2020-06-12T02:35:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_xfs_extsize": "false", 2020-06-12T02:35:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "filestore_zfs_snap": "false", 2020-06-12T02:35:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "fio_dir": "/tmp/fio", 2020-06-12T02:35:20.686 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "c120ba75-2438-45f0-aa6e-10a350976a3c", 2020-06-12T02:35:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_allow_other": "true", 2020-06-12T02:35:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_atomic_o_trunc": "true", 2020-06-12T02:35:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_big_writes": "true", 2020-06-12T02:35:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_debug": "false", 2020-06-12T02:35:20.687 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_default_permissions": "false", 2020-06-12T02:35:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_disable_pagecache": "false", 2020-06-12T02:35:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_max_write": "0", 2020-06-12T02:35:20.688 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_multithreaded": "true", 2020-06-12T02:35:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_require_active_mds": "true", 2020-06-12T02:35:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_set_user_groups": "true", 2020-06-12T02:35:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_syncfs_on_mksnap": "true", 2020-06-12T02:35:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "fuse_use_invalidate_cb": "true", 2020-06-12T02:35:20.689 INFO:teuthology.orchestra.run.smithi142.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2020-06-12T02:35:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "gss_target_name": "ceph", 2020-06-12T02:35:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_file": "", 2020-06-12T02:35:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_inject_failure": "0", 2020-06-12T02:35:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_interval": "5", 2020-06-12T02:35:20.690 INFO:teuthology.orchestra.run.smithi142.stdout: "host": "", 2020-06-12T02:35:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2020-06-12T02:35:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_max_inflight_ops": "128", 2020-06-12T02:35:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_max_size": "1073741824", 2020-06-12T02:35:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_path": "/tmp", 2020-06-12T02:35:20.691 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2020-06-12T02:35:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "immutable_object_cache_watermark": "0.100000", 2020-06-12T02:35:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "inject_early_sigterm": "false", 2020-06-12T02:35:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_aio": "true", 2020-06-12T02:35:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_align_min_size": "65536", 2020-06-12T02:35:20.692 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_block_align": "true", 2020-06-12T02:35:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_block_size": "4096", 2020-06-12T02:35:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_dio": "true", 2020-06-12T02:35:20.693 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_discard": "false", 2020-06-12T02:35:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_force_aio": "false", 2020-06-12T02:35:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_ignore_corruption": "false", 2020-06-12T02:35:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_max_write_bytes": "10485760", 2020-06-12T02:35:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_max_write_entries": "100", 2020-06-12T02:35:20.694 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_replay_from": "0", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_throttle_high_multiple": "0.000000", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_throttle_high_threshhold": "0.900000", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_throttle_low_threshhold": "0.600000", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_throttle_max_multiple": "0.000000", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_write_header_frequency": "0", 2020-06-12T02:35:20.695 INFO:teuthology.orchestra.run.smithi142.stdout: "journal_zero_on_create": "false", 2020-06-12T02:35:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "journaler_prefetch_periods": "10", 2020-06-12T02:35:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "journaler_prezero_periods": "5", 2020-06-12T02:35:20.696 INFO:teuthology.orchestra.run.smithi142.stdout: "journaler_write_head_interval": "15", 2020-06-12T02:35:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "key": "", 2020-06-12T02:35:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "keyfile": "", 2020-06-12T02:35:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2020-06-12T02:35:20.697 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_backend": "rocksdb", 2020-06-12T02:35:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_default_stripe_size": "65536", 2020-06-12T02:35:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_fsck_on_mount": "false", 2020-06-12T02:35:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_fsck_on_mount_deep": "true", 2020-06-12T02:35:20.698 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_max_bytes": "67108864", 2020-06-12T02:35:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_max_ops": "512", 2020-06-12T02:35:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_nid_prealloc": "1024", 2020-06-12T02:35:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_onode_map_size": "1024", 2020-06-12T02:35:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2020-06-12T02:35:20.699 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_sync_submit_transaction": "false", 2020-06-12T02:35:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "kstore_sync_transaction": "false", 2020-06-12T02:35:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_block_size": "65536", 2020-06-12T02:35:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_bloom_size": "0", 2020-06-12T02:35:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_cache_size": "536870912", 2020-06-12T02:35:20.700 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_compact_on_mount": "false", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_compression": "false", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_log": "", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_log_to_ceph_log": "true", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_max_open_files": "0", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_paranoid": "false", 2020-06-12T02:35:20.701 INFO:teuthology.orchestra.run.smithi142.stdout: "leveldb_write_buffer_size": "33554432", 2020-06-12T02:35:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "lockdep": "false", 2020-06-12T02:35:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "lockdep_force_backtrace": "false", 2020-06-12T02:35:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "log_coarse_timestamps": "true", 2020-06-12T02:35:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2020-06-12T02:35:20.702 INFO:teuthology.orchestra.run.smithi142.stdout: "log_flush_on_exit": "false", 2020-06-12T02:35:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "log_graylog_host": "127.0.0.1", 2020-06-12T02:35:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "log_graylog_port": "12201", 2020-06-12T02:35:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "log_max_new": "1000", 2020-06-12T02:35:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "log_max_recent": "10000", 2020-06-12T02:35:20.703 INFO:teuthology.orchestra.run.smithi142.stdout: "log_stderr_prefix": "", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "log_stop_at_utilization": "0.970000", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": "true", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_graylog": "false", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_stderr": "false", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_syslog": "false", 2020-06-12T02:35:20.704 INFO:teuthology.orchestra.run.smithi142.stdout: "max_completion_items": "50", 2020-06-12T02:35:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "max_rotating_auth_attempts": "10", 2020-06-12T02:35:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_action_on_write_error": "1", 2020-06-12T02:35:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_export_pin": "true", 2020-06-12T02:35:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_fragment_dirs": "true", 2020-06-12T02:35:20.705 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_fragment_interval": "5", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_fragment_size_max": "100000", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_idle_threshold": "0.000000", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_interval": "10", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_max": "-1", 2020-06-12T02:35:20.706 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_max_until": "-1", 2020-06-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_merge_size": "50", 2020-06-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_midchunk": "0.300000", 2020-06-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_min_rebalance": "0.100000", 2020-06-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_min_start": "0.200000", 2020-06-12T02:35:20.707 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_minchunk": "0.001000", 2020-06-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_mode": "0", 2020-06-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_need_max": "1.200000", 2020-06-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_need_min": "0.800000", 2020-06-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_replicate_threshold": "8000.000000", 2020-06-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_sample_interval": "3.000000", 2020-06-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_split_bits": "3", 2020-06-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_split_rd": "25000.000000", 2020-06-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_split_size": "10000", 2020-06-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_split_wr": "10000.000000", 2020-06-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_target_decay": "10.000000", 2020-06-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2020-06-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_beacon_grace": "15.000000", 2020-06-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_beacon_interval": "4.000000", 2020-06-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_memory_limit": "4294967296", 2020-06-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_mid": "0.700000", 2020-06-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_release_free_interval": "10", 2020-06-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_reservation": "0.050000", 2020-06-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_trim_decay_rate": "1.000000", 2020-06-12T02:35:20.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_trim_interval": "1", 2020-06-12T02:35:20.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache_trim_threshold": "65536", 2020-06-12T02:35:20.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2020-06-12T02:35:20.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_client_delegate_inos_pct": "50", 2020-06-12T02:35:20.712 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_client_prealloc_inos": "1000", 2020-06-12T02:35:20.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2020-06-12T02:35:20.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_damage_table_max_entries": "10000", 2020-06-12T02:35:20.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2020-06-12T02:35:20.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_debug_auth_pins": "false", 2020-06-12T02:35:20.713 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_debug_frag": "false", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_debug_scatterstat": "false", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_debug_subtrees": "false", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_decay_halflife": "5.000000", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_default_dir_hash": "2", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_defer_session_stale": "true", 2020-06-12T02:35:20.714 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dir_keys_per_op": "16384", 2020-06-12T02:35:20.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dir_max_commit_size": "10", 2020-06-12T02:35:20.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dirstat_min_interval": "1.000000", 2020-06-12T02:35:20.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dump_cache_after_rejoin": "false", 2020-06-12T02:35:20.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dump_cache_on_map": "false", 2020-06-12T02:35:20.715 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dump_cache_threshold_file": "0", 2020-06-12T02:35:20.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2020-06-12T02:35:20.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_early_reply": "true", 2020-06-12T02:35:20.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_enable_op_tracker": "true", 2020-06-12T02:35:20.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_enforce_unique_name": "true", 2020-06-12T02:35:20.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_forward_all_requests_to_auth": "false", 2020-06-12T02:35:20.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_freeze_tree_timeout": "30.000000", 2020-06-12T02:35:20.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2020-06-12T02:35:20.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_health_cache_threshold": "1.500000", 2020-06-12T02:35:20.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_health_summarize_threshold": "10", 2020-06-12T02:35:20.717 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_heartbeat_grace": "15.000000", 2020-06-12T02:35:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_inject_migrator_session_race": "false", 2020-06-12T02:35:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2020-06-12T02:35:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_join_fs": "", 2020-06-12T02:35:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_journal_format": "1", 2020-06-12T02:35:20.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_create_at": "0", 2020-06-12T02:35:20.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_export_at": "0", 2020-06-12T02:35:20.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_import_at": "0", 2020-06-12T02:35:20.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_journal_at": "0", 2020-06-12T02:35:20.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_journal_expire_at": "0", 2020-06-12T02:35:20.720 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_journal_replay_at": "0", 2020-06-12T02:35:20.720 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_link_at": "0", 2020-06-12T02:35:20.720 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_mdstable_at": "0", 2020-06-12T02:35:20.720 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_openc_at": "0", 2020-06-12T02:35:20.720 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_kill_rename_at": "0", 2020-06-12T02:35:20.721 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_events_per_segment": "1024", 2020-06-12T02:35:20.721 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_max_events": "-1", 2020-06-12T02:35:20.721 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_max_segments": "128", 2020-06-12T02:35:20.721 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_pause": "false", 2020-06-12T02:35:20.721 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_segment_size": "0", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log_skip_corrupt_events": "false", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_caps_per_client": "1048576", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_completed_flushes": "100000", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_completed_requests": "100000", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_export_size": "20971520", 2020-06-12T02:35:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_file_recover": "32", 2020-06-12T02:35:20.723 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_purge_files": "64", 2020-06-12T02:35:20.723 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_purge_ops": "8192", 2020-06-12T02:35:20.723 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2020-06-12T02:35:20.723 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_retries_on_remount_failure": "5", 2020-06-12T02:35:20.723 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_scrub_ops_in_progress": "5", 2020-06-12T02:35:20.724 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_snaps_per_dir": "100", 2020-06-12T02:35:20.724 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_max_xattr_pairs_size": "65536", 2020-06-12T02:35:20.724 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_min_caps_per_client": "100", 2020-06-12T02:35:20.724 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mon_shutdown_timeout": "5.000000", 2020-06-12T02:35:20.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_numa_node": "-1", 2020-06-12T02:35:20.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_op_complaint_time": "30.000000", 2020-06-12T02:35:20.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_op_history_duration": "600", 2020-06-12T02:35:20.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_op_history_size": "20", 2020-06-12T02:35:20.725 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_op_log_threshold": "5", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_global_max_decay_threshold": "65536", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_max_caps": "5000", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_max_decay_rate": "2.500000", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_max_decay_threshold": "16384", 2020-06-12T02:35:20.726 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_warning_decay_rate": "60.000000", 2020-06-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_recall_warning_threshold": "32768", 2020-06-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_reconnect_timeout": "45.000000", 2020-06-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_replay_interval": "1.000000", 2020-06-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_replay_unsafe_with_closed_session": "false", 2020-06-12T02:35:20.727 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_request_load_average_decay_rate": "60.000000", 2020-06-12T02:35:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_root_ino_gid": "0", 2020-06-12T02:35:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_root_ino_uid": "0", 2020-06-12T02:35:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_scatter_nudge_interval": "5.000000", 2020-06-12T02:35:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_session_blacklist_on_evict": "true", 2020-06-12T02:35:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_session_blacklist_on_timeout": "true", 2020-06-12T02:35:20.729 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2020-06-12T02:35:20.729 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_session_cache_liveness_magnitude": "10", 2020-06-12T02:35:20.729 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessionmap_keys_per_op": "1024", 2020-06-12T02:35:20.729 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_shutdown_check": "0", 2020-06-12T02:35:20.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_skip_ino": "0", 2020-06-12T02:35:20.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_snap_max_uid": "4294967294", 2020-06-12T02:35:20.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_snap_min_uid": "0", 2020-06-12T02:35:20.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_snap_rstat": "false", 2020-06-12T02:35:20.730 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_task_status_update_interval": "2.000000", 2020-06-12T02:35:20.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_thrash_exports": "0", 2020-06-12T02:35:20.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_thrash_fragments": "0", 2020-06-12T02:35:20.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_tick_interval": "5.000000", 2020-06-12T02:35:20.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_verify_backtrace": "1", 2020-06-12T02:35:20.731 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_verify_scatter": "false", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_wipe_ino_prealloc": "false", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_wipe_sessions": "false", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool_debug": "false", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "memstore_debug_omit_block_device_write": "false", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "memstore_device_bytes": "1073741824", 2020-06-12T02:35:20.732 INFO:teuthology.orchestra.run.smithi142.stdout: "memstore_page_set": "false", 2020-06-12T02:35:20.733 INFO:teuthology.orchestra.run.smithi142.stdout: "memstore_page_size": "65536", 2020-06-12T02:35:20.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_client_bytes": "134217728", 2020-06-12T02:35:20.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_client_messages": "512", 2020-06-12T02:35:20.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2020-06-12T02:35:20.733 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_connect_retry_interval": "1.000000", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_initial_modules": "restful iostat", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_mds_bytes": "134217728", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_mds_messages": "128", 2020-06-12T02:35:20.734 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2020-06-12T02:35:20.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_mon_bytes": "134217728", 2020-06-12T02:35:20.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_mon_messages": "128", 2020-06-12T02:35:20.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_osd_bytes": "536870912", 2020-06-12T02:35:20.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_osd_messages": "8192", 2020-06-12T02:35:20.735 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_service_beacon_grace": "60.000000", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_stats_period": "5", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_stats_threshold": "5", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_tick_period": "2", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_accept_timeout_factor": "2.000000", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_allow_pool_delete": "true", 2020-06-12T02:35:20.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2020-06-12T02:35:20.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2020-06-12T02:35:20.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_bytes": "104857600", 2020-06-12T02:35:20.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_directed_command_retry": "5", 2020-06-12T02:35:20.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_hunt_interval": "3.000000", 2020-06-12T02:35:20.737 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2020-06-12T02:35:20.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2020-06-12T02:35:20.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2020-06-12T02:35:20.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_hunt_parallel": "3", 2020-06-12T02:35:20.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_log_interval": "1.000000", 2020-06-12T02:35:20.738 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_max_log_entries_per_message": "1000", 2020-06-12T02:35:20.739 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_ping_interval": "10.000000", 2020-06-12T02:35:20.739 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_client_ping_timeout": "30.000000", 2020-06-12T02:35:20.739 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_clock_drift_allowed": "1.000000", 2020-06-12T02:35:20.739 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2020-06-12T02:35:20.740 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2020-06-12T02:35:20.740 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_file_level": "debug", 2020-06-12T02:35:20.740 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_file": "true", 2020-06-12T02:35:20.740 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_graylog": "false", 2020-06-12T02:35:20.740 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_graylog_port": "12201", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_stderr": "false", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_syslog": "default=false", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cluster_log_to_syslog_level": "info", 2020-06-12T02:35:20.741 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_compact_on_bootstrap": "false", 2020-06-12T02:35:20.742 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_compact_on_start": "false", 2020-06-12T02:35:20.742 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_compact_on_trim": "true", 2020-06-12T02:35:20.742 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_config_key_max_entry_size": "65536", 2020-06-12T02:35:20.742 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_cpu_threads": "4", 2020-06-12T02:35:20.744 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_crush_min_required_version": "hammer", 2020-06-12T02:35:20.744 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_daemon_bytes": "419430400", 2020-06-12T02:35:20.745 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2020-06-12T02:35:20.745 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_data_avail_crit": "5", 2020-06-12T02:35:20.745 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_data_avail_warn": "5", 2020-06-12T02:35:20.745 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_data_size_warn": "16106127360", 2020-06-12T02:35:20.745 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_block_osdmap_trim": "false", 2020-06-12T02:35:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_deprecated_as_obsolete": "false", 2020-06-12T02:35:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_dump_json": "false", 2020-06-12T02:35:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2020-06-12T02:35:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_dump_transactions": "false", 2020-06-12T02:35:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_extra_checks": "false", 2020-06-12T02:35:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_no_initial_persistent_features": "false", 2020-06-12T02:35:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2020-06-12T02:35:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_no_require_nautilus": "false", 2020-06-12T02:35:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_no_require_octopus": "false", 2020-06-12T02:35:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2020-06-12T02:35:20.748 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_delta_reset_interval": "10.000000", 2020-06-12T02:35:20.748 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_dns_srv_name": "ceph-mon", 2020-06-12T02:35:20.748 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_election_timeout": "5.000000", 2020-06-12T02:35:20.748 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_enable_op_tracker": "true", 2020-06-12T02:35:20.749 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_fake_pool_delete": "false", 2020-06-12T02:35:20.749 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_force_quorum_join": "false", 2020-06-12T02:35:20.749 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_globalid_prealloc": "10000", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_health_log_update_period": "5", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_health_max_detail": "50", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_health_to_clog": "true", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_health_to_clog_interval": "3600", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2020-06-12T02:35:20.750 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_host": "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.117", 2020-06-12T02:35:20.751 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_initial_members": "", 2020-06-12T02:35:20.751 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2020-06-12T02:35:20.751 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2020-06-12T02:35:20.751 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_inject_transaction_delay_max": "10.000000", 2020-06-12T02:35:20.751 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_keyvaluedb": "rocksdb", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_lease": "5.000000", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_lease_renew_interval_factor": "0.600000", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_log_max_summary": "50", 2020-06-12T02:35:20.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_log_entries_per_event": "4096", 2020-06-12T02:35:20.753 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_log_epochs": "500", 2020-06-12T02:35:20.753 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_mdsmap_epochs": "500", 2020-06-12T02:35:20.753 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_mgrmap_epochs": "500", 2020-06-12T02:35:20.753 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_osd": "10000", 2020-06-12T02:35:20.753 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_pg_per_osd": "10000", 2020-06-12T02:35:20.754 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_pool_pg_num": "65536", 2020-06-12T02:35:20.754 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_max_snap_prune_per_epoch": "100", 2020-06-12T02:35:20.754 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mds_blacklist_interval": "86400.000000", 2020-06-12T02:35:20.754 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mds_force_trim_to": "0", 2020-06-12T02:35:20.754 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mds_skip_sanity": "false", 2020-06-12T02:35:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_memory_autotune": "true", 2020-06-12T02:35:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_memory_target": "2147483648", 2020-06-12T02:35:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_beacon_grace": "30", 2020-06-12T02:35:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_blacklist_interval": "86400.000000", 2020-06-12T02:35:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_digest_period": "5", 2020-06-12T02:35:20.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_inactive_grace": "60", 2020-06-12T02:35:20.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_mkfs_grace": "240", 2020-06-12T02:35:20.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2020-06-12T02:35:20.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_min_osdmap_epochs": "500", 2020-06-12T02:35:20.756 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_complaint_time": "30", 2020-06-12T02:35:20.757 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_history_duration": "600", 2020-06-12T02:35:20.758 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_history_size": "20", 2020-06-12T02:35:20.758 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_history_slow_op_size": "20", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_history_slow_op_threshold": "10", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_op_log_threshold": "5", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_adjust_down_out_interval": "true", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2020-06-12T02:35:20.759 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_auto_mark_in": "false", 2020-06-12T02:35:20.760 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_auto_mark_new_in": "true", 2020-06-12T02:35:20.760 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2020-06-12T02:35:20.760 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_blacklist_default_expire": "3600.000000", 2020-06-12T02:35:20.760 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_cache_size": "500", 2020-06-12T02:35:20.760 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_cache_size_min": "134217728", 2020-06-12T02:35:20.761 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_crush_smoke_test": "true", 2020-06-12T02:35:20.761 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_destroyed_out_interval": "600", 2020-06-12T02:35:20.761 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_down_out_interval": "600", 2020-06-12T02:35:20.761 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_down_out_subtree_limit": "rack", 2020-06-12T02:35:20.761 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_force_trim_to": "0", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_full_ratio": "0.950000", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_initial_require_min_compat_client": "jewel", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_laggy_halflife": "3600", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_laggy_max_interval": "300", 2020-06-12T02:35:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_laggy_weight": "0.300000", 2020-06-12T02:35:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2020-06-12T02:35:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_max_creating_pgs": "1024", 2020-06-12T02:35:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_max_initial_pgs": "1024", 2020-06-12T02:35:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_min_down_reporters": "2", 2020-06-12T02:35:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_min_in_ratio": "0.750000", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_min_up_ratio": "0.300000", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_nearfull_ratio": "0.850000", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_prime_pg_temp": "true", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2020-06-12T02:35:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_report_timeout": "900", 2020-06-12T02:35:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_reporter_subtree_level": "osd", 2020-06-12T02:35:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2020-06-12T02:35:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osd_warn_op_age": "32.000000", 2020-06-12T02:35:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osdmap_full_prune_enabled": "true", 2020-06-12T02:35:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osdmap_full_prune_interval": "10", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osdmap_full_prune_min": "10000", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_osdmap_full_prune_txsize": "100", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_stuck_threshold": "60", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2020-06-12T02:35:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_warn_min_objects": "10000", 2020-06-12T02:35:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_warn_min_per_osd": "0", 2020-06-12T02:35:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pg_warn_min_pool_objects": "1000", 2020-06-12T02:35:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pool_quota_crit_threshold": "0", 2020-06-12T02:35:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_pool_quota_warn_threshold": "0", 2020-06-12T02:35:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_probe_timeout": "2.000000", 2020-06-12T02:35:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_reweight_max_change": "0.050000", 2020-06-12T02:35:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_reweight_max_osds": "4", 2020-06-12T02:35:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_reweight_min_bytes_per_osd": "10", 2020-06-12T02:35:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_reweight_min_pgs_per_osd": "4", 2020-06-12T02:35:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2020-06-12T02:35:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2020-06-12T02:35:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2020-06-12T02:35:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_scrub_interval": "86400", 2020-06-12T02:35:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_scrub_max_keys": "100", 2020-06-12T02:35:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_scrub_timeout": "300", 2020-06-12T02:35:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_session_timeout": "300", 2020-06-12T02:35:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_smart_report_timeout": "5", 2020-06-12T02:35:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_stat_smooth_intervals": "6", 2020-06-12T02:35:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_subscribe_interval": "86400.000000", 2020-06-12T02:35:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_debug": "false", 2020-06-12T02:35:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_max_payload_keys": "2000", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_max_payload_size": "1048576", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_provider_kill_at": "0", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_requester_kill_at": "0", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_sync_timeout": "60.000000", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_target_pg_per_osd": "100", 2020-06-12T02:35:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_tick_interval": "5", 2020-06-12T02:35:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_timecheck_interval": "300.000000", 2020-06-12T02:35:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_timecheck_skew_interval": "30.000000", 2020-06-12T02:35:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2020-06-12T02:35:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2020-06-12T02:35:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2020-06-12T02:35:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_misplaced": "false", 2020-06-12T02:35:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2020-06-12T02:35:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2020-06-12T02:35:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_pool_no_app": "true", 2020-06-12T02:35:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_pool_no_redundancy": "false", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_on_too_few_osds": "false", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2020-06-12T02:35:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2020-06-12T02:35:20.776 INFO:teuthology.orchestra.run.smithi142.stdout: "monmap": "", 2020-06-12T02:35:20.776 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_max_op_threads": "5", 2020-06-12T02:35:20.776 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_op_threads": "3", 2020-06-12T02:35:20.776 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_buffer_size": "131072", 2020-06-12T02:35:20.776 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_cm": "false", 2020-06-12T02:35:20.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_device_name": "", 2020-06-12T02:35:20.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_dscp": "96", 2020-06-12T02:35:20.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_enable_hugepage": "false", 2020-06-12T02:35:20.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_gid_idx": "0", 2020-06-12T02:35:20.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_local_gid": "", 2020-06-12T02:35:20.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_polling_us": "1000", 2020-06-12T02:35:20.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_port_num": "1", 2020-06-12T02:35:20.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_receive_buffers": "32768", 2020-06-12T02:35:20.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_receive_queue_len": "4096", 2020-06-12T02:35:20.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_roce_ver": "1", 2020-06-12T02:35:20.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_send_buffers": "1024", 2020-06-12T02:35:20.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_sl": "3", 2020-06-12T02:35:20.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_support_srq": "true", 2020-06-12T02:35:20.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_async_rdma_type": "ib", 2020-06-12T02:35:20.780 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_before_connect": "false", 2020-06-12T02:35:20.780 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_ipv4": "true", 2020-06-12T02:35:20.780 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_ipv6": "false", 2020-06-12T02:35:20.780 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_msgr1": "true", 2020-06-12T02:35:20.780 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_msgr2": "true", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_port_max": "7300", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_port_min": "6800", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_prefer_ipv4": "false", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_retry_count": "3", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_bind_retry_delay": "5", 2020-06-12T02:35:20.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_blackhole_client": "false", 2020-06-12T02:35:20.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_blackhole_mds": "false", 2020-06-12T02:35:20.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_blackhole_mgr": "false", 2020-06-12T02:35:20.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_blackhole_mon": "false", 2020-06-12T02:35:20.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_blackhole_osd": "false", 2020-06-12T02:35:20.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_client_mode": "crc secure", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_cluster_mode": "crc secure", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_cluster_type": "", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_connection_idle_timeout": "900", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_connection_ready_timeout": "10", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_crc_data": "true", 2020-06-12T02:35:20.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_crc_header": "true", 2020-06-12T02:35:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_die_on_bad_msg": "false", 2020-06-12T02:35:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_die_on_bug": "true", 2020-06-12T02:35:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_die_on_old_message": "true", 2020-06-12T02:35:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_die_on_skipped_message": "false", 2020-06-12T02:35:20.784 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_die_on_unhandled_msg": "false", 2020-06-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dispatch_throttle_bytes": "104857600", 2020-06-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_coremask": "0xF", 2020-06-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_debug_allow_loopback": "false", 2020-06-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2020-06-12T02:35:20.785 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_host_ipv4_addr": "", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_hugepages": "", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_hw_flow_control": "true", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_lro": "true", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_memory_channel": "4", 2020-06-12T02:35:20.786 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2020-06-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_pmd": "", 2020-06-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_port_id": "0", 2020-06-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2020-06-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dump_corrupt_message_level": "1", 2020-06-12T02:35:20.787 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_dump_on_send": "false", 2020-06-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_initial_backoff": "0.200000", 2020-06-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_delay_max": "1.000000", 2020-06-12T02:35:20.788 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_delay_msg_type": "", 2020-06-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_delay_probability": "0.000000", 2020-06-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_delay_type": "", 2020-06-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_internal_delays": "0.000000", 2020-06-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_inject_socket_failures": "2500", 2020-06-12T02:35:20.789 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_learn_addr_from_peer": "true", 2020-06-12T02:35:20.790 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_max_accept_failures": "4", 2020-06-12T02:35:20.790 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_max_backoff": "15.000000", 2020-06-12T02:35:20.790 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_mon_client_mode": "secure crc", 2020-06-12T02:35:20.790 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_mon_cluster_mode": "secure crc", 2020-06-12T02:35:20.791 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_mon_service_mode": "secure crc", 2020-06-12T02:35:20.791 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2020-06-12T02:35:20.791 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_pq_min_cost": "65536", 2020-06-12T02:35:20.791 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_public_type": "", 2020-06-12T02:35:20.791 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_service_mode": "crc secure", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_tcp_listen_backlog": "512", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_tcp_nodelay": "true", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_tcp_prefetch_max_size": "4096", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_tcp_rcvbuf": "0", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "ms_type": "async+posix", 2020-06-12T02:35:20.792 INFO:teuthology.orchestra.run.smithi142.stdout: "no_config_file": "false", 2020-06-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_completion_locks_per_session": "32", 2020-06-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_debug_inject_relock_delay": "false", 2020-06-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_inflight_op_bytes": "104857600", 2020-06-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_inflight_ops": "1024", 2020-06-12T02:35:20.793 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_inject_no_watch_ping": "false", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_retry_writes_after_first_reply": "false", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_tick_interval": "5.000000", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter_timeout": "10.000000", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "objectstore_blackhole": "false", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_delay_time": "5.000000", 2020-06-12T02:35:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_hist_halflife": "1000", 2020-06-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_max_low_ops": "2", 2020-06-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_max_ops": "4", 2020-06-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_min_evict_effort": "0.100000", 2020-06-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_quantize_effort": "0.100000", 2020-06-12T02:35:20.795 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_agent_slop": "0.020000", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_allow_recovery_below_min_size": "true", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_async_recovery_min_cost": "100", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_auto_mark_unfound_lost": "false", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backfill_retry_interval": "30.000000", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backfill_scan_max": "512", 2020-06-12T02:35:20.796 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backfill_scan_min": "64", 2020-06-12T02:35:20.797 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backoff_on_degraded": "false", 2020-06-12T02:35:20.798 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backoff_on_peering": "false", 2020-06-12T02:35:20.798 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_backoff_on_unfound": "true", 2020-06-12T02:35:20.798 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_beacon_report_interval": "300", 2020-06-12T02:35:20.798 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bench_duration": "30", 2020-06-12T02:35:20.798 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bench_large_size_max_throughput": "104857600", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bench_max_block_size": "67108864", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bench_small_size_max_iops": "100", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_blkin_trace_all": "false", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2020-06-12T02:35:20.799 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_check_for_log_corruption": "false", 2020-06-12T02:35:20.800 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_check_max_object_name_len_on_startup": "true", 2020-06-12T02:35:20.800 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2020-06-12T02:35:20.800 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2020-06-12T02:35:20.800 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2020-06-12T02:35:20.800 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_class_update_on_start": "true", 2020-06-12T02:35:20.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_client_message_cap": "100", 2020-06-12T02:35:20.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_client_message_size_cap": "524288000", 2020-06-12T02:35:20.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_client_op_priority": "63", 2020-06-12T02:35:20.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_client_watch_timeout": "30", 2020-06-12T02:35:20.801 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_command_max_records": "256", 2020-06-12T02:35:20.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_command_thread_suicide_timeout": "900", 2020-06-12T02:35:20.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_command_thread_timeout": "600", 2020-06-12T02:35:20.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_copyfrom_max_chunk": "8388608", 2020-06-12T02:35:20.802 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_crush_chooseleaf_type": "0", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_crush_initial_weight": "-1.000000", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_crush_update_on_start": "true", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_crush_update_weight_set": "true", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2020-06-12T02:35:20.803 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2020-06-12T02:35:20.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_drop_ping_duration": "0", 2020-06-12T02:35:20.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_drop_ping_probability": "0.000000", 2020-06-12T02:35:20.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_feed_pullee": "-1", 2020-06-12T02:35:20.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_inject_copyfrom_error": "false", 2020-06-12T02:35:20.804 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2020-06-12T02:35:20.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2020-06-12T02:35:20.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_misdirected_ops": "false", 2020-06-12T02:35:20.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_no_acting_change": "false", 2020-06-12T02:35:20.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_no_purge_strays": "false", 2020-06-12T02:35:20.805 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_op_order": "false", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_pg_log_writeout": "false", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_pretend_recovery_active": "false", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_random_push_read_error": "0.000000", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_shutdown": "false", 2020-06-12T02:35:20.806 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2020-06-12T02:35:20.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2020-06-12T02:35:20.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_verify_cached_snaps": "false", 2020-06-12T02:35:20.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_verify_missing_on_start": "false", 2020-06-12T02:35:20.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_verify_snaps": "false", 2020-06-12T02:35:20.807 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_debug_verify_stray_on_activate": "false", 2020-06-12T02:35:20.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_interval": "604800.000000", 2020-06-12T02:35:20.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_keys": "1024", 2020-06-12T02:35:20.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2020-06-12T02:35:20.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2020-06-12T02:35:20.808 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_stride": "524288", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_default_data_pool_replay_window": "5", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_default_notify_timeout": "30", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_delete_sleep": "0.000000", 2020-06-12T02:35:20.809 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_delete_sleep_hdd": "5.000000", 2020-06-12T02:35:20.810 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_delete_sleep_hybrid": "2.000000", 2020-06-12T02:35:20.810 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_delete_sleep_ssd": "0.000000", 2020-06-12T02:35:20.810 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_discard_disconnected_ops": "true", 2020-06-12T02:35:20.810 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_enable_op_tracker": "true", 2020-06-12T02:35:20.810 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_failsafe_full_ratio": "0.970000", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_fast_fail_on_connection_refused": "true", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_fast_info": "true", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_fast_shutdown": "true", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_find_best_info_ignore_history_les": "false", 2020-06-12T02:35:20.811 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_force_auth_primary_missing_objects": "100", 2020-06-12T02:35:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2020-06-12T02:35:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_function_tracing": "false", 2020-06-12T02:35:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_grace": "20", 2020-06-12T02:35:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_interval": "6", 2020-06-12T02:35:20.812 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_min_peers": "10", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_min_size": "2000", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_stale": "600", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_hit_set_max_size": "100000", 2020-06-12T02:35:20.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_hit_set_min_size": "1000", 2020-06-12T02:35:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_hit_set_namespace": ".ceph-internal", 2020-06-12T02:35:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_ignore_stale_divergent_priors": "false", 2020-06-12T02:35:20.814 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2020-06-12T02:35:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_inject_failure_on_pg_removal": "false", 2020-06-12T02:35:20.815 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2020-06-12T02:35:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_journal_flush_on_shutdown": "true", 2020-06-12T02:35:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_journal_size": "5120", 2020-06-12T02:35:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_kill_backfill_at": "0", 2020-06-12T02:35:20.816 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_loop_before_reset_tphandle": "64", 2020-06-12T02:35:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_map_cache_size": "50", 2020-06-12T02:35:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_map_dedup": "true", 2020-06-12T02:35:20.817 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_map_message_max": "40", 2020-06-12T02:35:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_map_message_max_bytes": "10485760", 2020-06-12T02:35:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_map_share_max_epochs": "40", 2020-06-12T02:35:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_attr_name_len": "100", 2020-06-12T02:35:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_attr_size": "0", 2020-06-12T02:35:20.818 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_backfills": "1", 2020-06-12T02:35:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_markdown_count": "5", 2020-06-12T02:35:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_markdown_period": "600", 2020-06-12T02:35:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_object_name_len": "2048", 2020-06-12T02:35:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_object_namespace_len": "256", 2020-06-12T02:35:20.819 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_object_size": "134217728", 2020-06-12T02:35:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2020-06-12T02:35:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_omap_entries_per_request": "1024", 2020-06-12T02:35:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_pg_blocked_by": "16", 2020-06-12T02:35:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_pg_log_entries": "10000", 2020-06-12T02:35:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2020-06-12T02:35:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_pgls": "1024", 2020-06-12T02:35:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_push_cost": "8388608", 2020-06-12T02:35:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_push_objects": "10", 2020-06-12T02:35:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_scrubs": "1", 2020-06-12T02:35:20.821 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2020-06-12T02:35:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_trimming_pgs": "2", 2020-06-12T02:35:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_write_op_reply_len": "32", 2020-06-12T02:35:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_max_write_size": "90", 2020-06-12T02:35:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2020-06-12T02:35:20.822 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2020-06-12T02:35:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2020-06-12T02:35:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2020-06-12T02:35:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2020-06-12T02:35:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2020-06-12T02:35:20.823 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2020-06-12T02:35:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_client_lim": "999999", 2020-06-12T02:35:20.824 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_client_res": "1", 2020-06-12T02:35:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mclock_scheduler_client_wgt": "1", 2020-06-12T02:35:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_base": "805306368", 2020-06-12T02:35:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_cache_min": "134217728", 2020-06-12T02:35:20.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_cache_resize_interval": "1.000000", 2020-06-12T02:35:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_expected_fragmentation": "0.150000", 2020-06-12T02:35:20.826 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_target": "4294967296", 2020-06-12T02:35:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2020-06-12T02:35:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_min_pg_log_entries": "250", 2020-06-12T02:35:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_min_recovery_priority": "0", 2020-06-12T02:35:20.827 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_ack_timeout": "30.000000", 2020-06-12T02:35:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_heartbeat_interval": "30", 2020-06-12T02:35:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2020-06-12T02:35:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_report_interval": "5", 2020-06-12T02:35:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_report_max_in_flight": "2", 2020-06-12T02:35:20.828 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mon_shutdown_timeout": "5.000000", 2020-06-12T02:35:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_num_cache_shards": "32", 2020-06-12T02:35:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_num_op_tracker_shard": "32", 2020-06-12T02:35:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_numa_auto_affinity": "true", 2020-06-12T02:35:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_numa_node": "-1", 2020-06-12T02:35:20.829 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_numa_prefer_iface": "true", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_object_clean_region_max_num_intervals": "10", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_objecter_finishers": "1", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_objectstore": "bluestore", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_objectstore_fuse": "false", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_objectstore_tracing": "false", 2020-06-12T02:35:20.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_complaint_time": "30.000000", 2020-06-12T02:35:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_history_duration": "600", 2020-06-12T02:35:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_history_size": "20", 2020-06-12T02:35:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_history_slow_op_size": "20", 2020-06-12T02:35:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2020-06-12T02:35:20.831 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_log_threshold": "5", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_shards": "0", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_shards_hdd": "5", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_shards_ssd": "8", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_threads_per_shard": "0", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2020-06-12T02:35:20.832 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2020-06-12T02:35:20.833 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2020-06-12T02:35:20.833 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_pq_min_cost": "65536", 2020-06-12T02:35:20.833 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_queue": "wpq", 2020-06-12T02:35:20.833 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_queue_cut_off": "high", 2020-06-12T02:35:20.833 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_thread_suicide_timeout": "150", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_op_thread_timeout": "15", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_open_classes_on_start": "true", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_os_flags": "0", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_peering_op_priority": "255", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_delete_cost": "1048576", 2020-06-12T02:35:20.834 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_delete_priority": "5", 2020-06-12T02:35:20.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2020-06-12T02:35:20.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2020-06-12T02:35:20.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_log_dups_tracked": "3000", 2020-06-12T02:35:20.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_log_trim_max": "10000", 2020-06-12T02:35:20.835 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_log_trim_min": "100", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_object_context_cache_count": "64", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pg_stat_report_interval_max": "500", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_min_evict_age": "0", 2020-06-12T02:35:20.836 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_min_flush_age": "0", 2020-06-12T02:35:20.837 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2020-06-12T02:35:20.837 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2020-06-12T02:35:20.837 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2020-06-12T02:35:20.837 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_crush_rule": "-1", 2020-06-12T02:35:20.837 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_ec_fast_read": "false", 2020-06-12T02:35:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2020-06-12T02:35:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_flag_hashpspool": "true", 2020-06-12T02:35:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_flag_nodelete": "false", 2020-06-12T02:35:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_flag_nopgchange": "false", 2020-06-12T02:35:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_flag_nosizechange": "false", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_flags": "0", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_min_size": "0", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_pg_num": "32", 2020-06-12T02:35:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_pgp_num": "0", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_size": "2", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_default_type": "replicated", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pool_use_gmt_hitset": "true", 2020-06-12T02:35:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_push_per_object_cost": "1000", 2020-06-12T02:35:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_read_ec_check_for_errors": "false", 2020-06-12T02:35:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recover_clone_overlap": "true", 2020-06-12T02:35:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recover_clone_overlap_limit": "10", 2020-06-12T02:35:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_cost": "20971520", 2020-06-12T02:35:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_delay_start": "0.000000", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_active": "0", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_active_hdd": "3", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_active_ssd": "10", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_chunk": "8388608", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2020-06-12T02:35:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_max_single_start": "1", 2020-06-12T02:35:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_op_priority": "3", 2020-06-12T02:35:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_op_warn_multiple": "16", 2020-06-12T02:35:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_priority": "5", 2020-06-12T02:35:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_retry_interval": "30.000000", 2020-06-12T02:35:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_sleep": "0.000000", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_sleep_hdd": "0.100000", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_recovery_sleep_ssd": "0.000000", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_repair_during_recovery": "false", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_requested_scrub_priority": "120", 2020-06-12T02:35:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_rollback_to_cluster_snap": "", 2020-06-12T02:35:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_auto_repair": "false", 2020-06-12T02:35:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_auto_repair_num_errors": "5", 2020-06-12T02:35:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_backoff_ratio": "0.660000", 2020-06-12T02:35:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_begin_hour": "0", 2020-06-12T02:35:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_begin_week_day": "0", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_chunk_max": "25", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_chunk_min": "5", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_cost": "52428800", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_during_recovery": "false", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_end_hour": "24", 2020-06-12T02:35:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_end_week_day": "7", 2020-06-12T02:35:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_extended_sleep": "0.000000", 2020-06-12T02:35:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2020-06-12T02:35:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_invalid_stats": "true", 2020-06-12T02:35:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_load_threshold": "0.500000", 2020-06-12T02:35:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_max_interval": "604800.000000", 2020-06-12T02:35:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_max_preemptions": "5", 2020-06-12T02:35:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_min_interval": "86400.000000", 2020-06-12T02:35:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_priority": "5", 2020-06-12T02:35:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_scrub_sleep": "0.000000", 2020-06-12T02:35:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_shutdown_pgref_assert": "false", 2020-06-12T02:35:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_skip_data_digest": "false", 2020-06-12T02:35:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_smart_report_timeout": "5", 2020-06-12T02:35:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_cost": "1048576", 2020-06-12T02:35:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_priority": "5", 2020-06-12T02:35:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_sleep": "0.000000", 2020-06-12T02:35:20.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2020-06-12T02:35:20.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2020-06-12T02:35:20.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2020-06-12T02:35:20.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_stats_ack_timeout_decay": "0.900000", 2020-06-12T02:35:20.850 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_stats_ack_timeout_factor": "2.000000", 2020-06-12T02:35:20.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2020-06-12T02:35:20.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_target_transaction_size": "30", 2020-06-12T02:35:20.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_hit_set_count": "4", 2020-06-12T02:35:20.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2020-06-12T02:35:20.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_default_cache_mode": "writeback", 2020-06-12T02:35:20.852 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2020-06-12T02:35:20.853 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tier_promote_max_objects_sec": "25", 2020-06-12T02:35:20.853 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_tracing": "false", 2020-06-12T02:35:20.853 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_use_stale_snap": "false", 2020-06-12T02:35:20.853 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2020-06-12T02:35:20.853 INFO:teuthology.orchestra.run.smithi142.stdout: "osdc_blkin_trace_all": "false", 2020-06-12T02:35:20.854 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_kill_at": "0", 2020-06-12T02:35:20.854 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_max_join_drift": "10", 2020-06-12T02:35:20.854 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_min": "500", 2020-06-12T02:35:20.854 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_min_wait": "0.050000", 2020-06-12T02:35:20.854 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_propose_interval": "1.000000", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_service_trim_max": "500", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_service_trim_min": "250", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_stash_full_interval": "25", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_trim_max": "500", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "paxos_trim_min": "250", 2020-06-12T02:35:20.855 INFO:teuthology.orchestra.run.smithi142.stdout: "perf": "true", 2020-06-12T02:35:20.856 INFO:teuthology.orchestra.run.smithi142.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2020-06-12T02:35:20.856 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin_crypto_accelerator": "crypto_isal", 2020-06-12T02:35:20.856 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin_dir": "/usr/lib/ceph", 2020-06-12T02:35:20.856 INFO:teuthology.orchestra.run.smithi142.stdout: "prompt": "\u001b[01;33mCephFS:~\u001b[96m/\u001b[0m\u001b[01;33m>>>\u001b[00m ", 2020-06-12T02:35:20.856 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "-", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrv": "", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "public_bind_addr": "-", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "public_network": "", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "public_network_interface": "", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "qat_compressor_enabled": "false", 2020-06-12T02:35:20.857 INFO:teuthology.orchestra.run.smithi142.stdout: "quiet": "false", 2020-06-12T02:35:20.858 INFO:teuthology.orchestra.run.smithi142.stdout: "rados_mon_op_timeout": "0.000000", 2020-06-12T02:35:20.858 INFO:teuthology.orchestra.run.smithi142.stdout: "rados_osd_op_timeout": "0.000000", 2020-06-12T02:35:20.858 INFO:teuthology.orchestra.run.smithi142.stdout: "rados_tracing": "false", 2020-06-12T02:35:20.858 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_atime_update_interval": "60", 2020-06-12T02:35:20.858 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2020-06-12T02:35:20.864 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_balance_parent_reads": "false", 2020-06-12T02:35:20.864 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_balance_snap_reads": "false", 2020-06-12T02:35:20.865 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_blacklist_expire_seconds": "0", 2020-06-12T02:35:20.865 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_blacklist_on_break_lock": "true", 2020-06-12T02:35:20.865 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_blkin_trace_all": "false", 2020-06-12T02:35:20.865 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache": "true", 2020-06-12T02:35:20.865 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_block_writes_upfront": "false", 2020-06-12T02:35:20.866 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_max_dirty": "25165824", 2020-06-12T02:35:20.866 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_max_dirty_age": "1.000000", 2020-06-12T02:35:20.866 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_max_dirty_object": "0", 2020-06-12T02:35:20.866 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_policy": "writearound", 2020-06-12T02:35:20.866 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_size": "33554432", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_target_dirty": "16777216", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_cache_writethrough_until_flush": "true", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_clone_copy_on_read": "false", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_compression_hint": "none", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_concurrent_management_ops": "10", 2020-06-12T02:35:20.867 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_clone_format": "auto", 2020-06-12T02:35:20.868 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_data_pool": "", 2020-06-12T02:35:20.868 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_features": "61", 2020-06-12T02:35:20.868 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_format": "2", 2020-06-12T02:35:20.868 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_map_options": "", 2020-06-12T02:35:20.868 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_order": "22", 2020-06-12T02:35:20.869 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_pool": "rbd", 2020-06-12T02:35:20.869 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_stripe_count": "0", 2020-06-12T02:35:20.869 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_default_stripe_unit": "0", 2020-06-12T02:35:20.869 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_disable_zero_copy_writes": "true", 2020-06-12T02:35:20.869 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_discard_granularity_bytes": "65536", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_discard_on_zeroed_write_same": "true", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_enable_alloc_hint": "true", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_io_scheduler": "simple", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_commit_age": "5.000000", 2020-06-12T02:35:20.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2020-06-12T02:35:20.871 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_max_payload_bytes": "16384", 2020-06-12T02:35:20.871 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_object_flush_age": "0.000000", 2020-06-12T02:35:20.871 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_object_flush_bytes": "1048576", 2020-06-12T02:35:20.871 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_object_flush_interval": "0", 2020-06-12T02:35:20.871 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2020-06-12T02:35:20.872 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2020-06-12T02:35:20.872 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_order": "24", 2020-06-12T02:35:20.872 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_pool": "", 2020-06-12T02:35:20.872 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_journal_splay_width": "4", 2020-06-12T02:35:20.872 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_localize_parent_reads": "false", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_localize_snap_reads": "false", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2020-06-12T02:35:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2020-06-12T02:35:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2020-06-12T02:35:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_policy_type": "simple", 2020-06-12T02:35:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2020-06-12T02:35:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_image_state_check_interval": "30", 2020-06-12T02:35:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_autotune": "true", 2020-06-12T02:35:20.875 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_base": "805306368", 2020-06-12T02:35:20.876 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2020-06-12T02:35:20.876 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_cache_min": "134217728", 2020-06-12T02:35:20.876 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2020-06-12T02:35:20.876 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2020-06-12T02:35:20.876 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_memory_target": "4294967296", 2020-06-12T02:35:20.877 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_perf_stats_prio": "5", 2020-06-12T02:35:20.877 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2020-06-12T02:35:20.877 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2020-06-12T02:35:20.877 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirroring_delete_delay": "0", 2020-06-12T02:35:20.877 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2020-06-12T02:35:20.878 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirroring_replay_delay": "0", 2020-06-12T02:35:20.878 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2020-06-12T02:35:20.879 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2020-06-12T02:35:20.879 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_move_to_trash_on_remove": "false", 2020-06-12T02:35:20.879 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2020-06-12T02:35:20.879 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_mtime_update_interval": "60", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_non_blocking_aio": "true", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_op_thread_timeout": "60", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_op_threads": "1", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_parent_cache_enabled": "false", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_bps_burst": "0", 2020-06-12T02:35:20.880 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_bps_limit": "0", 2020-06-12T02:35:20.881 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_iops_burst": "0", 2020-06-12T02:35:20.881 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_iops_limit": "0", 2020-06-12T02:35:20.881 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_read_bps_burst": "0", 2020-06-12T02:35:20.881 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_read_bps_limit": "0", 2020-06-12T02:35:20.881 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_read_iops_burst": "0", 2020-06-12T02:35:20.882 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_read_iops_limit": "0", 2020-06-12T02:35:20.882 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_schedule_tick_min": "50", 2020-06-12T02:35:20.882 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_write_bps_burst": "0", 2020-06-12T02:35:20.882 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_write_bps_limit": "0", 2020-06-12T02:35:20.882 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_write_iops_burst": "0", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_qos_write_iops_limit": "0", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_read_from_replica_policy": "default", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_readahead_max_bytes": "524288", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_readahead_trigger_requests": "10", 2020-06-12T02:35:20.883 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_request_timed_out_seconds": "30", 2020-06-12T02:35:20.884 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_rwl_enabled": "false", 2020-06-12T02:35:20.884 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_rwl_log_periodic_stats": "false", 2020-06-12T02:35:20.884 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_rwl_path": "/tmp", 2020-06-12T02:35:20.884 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_rwl_size": "1073741824", 2020-06-12T02:35:20.885 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_skip_partial_discard": "true", 2020-06-12T02:35:20.885 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2020-06-12T02:35:20.885 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_tracing": "false", 2020-06-12T02:35:20.885 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_validate_names": "true", 2020-06-12T02:35:20.885 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_validate_pool": "true", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "restapi_base_url": "", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "restapi_log_level": "", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_acl_grants_max_num": "100", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_admin_entry": "admin", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_barbican_url": "", 2020-06-12T02:35:20.886 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2020-06-12T02:35:20.887 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_default_quota_max_size": "-1", 2020-06-12T02:35:20.888 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_index_max_aio": "128", 2020-06-12T02:35:20.888 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_quota_cache_size": "10000", 2020-06-12T02:35:20.888 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_quota_soft_threshold": "0.950000", 2020-06-12T02:35:20.888 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_bucket_quota_ttl": "600", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_cache_enabled": "true", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_cache_expiry_interval": "900", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_cache_lru_size": "10000", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_content_length_compat": "false", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_copy_obj_progress": "true", 2020-06-12T02:35:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2020-06-12T02:35:20.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_cors_rules_max_num": "100", 2020-06-12T02:35:20.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_cross_domain_policy": "", 2020-06-12T02:35:20.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_default_encryption_key": "", 2020-06-12T02:35:20.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_require_ssl": "true", 2020-06-12T02:35:20.890 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2020-06-12T02:35:20.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2020-06-12T02:35:20.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_suppress_logs": "true", 2020-06-12T02:35:20.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_addr": "", 2020-06-12T02:35:20.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_auth": "token", 2020-06-12T02:35:20.891 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_namespace": "", 2020-06-12T02:35:20.892 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_prefix": "", 2020-06-12T02:35:20.892 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_secret_engine": "transit", 2020-06-12T02:35:20.892 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_crypt_vault_token_file": "", 2020-06-12T02:35:20.892 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_curl_low_speed_limit": "1024", 2020-06-12T02:35:20.892 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_curl_low_speed_time": "300", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_curl_wait_timeout_ms": "1000", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data_log_changes_size": "1000", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data_log_num_shards": "128", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data_log_obj_prefix": "data_log", 2020-06-12T02:35:20.893 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data_log_window": "30", 2020-06-12T02:35:20.894 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_data_notify_interval_msec": "200", 2020-06-12T02:35:20.894 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_default_realm_info_oid": "default.realm", 2020-06-12T02:35:20.894 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_default_region_info_oid": "default.region", 2020-06-12T02:35:20.894 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_default_zone_info_oid": "default.zone", 2020-06-12T02:35:20.894 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2020-06-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_defer_to_bucket_acls": "", 2020-06-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_delete_multi_obj_max_num": "1000", 2020-06-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_admin_lim": "0.000000", 2020-06-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_admin_res": "100.000000", 2020-06-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2020-06-12T02:35:20.896 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_auth_lim": "0.000000", 2020-06-12T02:35:20.896 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_auth_res": "200.000000", 2020-06-12T02:35:20.896 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2020-06-12T02:35:20.896 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_data_lim": "0.000000", 2020-06-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_data_res": "500.000000", 2020-06-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_data_wgt": "500.000000", 2020-06-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2020-06-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_metadata_res": "500.000000", 2020-06-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2020-06-12T02:35:20.898 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dns_name": "", 2020-06-12T02:35:20.898 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dns_s3website_name": "", 2020-06-12T02:35:20.898 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_dynamic_resharding": "true", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_gc_threads": "true", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_lc_threads": "true", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_ops_log": "false", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_quota_threads": "true", 2020-06-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_static_website": "false", 2020-06-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enable_usage_log": "false", 2020-06-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_enforce_swift_acls": "true", 2020-06-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_exit_timeout_secs": "120", 2020-06-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_expose_bucket": "false", 2020-06-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_extended_http_attrs": "", 2020-06-12T02:35:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_fcgi_socket_backlog": "1024", 2020-06-12T02:35:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2020-06-12T02:35:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_frontends": "beast port=7480", 2020-06-12T02:35:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_concurrent_io": "10", 2020-06-12T02:35:20.901 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_deferred": "50", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_objs": "32", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_queue_size": "134213632", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_max_trim_chunk": "16", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_obj_min_wait": "7200", 2020-06-12T02:35:20.902 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_processor_max_time": "3600", 2020-06-12T02:35:20.903 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_gc_processor_period": "3600", 2020-06-12T02:35:20.903 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_get_obj_max_req_size": "4194304", 2020-06-12T02:35:20.903 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_get_obj_window_size": "16777216", 2020-06-12T02:35:20.903 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_healthcheck_disabling_path": "", 2020-06-12T02:35:20.903 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_host": "", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ignore_get_invalid_range": "false", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_init_timeout": "300", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_accepted_admin_roles": "", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2020-06-12T02:35:20.904 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_domain": "", 2020-06-12T02:35:20.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_password": "", 2020-06-12T02:35:20.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_password_path": "", 2020-06-12T02:35:20.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_project": "", 2020-06-12T02:35:20.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_tenant": "", 2020-06-12T02:35:20.905 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_token": "", 2020-06-12T02:35:20.906 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_token_path": "", 2020-06-12T02:35:20.906 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_admin_user": "", 2020-06-12T02:35:20.906 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_api_version": "2", 2020-06-12T02:35:20.906 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_barbican_domain": "", 2020-06-12T02:35:20.906 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_barbican_password": "", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_barbican_project": "", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_barbican_tenant": "", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_barbican_user": "", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_implicit_tenants": "false", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_token_cache_size": "10000", 2020-06-12T02:35:20.907 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_url": "", 2020-06-12T02:35:20.908 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_keystone_verify_ssl": "true", 2020-06-12T02:35:20.908 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lc_debug_interval": "-1", 2020-06-12T02:35:20.908 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lc_lock_max_time": "60", 2020-06-12T02:35:20.908 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lc_max_objs": "32", 2020-06-12T02:35:20.908 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lc_max_rules": "1000", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lc_thread_delay": "0", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_dnattr": "uid", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_searchfilter": "", 2020-06-12T02:35:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2020-06-12T02:35:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ldap_uri": "ldaps://", 2020-06-12T02:35:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2020-06-12T02:35:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_list_bucket_min_readahead": "1000", 2020-06-12T02:35:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_list_buckets_max_chunk": "1000", 2020-06-12T02:35:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_log_http_headers": "", 2020-06-12T02:35:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_log_nonexistent_bucket": "false", 2020-06-12T02:35:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2020-06-12T02:35:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_log_object_name_utc": "false", 2020-06-12T02:35:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_attr_name_len": "0", 2020-06-12T02:35:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_attr_size": "0", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_attrs_num_in_req": "0", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_chunk_size": "4194304", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_concurrent_requests": "1024", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_dynamic_shards": "1999", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_listing_results": "1000", 2020-06-12T02:35:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_notify_retries": "3", 2020-06-12T02:35:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_objs_per_shard": "100000", 2020-06-12T02:35:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_put_param_size": "1048576", 2020-06-12T02:35:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_put_size": "5368709120", 2020-06-12T02:35:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_max_slo_entries": "1000", 2020-06-12T02:35:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_md_log_max_shards": "64", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_md_notify_interval_msec": "200", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_mime_types_file": "/etc/mime.types", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_mp_lock_max_time": "600", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_multipart_min_part_size": "5242880", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_multipart_part_upload_limit": "10000", 2020-06-12T02:35:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_fhcache_partitions": "3", 2020-06-12T02:35:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_fhcache_size": "2017", 2020-06-12T02:35:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2020-06-12T02:35:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_lru_lanes": "5", 2020-06-12T02:35:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_max_gc": "300", 2020-06-12T02:35:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_namespace_expire_secs": "300", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_s3_fast_attrs": "false", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_nfs_write_completion_interval_s": "10", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_num_async_rados_threads": "32", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_num_control_oids": "8", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_num_rados_handles": "1", 2020-06-12T02:35:20.916 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_numa_node": "-1", 2020-06-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_obj_stripe_size": "4194304", 2020-06-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_obj_tombstone_cache_size": "1000", 2020-06-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_objexp_chunk_size": "100", 2020-06-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_objexp_gc_interval": "600", 2020-06-12T02:35:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_objexp_hints_num_shards": "127", 2020-06-12T02:35:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_olh_pending_timeout_sec": "3600", 2020-06-12T02:35:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_op_thread_suicide_timeout": "0", 2020-06-12T02:35:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_op_thread_timeout": "600", 2020-06-12T02:35:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_op_tracing": "false", 2020-06-12T02:35:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_opa_token": "", 2020-06-12T02:35:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_opa_url": "", 2020-06-12T02:35:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_opa_verify_ssl": "true", 2020-06-12T02:35:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ops_log_data_backlog": "5242880", 2020-06-12T02:35:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ops_log_rados": "true", 2020-06-12T02:35:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_ops_log_socket_path": "", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_override_bucket_index_max_shards": "0", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_period_push_interval": "2.000000", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_period_push_interval_max": "30.000000", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_period_root_pool": ".rgw.root", 2020-06-12T02:35:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_port": "", 2020-06-12T02:35:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_print_continue": "true", 2020-06-12T02:35:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_print_prohibited_content_length": "false", 2020-06-12T02:35:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_put_obj_max_window_size": "67108864", 2020-06-12T02:35:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_put_obj_min_window_size": "16777216", 2020-06-12T02:35:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_rados_pool_pg_num_min": "8", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_rados_pool_recovery_priority": "5", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_rados_tracing": "false", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_realm": "", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_realm_root_pool": ".rgw.root", 2020-06-12T02:35:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_region": "", 2020-06-12T02:35:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_region_root_pool": ".rgw.root", 2020-06-12T02:35:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_relaxed_region_enforcement": "false", 2020-06-12T02:35:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_relaxed_s3_bucket_names": "false", 2020-06-12T02:35:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2020-06-12T02:35:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_request_uri": "", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_reshard_batch_size": "64", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_reshard_bucket_lock_duration": "360", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_reshard_max_aio": "128", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_reshard_num_logs": "16", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_reshard_thread_interval": "600", 2020-06-12T02:35:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_resolve_cname": "false", 2020-06-12T02:35:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_rest_getusage_op_compat": "false", 2020-06-12T02:35:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_run_sync_thread": "true", 2020-06-12T02:35:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_auth_order": "sts, external, local", 2020-06-12T02:35:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_auth_use_keystone": "false", 2020-06-12T02:35:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_auth_use_ldap": "false", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_auth_use_rados": "true", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_auth_use_sts": "false", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_s3_success_create_obj_status": "0", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_safe_max_objects_per_shard": "102400", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_scheduler_type": "throttler", 2020-06-12T02:35:20.926 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_script_uri": "", 2020-06-12T02:35:20.927 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_service_provider_name": "", 2020-06-12T02:35:20.927 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_shard_warning_threshold": "90.000000", 2020-06-12T02:35:20.927 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_socket_path": "", 2020-06-12T02:35:20.927 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_client_id": "", 2020-06-12T02:35:20.927 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_client_secret": "", 2020-06-12T02:35:20.928 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_entry": "sts", 2020-06-12T02:35:20.928 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_key": "sts", 2020-06-12T02:35:20.928 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_max_session_duration": "43200", 2020-06-12T02:35:20.928 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sts_token_introspection_url": "", 2020-06-12T02:35:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_account_in_url": "false", 2020-06-12T02:35:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_auth_entry": "auth", 2020-06-12T02:35:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_auth_url": "", 2020-06-12T02:35:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_custom_header": "", 2020-06-12T02:35:20.929 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_enforce_content_length": "false", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_need_stats": "true", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_tenant_name": "", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_token_expiration": "86400", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_url": "", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_url_prefix": "swift", 2020-06-12T02:35:20.930 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_swift_versioning_enabled": "false", 2020-06-12T02:35:20.931 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2020-06-12T02:35:20.931 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_lease_period": "120", 2020-06-12T02:35:20.931 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2020-06-12T02:35:20.931 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_log_trim_interval": "1200", 2020-06-12T02:35:20.931 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_log_trim_max_buckets": "16", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_trace_history_size": "4096", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_trace_per_node_log_size": "32", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2020-06-12T02:35:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_thread_pool_size": "512", 2020-06-12T02:35:20.933 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_comment": "", 2020-06-12T02:35:20.933 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_createby": "", 2020-06-12T02:35:20.933 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_encoding": "", 2020-06-12T02:35:20.933 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_flag": "false", 2020-06-12T02:35:20.933 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_origin": "", 2020-06-12T02:35:20.934 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_sha_unit": "524288", 2020-06-12T02:35:20.934 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_torrent_tracker": "", 2020-06-12T02:35:20.934 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_trust_forwarded_https": "false", 2020-06-12T02:35:20.934 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_usage_log_flush_threshold": "1024", 2020-06-12T02:35:20.934 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_usage_log_tick_interval": "30", 2020-06-12T02:35:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_usage_max_shards": "32", 2020-06-12T02:35:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_usage_max_user_shards": "1", 2020-06-12T02:35:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_use_opa_authz": "false", 2020-06-12T02:35:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_default_quota_max_objects": "-1", 2020-06-12T02:35:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_default_quota_max_size": "-1", 2020-06-12T02:35:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_max_buckets": "1000", 2020-06-12T02:35:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2020-06-12T02:35:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_quota_sync_idle_users": "false", 2020-06-12T02:35:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_quota_sync_interval": "86400", 2020-06-12T02:35:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_quota_sync_wait_time": "86400", 2020-06-12T02:35:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_user_unique_email": "true", 2020-06-12T02:35:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_verify_ssl": "true", 2020-06-12T02:35:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_website_routing_rules_max_num": "50", 2020-06-12T02:35:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_zone": "", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_zone_root_pool": ".rgw.root", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_zonegroup": "", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_block_size": "4096", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_bloom_bits_per_key": "20", 2020-06-12T02:35:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2020-06-12T02:35:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", 2020-06-12T02:35:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_row_ratio": "0.000000", 2020-06-12T02:35:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_shard_bits": "4", 2020-06-12T02:35:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_size": "536870912", 2020-06-12T02:35:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_cache_type": "binned_lru", 2020-06-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_collect_compaction_stats": "false", 2020-06-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_collect_extended_stats": "false", 2020-06-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_collect_memory_stats": "false", 2020-06-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_delete_range_threshold": "1048576", 2020-06-12T02:35:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_index_type": "binary_search", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_log_to_ceph_log": "true", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_metadata_block_size": "4096", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_partition_filters": "false", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_perf": "false", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2020-06-12T02:35:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "rotating_keys_bootstrap_timeout": "30", 2020-06-12T02:35:20.942 INFO:teuthology.orchestra.run.smithi142.stdout: "rotating_keys_renewal_timeout": "10", 2020-06-12T02:35:20.942 INFO:teuthology.orchestra.run.smithi142.stdout: "run_dir": "/var/run/ceph", 2020-06-12T02:35:20.942 INFO:teuthology.orchestra.run.smithi142.stdout: "setgroup": "", 2020-06-12T02:35:20.942 INFO:teuthology.orchestra.run.smithi142.stdout: "setuser": "", 2020-06-12T02:35:20.942 INFO:teuthology.orchestra.run.smithi142.stdout: "setuser_match_path": "", 2020-06-12T02:35:20.943 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_misplaced_ratio": "0.050000", 2020-06-12T02:35:20.943 INFO:teuthology.orchestra.run.smithi142.stdout: "thp": "false", 2020-06-12T02:35:20.944 INFO:teuthology.orchestra.run.smithi142.stdout: "threadpool_default_timeout": "60", 2020-06-12T02:35:20.944 INFO:teuthology.orchestra.run.smithi142.stdout: "threadpool_empty_queue_max_wait": "2", 2020-06-12T02:35:20.944 INFO:teuthology.orchestra.run.smithi142.stdout: "throttler_perf_counter": "true", 2020-06-12T02:35:20.944 INFO:teuthology.orchestra.run.smithi142.stdout: "timing": "false" 2020-06-12T02:35:20.944 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:20.947 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2020-06-12T02:35:21.058 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.052+0000 7f2556b98700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.068 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.060+0000 7f2555936700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.089 INFO:teuthology.orchestra.run.smithi142.stdout:mon.b: {} 2020-06-12T02:35:21.105 INFO:teuthology.orchestra.run.smithi142.stdout:mon.a: {} 2020-06-12T02:35:21.119 INFO:teuthology.orchestra.run.smithi142.stdout:mon.c: {} 2020-06-12T02:35:21.119 INFO:teuthology.orchestra.run.smithi142.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-06-12T02:35:21.120 INFO:teuthology.orchestra.run.smithi142.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-06-12T02:35:21.120 INFO:teuthology.orchestra.run.smithi142.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-06-12T02:35:21.132 INFO:teuthology.orchestra.run.smithi142:> type ceph-objectstore-tool 2020-06-12T02:35:21.138 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-06-12T02:35:21.139 INFO:teuthology.orchestra.run.smithi117:> type ceph-objectstore-tool 2020-06-12T02:35:21.147 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-06-12T02:35:21.148 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, not available on all OSD nodes 2020-06-12T02:35:21.149 INFO:teuthology.run_tasks:Running task rados... 2020-06-12T02:35:21.162 INFO:tasks.rados:Beginning rados... 2020-06-12T02:35:21.163 DEBUG:teuthology.run_tasks:Unwinding manager rados 2020-06-12T02:35:21.179 INFO:tasks.rados:joining rados 2020-06-12T02:35:21.179 INFO:tasks.thrashosds.thrasher:starting do_thrash 2020-06-12T02:35:21.180 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:21.180 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:21.180 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:21.181 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2020-06-12T02:35:21.182 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2020-06-12T02:35:21.182 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:21.183 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2020-06-12T02:35:21.183 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:21.184 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2020-06-12T02:35:21.184 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:35:21.185 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2020-06-12T02:35:21.185 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2020-06-12T02:35:21.187 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:21.180+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:21.283 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:21.280+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:21.303 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.288+0000 7fbc1d154700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.306 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.304+0000 7fbc1c953700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.327 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.320+0000 7f075b86e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.328 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.320+0000 7f0b9e330700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.336 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.324+0000 7f3029219700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.336 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.336+0000 7f075b86e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.337 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.336+0000 7f0b9d0ce700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.342 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:21.340+0000 7f3029219700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:21.345 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:21.345 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:21.345 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:21.345 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:21.357 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:21.386 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:21.387 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:21.384+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:21.412 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:21.445 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:21.481 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:21.486 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:21.484+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:21.494 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:21.503 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:21.508 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:21.546 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:21.587 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:21.587 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:21.584+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:21.589 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:21.592 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:21.602 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2020-06-12T02:35:19.920044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":754974720,"kb_used":8389760,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584960,"statfs":{"total":773094113280,"available":764502999040,"internally_reserved":8589934592,"allocated":1114112,"data_stored":305712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7610000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.589}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1980000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7770000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.968}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.663}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2360000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7949999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.665}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.548}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.085}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.778}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048720,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323120,"statfs":{"total":96636764160,"available":95562874880,"internally_reserved":1073741824,"allocated":139264,"data_stored":38214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1019999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.484}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5699999999999998}]}]}]}} 2020-06-12T02:35:21.616 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:21.616 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.616 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.617 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.617 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.617 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.617 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.617 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.618 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:21.630 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:21.631 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:21.634 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:21.721 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:21.720+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:21.788 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:21.788 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:21.789 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:21.787+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:21.796 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:21.896 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:21.895+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:21.953 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:21.953 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:21.962 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:21.997 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:21.999+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:22.034 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:35:22.049 INFO:tasks.rados:starting run 0 out of 1 2020-06-12T02:35:22.055 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2020-06-12T02:35:22.056 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2020-06-12T02:35:22.080 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.080 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.098 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:22.141 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:22.140+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:22.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:22.172+0000 7feb6371c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:22.190 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:22.188+0000 7feb6371c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:22.202 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:22.200+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:22.251 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.251 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.261 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:22.309 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:22.308+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:22.411 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:22.408+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:22.414 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.415 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.433 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:22.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:22.515+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.589 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.597 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:22.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:22.619+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:22.708 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.708 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.718 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:22.723 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:22.720+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:22.831 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.831 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:22.832 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:22.828+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:22.839 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:22.933 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:22.932+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:22.993 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:22.993 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.003 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:23.049 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:23.051+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:23.125 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.126 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.134 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:23.135+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:23.135 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:23.235 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:23.236+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:23.282 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.283 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.293 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:23.340 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:23.340+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:23.410 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.410 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.419 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:23.440 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:23.440+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:23.537 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.537 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.551 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:23.552 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:23.551+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:23.632 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:23.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:23.651+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:23.701 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.701 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.710 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:23.744+0000 7f981b9b3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:23.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:23.752+0000 7f981a751700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:23.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:23.755+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:23.789 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:23.812 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:23.833 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:23.852 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:23.855 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:23.852+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:23.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:23.862 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:23.872 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:23.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:23.897 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:23.947 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.949 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.950 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:23.956 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:23.955+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:23.981 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:23.981 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:23.982 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:23.982 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:23.999 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:24.047 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:35:24.060 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'unique_pool_0' created 2020-06-12T02:35:24.061 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:24.060+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:24.076 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set unique_pool_0 allow_ec_overwrites true 2020-06-12T02:35:24.143 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:24.144 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:24.144 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:24.144 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:24.144 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:24.153 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:24.156 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:24.148+0000 7fde6dde3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:24.158 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:24.156+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:24.234 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:24.220+0000 7f1130c7e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:24.240 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:24.236+0000 7f112b59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:24.259 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:24.259+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:24.260 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [] 2020-06-12T02:35:24.261 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:24.269 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:24.361 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:24.360+0000 7fde67fff700 0 --2- 172.21.15.142:0/3990403156 >> v2:172.21.15.142:3300/0 conn(0x7fde68136f40 0x7fde681373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-06-12T02:35:24.361 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:24.360+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:24.369 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:24.364+0000 7fde6dde3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:24.427 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:24.427 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:24.436 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:24.462 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:24.460+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:24.563 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:24.565 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:24.567+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:24.666 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:24.667+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:24.673 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:24.673 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:24.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:24.674 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [] 2020-06-12T02:35:24.674 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:24.683 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:24.772 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:24.771+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:24.800 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:24.800 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:24.801 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:24.801 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:24.873 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:24.875+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:24.918 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:24.918 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:24.919 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:24.928 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:24.979 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:24.976+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:25.034 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [] 2020-06-12T02:35:25.035 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:25.063 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:35:25.064 INFO:teuthology.orchestra.run.smithi142.stderr:set pool 1 allow_ec_overwrites to true 2020-06-12T02:35:25.080 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:25.076+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:25.081 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2020-06-12T02:35:25.171 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:25.172 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.178 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:25.176+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:25.180 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:25.242 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:25.224+0000 7efc12ca8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:25.246 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:25.244+0000 7efc11a46700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:25.279 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:25.276+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:25.336 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.337 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:25.337 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:25.337 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:25.337 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.346 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:25.388 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:25.387+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:25.489 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:25.491+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:25.496 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [] 2020-06-12T02:35:25.497 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.509 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:25.590 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:25.588+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:25.634 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:25.635 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.641 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:25.690 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:25.691+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:25.791 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:25.791+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:25.793 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.793 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:25.794 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.803 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:25.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:25.891+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:25.905 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:25.905 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:25.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:25.906 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [] 2020-06-12T02:35:25.906 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:25.930 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:25.959 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:25.992 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:25.991+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:26.048 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:26.049 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:26.049 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:26.058 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:26.075 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rados' on pool 'unique_pool_0' 2020-06-12T02:35:26.087 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:26.084+0000 7f119af62700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:26.091 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:26.088+0000 7f119af62700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:26.119 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:26.120 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:26.116+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:26.141 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:26.163 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:26.172 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:26.173 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:26.173 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:26.173 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:26.173 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:26.182 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:26.186 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:26.211 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:26.212 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:26.208+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:26.235 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:26.259 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:26.283 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:26.285 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.286 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.286 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.286 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.286 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.287 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.287 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.287 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:26.288 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.288 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.294 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:26.292+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:26.298 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:26.394 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:26.396+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:26.416 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.417 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.426 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:26.495 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:26.492+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:26.535 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.536 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.544 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:26.596 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:26.596+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:26.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:26.606 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:26.607 INFO:tasks.thrashosds.thrasher:inject_pause on 2 2020-06-12T02:35:26.607 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-06-12T02:35:26.607 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-06-12T02:35:26.608 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2020-06-12T02:35:26.651 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.651 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.663 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:26.698 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:26.696+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:26.722 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-06-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:26.773 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.774 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.784 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:26.829 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:26.831+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:26.893 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:26.895 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:26.900 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:26.896+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:26.905 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:27.004 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:27.004+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:27.056 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.057 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.066 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:27.094 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:35:27.095 INFO:teuthology.orchestra.run.smithi142:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2020-06-12T02:35:27.113 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight read -> 100 2020-06-12T02:35:27.113 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight write -> 50 2020-06-12T02:35:27.113 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight delete -> 50 2020-06-12T02:35:27.113 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight snap_create -> 50 2020-06-12T02:35:27.114 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight snap_remove -> 50 2020-06-12T02:35:27.114 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight rollback -> 50 2020-06-12T02:35:27.114 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight copy_from -> 50 2020-06-12T02:35:27.114 INFO:tasks.rados.rados.0.smithi142.stdout:adding op weight write_excl -> 50 2020-06-12T02:35:27.114 INFO:tasks.rados.rados.0.smithi142.stdout:ceph version 15.2.3-196-g91d24f4985 (91d24f498556f86f6d1318d2efd5210c35b36762) octopus (stable) 2020-06-12T02:35:27.115 INFO:tasks.rados.rados.0.smithi142.stdout:Configuration: 2020-06-12T02:35:27.115 INFO:tasks.rados.rados.0.smithi142.stdout: Number of operations: 4000 2020-06-12T02:35:27.115 INFO:tasks.rados.rados.0.smithi142.stdout: Number of objects: 50 2020-06-12T02:35:27.115 INFO:tasks.rados.rados.0.smithi142.stdout: Max in flight operations: 16 2020-06-12T02:35:27.115 INFO:tasks.rados.rados.0.smithi142.stdout: Object size (in bytes): 4000000 2020-06-12T02:35:27.116 INFO:tasks.rados.rados.0.smithi142.stdout: Write stride min: 400000 2020-06-12T02:35:27.116 INFO:tasks.rados.rados.0.smithi142.stdout: Write stride max: 800000 2020-06-12T02:35:27.116 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:27.112+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:27.173 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.174 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.183 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:27.206 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:27.204+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:27.212 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:27.200+0000 7f80e0f11700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:27.217 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:27.216+0000 7f80db59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:27.287 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.288 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.297 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:27.306 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:27.304+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:27.405 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.406 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:27.407+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:27.414 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:27.509 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:27.511+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:27.564 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.564 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.573 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:27.617 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:27.619+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:27.715 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:27.715+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:27.727 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.728 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.737 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:27.816 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:27.816+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:27.893 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:27.894 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:27.904 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:27.918 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:27.919+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:28.019 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:28.019+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:28.043 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:28.087 INFO:tasks.rados.rados.0.smithi142.stdout:1: write initial oid 1 2020-06-12T02:35:28.087 INFO:tasks.rados.rados.0.smithi142.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2020-06-12T02:35:28.090 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:35:28.097 INFO:tasks.rados.rados.0.smithi142.stdout:1: writing smithi14213939-1 from 416807 to 892056 tid 1 2020-06-12T02:35:28.103 INFO:tasks.rados.rados.0.smithi142.stdout:1: writing smithi14213939-1 from 1542129 to 2016807 tid 2 2020-06-12T02:35:28.104 INFO:tasks.rados.rados.0.smithi142.stdout:2: write initial oid 2 2020-06-12T02:35:28.104 INFO:tasks.rados.rados.0.smithi142.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2020-06-12T02:35:28.108 INFO:tasks.rados.rados.0.smithi142.stdout:2: writing smithi14213939-2 from 416807 to 892056 tid 1 2020-06-12T02:35:28.115 INFO:tasks.rados.rados.0.smithi142.stdout:2: writing smithi14213939-2 from 1542129 to 2016807 tid 2 2020-06-12T02:35:28.115 INFO:tasks.rados.rados.0.smithi142.stdout:3: write initial oid 3 2020-06-12T02:35:28.116 INFO:tasks.rados.rados.0.smithi142.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2020-06-12T02:35:28.120 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:28.116+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:28.121 INFO:tasks.rados.rados.0.smithi142.stdout:3: writing smithi14213939-3 from 433614 to 984112 tid 1 2020-06-12T02:35:28.128 INFO:tasks.rados.rados.0.smithi142.stdout:3: writing smithi14213939-3 from 1600611 to 2033614 tid 2 2020-06-12T02:35:28.128 INFO:tasks.rados.rados.0.smithi142.stdout:4: write initial oid 4 2020-06-12T02:35:28.129 INFO:tasks.rados.rados.0.smithi142.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2020-06-12T02:35:28.135 INFO:tasks.rados.rados.0.smithi142.stdout:4: writing smithi14213939-4 from 450421 to 1076168 tid 1 2020-06-12T02:35:28.141 INFO:tasks.rados.rados.0.smithi142.stdout:4: writing smithi14213939-4 from 1659093 to 2050421 tid 2 2020-06-12T02:35:28.141 INFO:tasks.rados.rados.0.smithi142.stdout:5: write initial oid 5 2020-06-12T02:35:28.141 INFO:tasks.rados.rados.0.smithi142.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2020-06-12T02:35:28.151 INFO:tasks.rados.rados.0.smithi142.stdout:5: writing smithi14213939-5 from 467228 to 1168224 tid 1 2020-06-12T02:35:28.162 INFO:tasks.rados.rados.0.smithi142.stdout:5: writing smithi14213939-5 from 1717575 to 2067228 tid 2 2020-06-12T02:35:28.162 INFO:tasks.rados.rados.0.smithi142.stdout:6: write initial oid 6 2020-06-12T02:35:28.162 INFO:tasks.rados.rados.0.smithi142.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2020-06-12T02:35:28.163 INFO:tasks.rados.rados.0.smithi142.stdout:6: writing smithi14213939-6 from 484035 to 1260280 tid 1 2020-06-12T02:35:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:28.168 INFO:tasks.rados.rados.0.smithi142.stdout:6: writing smithi14213939-6 from 2059704 to 2084035 tid 2 2020-06-12T02:35:28.168 INFO:tasks.rados.rados.0.smithi142.stdout:7: write initial oid 7 2020-06-12T02:35:28.168 INFO:tasks.rados.rados.0.smithi142.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2020-06-12T02:35:28.173 INFO:tasks.rados.rados.0.smithi142.stdout:7: writing smithi14213939-7 from 500842 to 952336 tid 1 2020-06-12T02:35:28.178 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:28.189 INFO:tasks.rados.rados.0.smithi142.stdout:7: writing smithi14213939-7 from 1718186 to 2100842 tid 2 2020-06-12T02:35:28.189 INFO:tasks.rados.rados.0.smithi142.stdout:8: write initial oid 8 2020-06-12T02:35:28.189 INFO:tasks.rados.rados.0.smithi142.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2020-06-12T02:35:28.190 INFO:tasks.rados.rados.0.smithi142.stdout:8: writing smithi14213939-8 from 517649 to 1044392 tid 1 2020-06-12T02:35:28.193 INFO:tasks.rados.rados.0.smithi142.stdout:8: writing smithi14213939-8 from 1776668 to 2117649 tid 2 2020-06-12T02:35:28.193 INFO:tasks.rados.rados.0.smithi142.stdout:9: write initial oid 9 2020-06-12T02:35:28.193 INFO:tasks.rados.rados.0.smithi142.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2020-06-12T02:35:28.201 INFO:tasks.rados.rados.0.smithi142.stdout:9: writing smithi14213939-9 from 534456 to 1252801 tid 1 2020-06-12T02:35:28.206 INFO:tasks.rados.rados.0.smithi142.stdout:9: writing smithi14213939-9 from 1951503 to 2134456 tid 2 2020-06-12T02:35:28.206 INFO:tasks.rados.rados.0.smithi142.stdout:10: write initial oid 10 2020-06-12T02:35:28.207 INFO:tasks.rados.rados.0.smithi142.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2020-06-12T02:35:28.214 INFO:tasks.rados.rados.0.smithi142.stdout:10: writing smithi14213939-10 from 551263 to 1344857 tid 1 2020-06-12T02:35:28.219 INFO:tasks.rados.rados.0.smithi142.stdout:10: writing smithi14213939-10 from 1893632 to 2151263 tid 2 2020-06-12T02:35:28.219 INFO:tasks.rados.rados.0.smithi142.stdout:11: write initial oid 11 2020-06-12T02:35:28.219 INFO:tasks.rados.rados.0.smithi142.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2020-06-12T02:35:28.221 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:28.223+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:28.225 INFO:tasks.rados.rados.0.smithi142.stdout:11: writing smithi14213939-11 from 568070 to 1036913 tid 1 2020-06-12T02:35:28.232 INFO:tasks.rados.rados.0.smithi142.stdout:11: writing smithi14213939-11 from 1552114 to 2168070 tid 2 2020-06-12T02:35:28.232 INFO:tasks.rados.rados.0.smithi142.stdout:12: write initial oid 12 2020-06-12T02:35:28.232 INFO:tasks.rados.rados.0.smithi142.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2020-06-12T02:35:28.238 INFO:tasks.rados.rados.0.smithi142.stdout:12: writing smithi14213939-12 from 584877 to 1128969 tid 1 2020-06-12T02:35:28.245 INFO:tasks.rados.rados.0.smithi142.stdout:12: writing smithi14213939-12 from 1610596 to 2172599 tid 2 2020-06-12T02:35:28.245 INFO:tasks.rados.rados.0.smithi142.stdout:13: write initial oid 13 2020-06-12T02:35:28.245 INFO:tasks.rados.rados.0.smithi142.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2020-06-12T02:35:28.253 INFO:tasks.rados.rados.0.smithi142.stdout:13: writing smithi14213939-13 from 601684 to 1221025 tid 1 2020-06-12T02:35:28.258 INFO:tasks.rados.rados.0.smithi142.stdout:13: writing smithi14213939-13 from 1669078 to 2201684 tid 2 2020-06-12T02:35:28.259 INFO:tasks.rados.rados.0.smithi142.stdout:14: write initial oid 14 2020-06-12T02:35:28.259 INFO:tasks.rados.rados.0.smithi142.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2020-06-12T02:35:28.267 INFO:tasks.rados.rados.0.smithi142.stdout:14: writing smithi14213939-14 from 618491 to 1313081 tid 1 2020-06-12T02:35:28.272 INFO:tasks.rados.rados.0.smithi142.stdout:14: writing smithi14213939-14 from 2011207 to 2218491 tid 2 2020-06-12T02:35:28.272 INFO:tasks.rados.rados.0.smithi142.stdout:15: write initial oid 15 2020-06-12T02:35:28.273 INFO:tasks.rados.rados.0.smithi142.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2020-06-12T02:35:28.281 INFO:tasks.rados.rados.0.smithi142.stdout:15: writing smithi14213939-15 from 635298 to 1405137 tid 1 2020-06-12T02:35:28.286 INFO:tasks.rados.rados.0.smithi142.stdout:15: writing smithi14213939-15 from 2069689 to 2235298 tid 2 2020-06-12T02:35:28.286 INFO:tasks.rados.rados.0.smithi142.stdout:16: write initial oid 16 2020-06-12T02:35:28.287 INFO:tasks.rados.rados.0.smithi142.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2020-06-12T02:35:28.292 INFO:tasks.rados.rados.0.smithi142.stdout:16: writing smithi14213939-16 from 652105 to 1097193 tid 1 2020-06-12T02:35:28.297 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:28.299 INFO:tasks.rados.rados.0.smithi142.stdout:16: writing smithi14213939-16 from 1728171 to 2181159 tid 2 2020-06-12T02:35:28.300 INFO:tasks.rados.rados.0.smithi142.stdout: waiting on 16 2020-06-12T02:35:28.300 INFO:tasks.rados.rados.0.smithi142.stdout:1: finishing write tid 1 to smithi14213939-1 2020-06-12T02:35:28.300 INFO:tasks.rados.rados.0.smithi142.stdout:1: finishing write tid 2 to smithi14213939-1 2020-06-12T02:35:28.301 INFO:tasks.rados.rados.0.smithi142.stdout:1: finishing write tid 4 to smithi14213939-1 2020-06-12T02:35:28.301 INFO:tasks.rados.rados.0.smithi142.stdout:2: finishing write tid 1 to smithi14213939-2 2020-06-12T02:35:28.301 INFO:tasks.rados.rados.0.smithi142.stdout:1: finishing write tid 5 to smithi14213939-1 2020-06-12T02:35:28.301 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-06-12T02:35:28.301 INFO:tasks.rados.rados.0.smithi142.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2020-06-12T02:35:28.302 INFO:tasks.rados.rados.0.smithi142.stdout:2: finishing write tid 2 to smithi14213939-2 2020-06-12T02:35:28.302 INFO:tasks.rados.rados.0.smithi142.stdout:2: finishing write tid 4 to smithi14213939-2 2020-06-12T02:35:28.302 INFO:tasks.rados.rados.0.smithi142.stdout:1: done (15 left) 2020-06-12T02:35:28.303 INFO:tasks.rados.rados.0.smithi142.stdout:17: write initial oid 17 2020-06-12T02:35:28.303 INFO:tasks.rados.rados.0.smithi142.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2020-06-12T02:35:28.306 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:28.306 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:28.307 INFO:tasks.rados.rados.0.smithi142.stdout:17: writing smithi14213939-17 from 668912 to 1305602 tid 1 2020-06-12T02:35:28.312 INFO:tasks.rados.rados.0.smithi142.stdout:17: writing smithi14213939-17 from 1903006 to 2268912 tid 2 2020-06-12T02:35:28.313 INFO:tasks.rados.rados.0.smithi142.stdout: waiting on 16 2020-06-12T02:35:28.313 INFO:tasks.rados.rados.0.smithi142.stdout:2: finishing write tid 5 to smithi14213939-2 2020-06-12T02:35:28.313 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2020-06-12T02:35:28.313 INFO:tasks.rados.rados.0.smithi142.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2020-06-12T02:35:28.313 INFO:tasks.rados.rados.0.smithi142.stdout:2: done (15 left) 2020-06-12T02:35:28.314 INFO:tasks.rados.rados.0.smithi142.stdout:18: write initial oid 18 2020-06-12T02:35:28.314 INFO:tasks.rados.rados.0.smithi142.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2020-06-12T02:35:28.318 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:28.323 INFO:tasks.rados.rados.0.smithi142.stdout:18: writing smithi14213939-18 from 685719 to 1397658 tid 1 2020-06-12T02:35:28.323 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:28.320+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:28.328 INFO:tasks.rados.rados.0.smithi142.stdout:18: writing smithi14213939-18 from 1845135 to 2285719 tid 2 2020-06-12T02:35:28.329 INFO:tasks.rados.rados.0.smithi142.stdout:3: finishing write tid 1 to smithi14213939-3 2020-06-12T02:35:28.329 INFO:tasks.rados.rados.0.smithi142.stdout:3: finishing write tid 2 to smithi14213939-3 2020-06-12T02:35:28.329 INFO:tasks.rados.rados.0.smithi142.stdout:3: finishing write tid 4 to smithi14213939-3 2020-06-12T02:35:28.329 INFO:tasks.rados.rados.0.smithi142.stdout:3: finishing write tid 5 to smithi14213939-3 2020-06-12T02:35:28.330 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 3 v 6 (ObjNum 2 snap 0 seq_num 2) dirty exists 2020-06-12T02:35:28.330 INFO:tasks.rados.rados.0.smithi142.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2020-06-12T02:35:28.331 INFO:tasks.rados.rados.0.smithi142.stdout:4: finishing write tid 1 to smithi14213939-4 2020-06-12T02:35:28.331 INFO:tasks.rados.rados.0.smithi142.stdout:4: finishing write tid 2 to smithi14213939-4 2020-06-12T02:35:28.331 INFO:tasks.rados.rados.0.smithi142.stdout:4: finishing write tid 4 to smithi14213939-4 2020-06-12T02:35:28.332 INFO:tasks.rados.rados.0.smithi142.stdout:4: finishing write tid 5 to smithi14213939-4 2020-06-12T02:35:28.332 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2020-06-12T02:35:28.332 INFO:tasks.rados.rados.0.smithi142.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2020-06-12T02:35:28.332 INFO:tasks.rados.rados.0.smithi142.stdout:5: finishing write tid 1 to smithi14213939-5 2020-06-12T02:35:28.333 INFO:tasks.rados.rados.0.smithi142.stdout:5: finishing write tid 2 to smithi14213939-5 2020-06-12T02:35:28.333 INFO:tasks.rados.rados.0.smithi142.stdout:5: finishing write tid 4 to smithi14213939-5 2020-06-12T02:35:28.333 INFO:tasks.rados.rados.0.smithi142.stdout:6: finishing write tid 1 to smithi14213939-6 2020-06-12T02:35:28.335 INFO:tasks.rados.rados.0.smithi142.stdout:5: finishing write tid 5 to smithi14213939-5 2020-06-12T02:35:28.335 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-06-12T02:35:28.335 INFO:tasks.rados.rados.0.smithi142.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2020-06-12T02:35:28.335 INFO:tasks.rados.rados.0.smithi142.stdout:6: finishing write tid 2 to smithi14213939-6 2020-06-12T02:35:28.335 INFO:tasks.rados.rados.0.smithi142.stdout:6: finishing write tid 4 to smithi14213939-6 2020-06-12T02:35:28.337 INFO:tasks.rados.rados.0.smithi142.stdout:6: finishing write tid 5 to smithi14213939-6 2020-06-12T02:35:28.337 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2020-06-12T02:35:28.338 INFO:tasks.rados.rados.0.smithi142.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2020-06-12T02:35:28.338 INFO:tasks.rados.rados.0.smithi142.stdout:7: finishing write tid 1 to smithi14213939-7 2020-06-12T02:35:28.338 INFO:tasks.rados.rados.0.smithi142.stdout:7: finishing write tid 2 to smithi14213939-7 2020-06-12T02:35:28.338 INFO:tasks.rados.rados.0.smithi142.stdout:7: finishing write tid 4 to smithi14213939-7 2020-06-12T02:35:28.338 INFO:tasks.rados.rados.0.smithi142.stdout:7: finishing write tid 5 to smithi14213939-7 2020-06-12T02:35:28.339 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2020-06-12T02:35:28.339 INFO:tasks.rados.rados.0.smithi142.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2020-06-12T02:35:28.339 INFO:tasks.rados.rados.0.smithi142.stdout:8: finishing write tid 1 to smithi14213939-8 2020-06-12T02:35:28.339 INFO:tasks.rados.rados.0.smithi142.stdout:8: finishing write tid 2 to smithi14213939-8 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:8: finishing write tid 4 to smithi14213939-8 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:8: finishing write tid 5 to smithi14213939-8 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:9: finishing write tid 1 to smithi14213939-9 2020-06-12T02:35:28.340 INFO:tasks.rados.rados.0.smithi142.stdout:9: finishing write tid 2 to smithi14213939-9 2020-06-12T02:35:28.341 INFO:tasks.rados.rados.0.smithi142.stdout:9: finishing write tid 4 to smithi14213939-9 2020-06-12T02:35:28.341 INFO:tasks.rados.rados.0.smithi142.stdout:9: finishing write tid 5 to smithi14213939-9 2020-06-12T02:35:28.341 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2020-06-12T02:35:28.341 INFO:tasks.rados.rados.0.smithi142.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2020-06-12T02:35:28.341 INFO:tasks.rados.rados.0.smithi142.stdout:10: finishing write tid 1 to smithi14213939-10 2020-06-12T02:35:28.342 INFO:tasks.rados.rados.0.smithi142.stdout:11: finishing write tid 1 to smithi14213939-11 2020-06-12T02:35:28.342 INFO:tasks.rados.rados.0.smithi142.stdout:10: finishing write tid 2 to smithi14213939-10 2020-06-12T02:35:28.352 INFO:tasks.rados.rados.0.smithi142.stdout:10: finishing write tid 4 to smithi14213939-10 2020-06-12T02:35:28.352 INFO:tasks.rados.rados.0.smithi142.stdout:11: finishing write tid 2 to smithi14213939-11 2020-06-12T02:35:28.352 INFO:tasks.rados.rados.0.smithi142.stdout:10: finishing write tid 5 to smithi14213939-10 2020-06-12T02:35:28.353 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2020-06-12T02:35:28.353 INFO:tasks.rados.rados.0.smithi142.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2020-06-12T02:35:28.353 INFO:tasks.rados.rados.0.smithi142.stdout:11: finishing write tid 4 to smithi14213939-11 2020-06-12T02:35:28.353 INFO:tasks.rados.rados.0.smithi142.stdout:11: finishing write tid 5 to smithi14213939-11 2020-06-12T02:35:28.353 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 11 v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2020-06-12T02:35:28.354 INFO:tasks.rados.rados.0.smithi142.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2020-06-12T02:35:28.354 INFO:tasks.rados.rados.0.smithi142.stdout:12: finishing write tid 1 to smithi14213939-12 2020-06-12T02:35:28.354 INFO:tasks.rados.rados.0.smithi142.stdout:12: finishing write tid 2 to smithi14213939-12 2020-06-12T02:35:28.354 INFO:tasks.rados.rados.0.smithi142.stdout:12: finishing write tid 4 to smithi14213939-12 2020-06-12T02:35:28.354 INFO:tasks.rados.rados.0.smithi142.stdout:12: finishing write tid 5 to smithi14213939-12 2020-06-12T02:35:28.355 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 12 v 9 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-06-12T02:35:28.355 INFO:tasks.rados.rados.0.smithi142.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2020-06-12T02:35:28.355 INFO:tasks.rados.rados.0.smithi142.stdout:13: finishing write tid 1 to smithi14213939-13 2020-06-12T02:35:28.355 INFO:tasks.rados.rados.0.smithi142.stdout:13: finishing write tid 2 to smithi14213939-13 2020-06-12T02:35:28.355 INFO:tasks.rados.rados.0.smithi142.stdout:13: finishing write tid 4 to smithi14213939-13 2020-06-12T02:35:28.356 INFO:tasks.rados.rados.0.smithi142.stdout:13: finishing write tid 5 to smithi14213939-13 2020-06-12T02:35:28.357 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 3 (ObjNum 12 snap 0 seq_num 12) dirty exists 2020-06-12T02:35:28.357 INFO:tasks.rados.rados.0.smithi142.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2020-06-12T02:35:28.357 INFO:tasks.rados.rados.0.smithi142.stdout:14: finishing write tid 1 to smithi14213939-14 2020-06-12T02:35:28.357 INFO:tasks.rados.rados.0.smithi142.stdout:14: finishing write tid 2 to smithi14213939-14 2020-06-12T02:35:28.358 INFO:tasks.rados.rados.0.smithi142.stdout:14: finishing write tid 4 to smithi14213939-14 2020-06-12T02:35:28.358 INFO:tasks.rados.rados.0.smithi142.stdout:14: finishing write tid 5 to smithi14213939-14 2020-06-12T02:35:28.358 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 14 v 6 (ObjNum 13 snap 0 seq_num 13) dirty exists 2020-06-12T02:35:28.358 INFO:tasks.rados.rados.0.smithi142.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2020-06-12T02:35:28.358 INFO:tasks.rados.rados.0.smithi142.stdout:15: finishing write tid 1 to smithi14213939-15 2020-06-12T02:35:28.359 INFO:tasks.rados.rados.0.smithi142.stdout:15: finishing write tid 2 to smithi14213939-15 2020-06-12T02:35:28.359 INFO:tasks.rados.rados.0.smithi142.stdout:15: finishing write tid 4 to smithi14213939-15 2020-06-12T02:35:28.359 INFO:tasks.rados.rados.0.smithi142.stdout:16: finishing write tid 1 to smithi14213939-16 2020-06-12T02:35:28.359 INFO:tasks.rados.rados.0.smithi142.stdout:15: finishing write tid 5 to smithi14213939-15 2020-06-12T02:35:28.359 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-06-12T02:35:28.360 INFO:tasks.rados.rados.0.smithi142.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2020-06-12T02:35:28.360 INFO:tasks.rados.rados.0.smithi142.stdout:16: finishing write tid 2 to smithi14213939-16 2020-06-12T02:35:28.360 INFO:tasks.rados.rados.0.smithi142.stdout:17: finishing write tid 1 to smithi14213939-17 2020-06-12T02:35:28.360 INFO:tasks.rados.rados.0.smithi142.stdout:16: finishing write tid 4 to smithi14213939-16 2020-06-12T02:35:28.360 INFO:tasks.rados.rados.0.smithi142.stdout:16: finishing write tid 5 to smithi14213939-16 2020-06-12T02:35:28.361 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 16 v 12 (ObjNum 15 snap 0 seq_num 15) dirty exists 2020-06-12T02:35:28.361 INFO:tasks.rados.rados.0.smithi142.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2020-06-12T02:35:28.361 INFO:tasks.rados.rados.0.smithi142.stdout:17: finishing write tid 2 to smithi14213939-17 2020-06-12T02:35:28.361 INFO:tasks.rados.rados.0.smithi142.stdout:17: finishing write tid 4 to smithi14213939-17 2020-06-12T02:35:28.361 INFO:tasks.rados.rados.0.smithi142.stdout:3: done (15 left) 2020-06-12T02:35:28.362 INFO:tasks.rados.rados.0.smithi142.stdout:4: done (14 left) 2020-06-12T02:35:28.362 INFO:tasks.rados.rados.0.smithi142.stdout:5: done (13 left) 2020-06-12T02:35:28.362 INFO:tasks.rados.rados.0.smithi142.stdout:6: done (12 left) 2020-06-12T02:35:28.362 INFO:tasks.rados.rados.0.smithi142.stdout:7: done (11 left) 2020-06-12T02:35:28.362 INFO:tasks.rados.rados.0.smithi142.stdout:8: done (10 left) 2020-06-12T02:35:28.363 INFO:tasks.rados.rados.0.smithi142.stdout:9: done (9 left) 2020-06-12T02:35:28.363 INFO:tasks.rados.rados.0.smithi142.stdout:10: done (8 left) 2020-06-12T02:35:28.363 INFO:tasks.rados.rados.0.smithi142.stdout:11: done (7 left) 2020-06-12T02:35:28.363 INFO:tasks.rados.rados.0.smithi142.stdout:12: done (6 left) 2020-06-12T02:35:28.363 INFO:tasks.rados.rados.0.smithi142.stdout:13: done (5 left) 2020-06-12T02:35:28.364 INFO:tasks.rados.rados.0.smithi142.stdout:14: done (4 left) 2020-06-12T02:35:28.364 INFO:tasks.rados.rados.0.smithi142.stdout:15: done (3 left) 2020-06-12T02:35:28.364 INFO:tasks.rados.rados.0.smithi142.stdout:16: done (2 left) 2020-06-12T02:35:28.364 INFO:tasks.rados.rados.0.smithi142.stdout:19: write initial oid 19 2020-06-12T02:35:28.364 INFO:tasks.rados.rados.0.smithi142.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2020-06-12T02:35:28.366 INFO:tasks.rados.rados.0.smithi142.stdout:19: writing smithi14213939-19 from 702526 to 1489714 tid 1 2020-06-12T02:35:28.366 INFO:tasks.rados.rados.0.smithi142.stdout:19: writing smithi14213939-19 from 1903617 to 2302526 tid 2 2020-06-12T02:35:28.366 INFO:tasks.rados.rados.0.smithi142.stdout:20: write initial oid 20 2020-06-12T02:35:28.366 INFO:tasks.rados.rados.0.smithi142.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2020-06-12T02:35:28.367 INFO:tasks.rados.rados.0.smithi142.stdout:20: writing smithi14213939-20 from 719333 to 1181770 tid 1 2020-06-12T02:35:28.367 INFO:tasks.rados.rados.0.smithi142.stdout:20: writing smithi14213939-20 from 1962099 to 2319333 tid 2 2020-06-12T02:35:28.367 INFO:tasks.rados.rados.0.smithi142.stdout:21: write initial oid 21 2020-06-12T02:35:28.367 INFO:tasks.rados.rados.0.smithi142.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2020-06-12T02:35:28.367 INFO:tasks.rados.rados.0.smithi142.stdout:21: writing smithi14213939-21 from 736140 to 1273826 tid 1 2020-06-12T02:35:28.369 INFO:tasks.rados.rados.0.smithi142.stdout:21: writing smithi14213939-21 from 2020581 to 2336140 tid 2 2020-06-12T02:35:28.369 INFO:tasks.rados.rados.0.smithi142.stdout:22: write initial oid 22 2020-06-12T02:35:28.369 INFO:tasks.rados.rados.0.smithi142.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2020-06-12T02:35:28.377 INFO:tasks.rados.rados.0.smithi142.stdout:22: writing smithi14213939-22 from 752947 to 1365882 tid 1 2020-06-12T02:35:28.383 INFO:tasks.rados.rados.0.smithi142.stdout:22: writing smithi14213939-22 from 1962710 to 2352947 tid 2 2020-06-12T02:35:28.383 INFO:tasks.rados.rados.0.smithi142.stdout:23: write initial oid 23 2020-06-12T02:35:28.384 INFO:tasks.rados.rados.0.smithi142.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2020-06-12T02:35:28.391 INFO:tasks.rados.rados.0.smithi142.stdout:23: writing smithi14213939-23 from 769754 to 1457938 tid 1 2020-06-12T02:35:28.397 INFO:tasks.rados.rados.0.smithi142.stdout:23: writing smithi14213939-23 from 2021192 to 2369754 tid 2 2020-06-12T02:35:28.397 INFO:tasks.rados.rados.0.smithi142.stdout:24: write initial oid 24 2020-06-12T02:35:28.397 INFO:tasks.rados.rados.0.smithi142.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2020-06-12T02:35:28.404 INFO:tasks.rados.rados.0.smithi142.stdout:24: writing smithi14213939-24 from 786561 to 1266347 tid 1 2020-06-12T02:35:28.411 INFO:tasks.rados.rados.0.smithi142.stdout:24: writing smithi14213939-24 from 1796027 to 2263691 tid 2 2020-06-12T02:35:28.411 INFO:tasks.rados.rados.0.smithi142.stdout:25: write initial oid 25 2020-06-12T02:35:28.411 INFO:tasks.rados.rados.0.smithi142.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2020-06-12T02:35:28.417 INFO:tasks.rados.rados.0.smithi142.stdout:25: writing smithi14213939-25 from 403368 to 958403 tid 1 2020-06-12T02:35:28.417 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:28.412+0000 7fd329fc6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:28.421 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:28.420+0000 7fd329fc6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:28.423 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:28.420+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:28.424 INFO:tasks.rados.rados.0.smithi142.stdout:25: writing smithi14213939-25 from 1454509 to 2182184 tid 2 2020-06-12T02:35:28.425 INFO:tasks.rados.rados.0.smithi142.stdout:26: write initial oid 26 2020-06-12T02:35:28.425 INFO:tasks.rados.rados.0.smithi142.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2020-06-12T02:35:28.431 INFO:tasks.rados.rados.0.smithi142.stdout:26: writing smithi14213939-26 from 420175 to 1050459 tid 1 2020-06-12T02:35:28.438 INFO:tasks.rados.rados.0.smithi142.stdout:26: writing smithi14213939-26 from 1796638 to 2267971 tid 2 2020-06-12T02:35:28.438 INFO:tasks.rados.rados.0.smithi142.stdout:27: write initial oid 27 2020-06-12T02:35:28.438 INFO:tasks.rados.rados.0.smithi142.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2020-06-12T02:35:28.445 INFO:tasks.rados.rados.0.smithi142.stdout:27: writing smithi14213939-27 from 436982 to 1142515 tid 1 2020-06-12T02:35:28.453 INFO:tasks.rados.rados.0.smithi142.stdout:27: writing smithi14213939-27 from 1855120 to 2436982 tid 2 2020-06-12T02:35:28.453 INFO:tasks.rados.rados.0.smithi142.stdout:28: write initial oid 28 2020-06-12T02:35:28.454 INFO:tasks.rados.rados.0.smithi142.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2020-06-12T02:35:28.460 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:28.460 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:28.461 INFO:tasks.rados.rados.0.smithi142.stdout:28: writing smithi14213939-28 from 453789 to 1234571 tid 1 2020-06-12T02:35:28.465 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:28.467 INFO:tasks.rados.rados.0.smithi142.stdout:28: writing smithi14213939-28 from 1913602 to 2388604 tid 2 2020-06-12T02:35:28.467 INFO:tasks.rados.rados.0.smithi142.stdout:29: write initial oid 29 2020-06-12T02:35:28.468 INFO:tasks.rados.rados.0.smithi142.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2020-06-12T02:35:28.471 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:28.472 INFO:tasks.rados.rados.0.smithi142.stdout:29: writing smithi14213939-29 from 470596 to 926627 tid 1 2020-06-12T02:35:28.481 INFO:tasks.rados.rados.0.smithi142.stdout:29: writing smithi14213939-29 from 1572084 to 2190744 tid 2 2020-06-12T02:35:28.482 INFO:tasks.rados.rados.0.smithi142.stdout:17: finishing write tid 5 to smithi14213939-17 2020-06-12T02:35:28.482 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 17 v 3 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-06-12T02:35:28.482 INFO:tasks.rados.rados.0.smithi142.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2020-06-12T02:35:28.482 INFO:tasks.rados.rados.0.smithi142.stdout:18: finishing write tid 1 to smithi14213939-18 2020-06-12T02:35:28.483 INFO:tasks.rados.rados.0.smithi142.stdout:18: finishing write tid 2 to smithi14213939-18 2020-06-12T02:35:28.483 INFO:tasks.rados.rados.0.smithi142.stdout:18: finishing write tid 4 to smithi14213939-18 2020-06-12T02:35:28.483 INFO:tasks.rados.rados.0.smithi142.stdout:18: finishing write tid 5 to smithi14213939-18 2020-06-12T02:35:28.483 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 18 v 6 (ObjNum 17 snap 0 seq_num 17) dirty exists 2020-06-12T02:35:28.483 INFO:tasks.rados.rados.0.smithi142.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2020-06-12T02:35:28.484 INFO:tasks.rados.rados.0.smithi142.stdout:19: finishing write tid 1 to smithi14213939-19 2020-06-12T02:35:28.484 INFO:tasks.rados.rados.0.smithi142.stdout:19: finishing write tid 2 to smithi14213939-19 2020-06-12T02:35:28.484 INFO:tasks.rados.rados.0.smithi142.stdout:19: finishing write tid 4 to smithi14213939-19 2020-06-12T02:35:28.484 INFO:tasks.rados.rados.0.smithi142.stdout:20: finishing write tid 1 to smithi14213939-20 2020-06-12T02:35:28.484 INFO:tasks.rados.rados.0.smithi142.stdout:19: finishing write tid 5 to smithi14213939-19 2020-06-12T02:35:28.485 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 9 (ObjNum 18 snap 0 seq_num 18) dirty exists 2020-06-12T02:35:28.485 INFO:tasks.rados.rados.0.smithi142.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2020-06-12T02:35:28.485 INFO:tasks.rados.rados.0.smithi142.stdout:20: finishing write tid 2 to smithi14213939-20 2020-06-12T02:35:28.485 INFO:tasks.rados.rados.0.smithi142.stdout:20: finishing write tid 4 to smithi14213939-20 2020-06-12T02:35:28.485 INFO:tasks.rados.rados.0.smithi142.stdout:21: finishing write tid 1 to smithi14213939-21 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:20: finishing write tid 5 to smithi14213939-20 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 20 v 6 (ObjNum 19 snap 0 seq_num 19) dirty exists 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:21: finishing write tid 2 to smithi14213939-21 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:21: finishing write tid 4 to smithi14213939-21 2020-06-12T02:35:28.486 INFO:tasks.rados.rados.0.smithi142.stdout:21: finishing write tid 5 to smithi14213939-21 2020-06-12T02:35:28.487 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 21 v 12 (ObjNum 20 snap 0 seq_num 20) dirty exists 2020-06-12T02:35:28.487 INFO:tasks.rados.rados.0.smithi142.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:35:28.487 INFO:tasks.rados.rados.0.smithi142.stdout:22: finishing write tid 1 to smithi14213939-22 2020-06-12T02:35:28.487 INFO:tasks.rados.rados.0.smithi142.stdout:22: finishing write tid 2 to smithi14213939-22 2020-06-12T02:35:28.487 INFO:tasks.rados.rados.0.smithi142.stdout:22: finishing write tid 4 to smithi14213939-22 2020-06-12T02:35:28.488 INFO:tasks.rados.rados.0.smithi142.stdout:22: finishing write tid 5 to smithi14213939-22 2020-06-12T02:35:28.488 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 22 v 3 (ObjNum 21 snap 0 seq_num 21) dirty exists 2020-06-12T02:35:28.488 INFO:tasks.rados.rados.0.smithi142.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2020-06-12T02:35:28.488 INFO:tasks.rados.rados.0.smithi142.stdout:23: finishing write tid 1 to smithi14213939-23 2020-06-12T02:35:28.488 INFO:tasks.rados.rados.0.smithi142.stdout:23: finishing write tid 2 to smithi14213939-23 2020-06-12T02:35:28.489 INFO:tasks.rados.rados.0.smithi142.stdout:23: finishing write tid 4 to smithi14213939-23 2020-06-12T02:35:28.489 INFO:tasks.rados.rados.0.smithi142.stdout:23: finishing write tid 5 to smithi14213939-23 2020-06-12T02:35:28.489 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2020-06-12T02:35:28.490 INFO:tasks.rados.rados.0.smithi142.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2020-06-12T02:35:28.490 INFO:tasks.rados.rados.0.smithi142.stdout:24: finishing write tid 1 to smithi14213939-24 2020-06-12T02:35:28.490 INFO:tasks.rados.rados.0.smithi142.stdout:24: finishing write tid 2 to smithi14213939-24 2020-06-12T02:35:28.490 INFO:tasks.rados.rados.0.smithi142.stdout:24: finishing write tid 4 to smithi14213939-24 2020-06-12T02:35:28.491 INFO:tasks.rados.rados.0.smithi142.stdout:25: finishing write tid 1 to smithi14213939-25 2020-06-12T02:35:28.491 INFO:tasks.rados.rados.0.smithi142.stdout:24: finishing write tid 5 to smithi14213939-24 2020-06-12T02:35:28.491 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 24 v 9 (ObjNum 23 snap 0 seq_num 23) dirty exists 2020-06-12T02:35:28.491 INFO:tasks.rados.rados.0.smithi142.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2020-06-12T02:35:28.491 INFO:tasks.rados.rados.0.smithi142.stdout:25: finishing write tid 2 to smithi14213939-25 2020-06-12T02:35:28.492 INFO:tasks.rados.rados.0.smithi142.stdout:25: finishing write tid 4 to smithi14213939-25 2020-06-12T02:35:28.493 INFO:tasks.rados.rados.0.smithi142.stdout:26: finishing write tid 1 to smithi14213939-26 2020-06-12T02:35:28.493 INFO:tasks.rados.rados.0.smithi142.stdout:25: finishing write tid 5 to smithi14213939-25 2020-06-12T02:35:28.493 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 25 v 15 (ObjNum 24 snap 0 seq_num 24) dirty exists 2020-06-12T02:35:28.493 INFO:tasks.rados.rados.0.smithi142.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2020-06-12T02:35:28.493 INFO:tasks.rados.rados.0.smithi142.stdout:26: finishing write tid 2 to smithi14213939-26 2020-06-12T02:35:28.494 INFO:tasks.rados.rados.0.smithi142.stdout:26: finishing write tid 4 to smithi14213939-26 2020-06-12T02:35:28.494 INFO:tasks.rados.rados.0.smithi142.stdout:26: finishing write tid 5 to smithi14213939-26 2020-06-12T02:35:28.494 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 26 v 3 (ObjNum 25 snap 0 seq_num 25) dirty exists 2020-06-12T02:35:28.494 INFO:tasks.rados.rados.0.smithi142.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2020-06-12T02:35:28.494 INFO:tasks.rados.rados.0.smithi142.stdout:27: finishing write tid 1 to smithi14213939-27 2020-06-12T02:35:28.495 INFO:tasks.rados.rados.0.smithi142.stdout:27: finishing write tid 2 to smithi14213939-27 2020-06-12T02:35:28.495 INFO:tasks.rados.rados.0.smithi142.stdout:27: finishing write tid 4 to smithi14213939-27 2020-06-12T02:35:28.495 INFO:tasks.rados.rados.0.smithi142.stdout:27: finishing write tid 5 to smithi14213939-27 2020-06-12T02:35:28.495 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 27 v 9 (ObjNum 26 snap 0 seq_num 26) dirty exists 2020-06-12T02:35:28.495 INFO:tasks.rados.rados.0.smithi142.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2020-06-12T02:35:28.496 INFO:tasks.rados.rados.0.smithi142.stdout:28: finishing write tid 1 to smithi14213939-28 2020-06-12T02:35:28.496 INFO:tasks.rados.rados.0.smithi142.stdout:17: done (12 left) 2020-06-12T02:35:28.496 INFO:tasks.rados.rados.0.smithi142.stdout:18: done (11 left) 2020-06-12T02:35:28.496 INFO:tasks.rados.rados.0.smithi142.stdout:19: done (10 left) 2020-06-12T02:35:28.496 INFO:tasks.rados.rados.0.smithi142.stdout:20: done (9 left) 2020-06-12T02:35:28.497 INFO:tasks.rados.rados.0.smithi142.stdout:21: done (8 left) 2020-06-12T02:35:28.497 INFO:tasks.rados.rados.0.smithi142.stdout:22: done (7 left) 2020-06-12T02:35:28.497 INFO:tasks.rados.rados.0.smithi142.stdout:23: done (6 left) 2020-06-12T02:35:28.497 INFO:tasks.rados.rados.0.smithi142.stdout:24: done (5 left) 2020-06-12T02:35:28.497 INFO:tasks.rados.rados.0.smithi142.stdout:25: done (4 left) 2020-06-12T02:35:28.498 INFO:tasks.rados.rados.0.smithi142.stdout:26: done (3 left) 2020-06-12T02:35:28.498 INFO:tasks.rados.rados.0.smithi142.stdout:27: done (2 left) 2020-06-12T02:35:28.498 INFO:tasks.rados.rados.0.smithi142.stdout:30: write initial oid 30 2020-06-12T02:35:28.498 INFO:tasks.rados.rados.0.smithi142.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2020-06-12T02:35:28.499 INFO:tasks.rados.rados.0.smithi142.stdout:30: writing smithi14213939-30 from 487403 to 1018683 tid 1 2020-06-12T02:35:28.499 INFO:tasks.rados.rados.0.smithi142.stdout:30: writing smithi14213939-30 from 1514213 to 1992884 tid 2 2020-06-12T02:35:28.500 INFO:tasks.rados.rados.0.smithi142.stdout:31: write initial oid 31 2020-06-12T02:35:28.500 INFO:tasks.rados.rados.0.smithi142.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2020-06-12T02:35:28.500 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:28.501 INFO:tasks.rados.rados.0.smithi142.stdout:31: writing smithi14213939-31 from 504210 to 1110739 tid 1 2020-06-12T02:35:28.507 INFO:tasks.rados.rados.0.smithi142.stdout:31: writing smithi14213939-31 from 1572695 to 2195024 tid 2 2020-06-12T02:35:28.508 INFO:tasks.rados.rados.0.smithi142.stdout:32: write initial oid 32 2020-06-12T02:35:28.508 INFO:tasks.rados.rados.0.smithi142.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2020-06-12T02:35:28.517 INFO:tasks.rados.rados.0.smithi142.stdout:32: writing smithi14213939-32 from 521017 to 1319148 tid 1 2020-06-12T02:35:28.522 INFO:tasks.rados.rados.0.smithi142.stdout:32: writing smithi14213939-32 from 1747530 to 2229870 tid 2 2020-06-12T02:35:28.522 INFO:tasks.rados.rados.0.smithi142.stdout:33: write initial oid 33 2020-06-12T02:35:28.523 INFO:tasks.rados.rados.0.smithi142.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2020-06-12T02:35:28.530 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:28.531 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:28.520+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:28.531 INFO:tasks.rados.rados.0.smithi142.stdout:33: writing smithi14213939-33 from 537824 to 1011204 tid 1 2020-06-12T02:35:28.536 INFO:tasks.rados.rados.0.smithi142.stdout:33: writing smithi14213939-33 from 1806012 to 2432010 tid 2 2020-06-12T02:35:28.536 INFO:tasks.rados.rados.0.smithi142.stdout:34: write initial oid 34 2020-06-12T02:35:28.536 INFO:tasks.rados.rados.0.smithi142.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2020-06-12T02:35:28.543 INFO:tasks.rados.rados.0.smithi142.stdout:34: writing smithi14213939-34 from 554631 to 1103260 tid 1 2020-06-12T02:35:28.549 INFO:tasks.rados.rados.0.smithi142.stdout:34: writing smithi14213939-34 from 1748141 to 2234150 tid 2 2020-06-12T02:35:28.550 INFO:tasks.rados.rados.0.smithi142.stdout:35: write initial oid 35 2020-06-12T02:35:28.550 INFO:tasks.rados.rados.0.smithi142.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2020-06-12T02:35:28.557 INFO:tasks.rados.rados.0.smithi142.stdout:35: writing smithi14213939-35 from 571438 to 1195316 tid 1 2020-06-12T02:35:28.564 INFO:tasks.rados.rados.0.smithi142.stdout:35: writing smithi14213939-35 from 1806623 to 2436290 tid 2 2020-06-12T02:35:28.564 INFO:tasks.rados.rados.0.smithi142.stdout:36: write initial oid 36 2020-06-12T02:35:28.565 INFO:tasks.rados.rados.0.smithi142.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2020-06-12T02:35:28.572 INFO:tasks.rados.rados.0.smithi142.stdout:36: writing smithi14213939-36 from 588245 to 1287372 tid 1 2020-06-12T02:35:28.578 INFO:tasks.rados.rados.0.smithi142.stdout:36: writing smithi14213939-36 from 1865105 to 2354783 tid 2 2020-06-12T02:35:28.578 INFO:tasks.rados.rados.0.smithi142.stdout:37: write initial oid 37 2020-06-12T02:35:28.579 INFO:tasks.rados.rados.0.smithi142.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2020-06-12T02:35:28.587 INFO:tasks.rados.rados.0.smithi142.stdout:37: writing smithi14213939-37 from 605052 to 1379428 tid 1 2020-06-12T02:35:28.587 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:28.587 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:28.588 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:28.588 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:28.588 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:28.594 INFO:tasks.rados.rados.0.smithi142.stdout:37: writing smithi14213939-37 from 1923587 to 2556923 tid 2 2020-06-12T02:35:28.594 INFO:tasks.rados.rados.0.smithi142.stdout:38: write initial oid 38 2020-06-12T02:35:28.594 INFO:tasks.rados.rados.0.smithi142.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2020-06-12T02:35:28.599 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:28.600 INFO:tasks.rados.rados.0.smithi142.stdout:38: writing smithi14213939-38 from 621859 to 1071484 tid 1 2020-06-12T02:35:28.609 INFO:tasks.rados.rados.0.smithi142.stdout:38: writing smithi14213939-38 from 1865716 to 2621859 tid 2 2020-06-12T02:35:28.610 INFO:tasks.rados.rados.0.smithi142.stdout:39: write initial oid 39 2020-06-12T02:35:28.610 INFO:tasks.rados.rados.0.smithi142.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2020-06-12T02:35:28.616 INFO:tasks.rados.rados.0.smithi142.stdout:39: writing smithi14213939-39 from 638666 to 1163540 tid 1 2020-06-12T02:35:28.624 INFO:tasks.rados.rados.0.smithi142.stdout:39: writing smithi14213939-39 from 1924198 to 2561203 tid 2 2020-06-12T02:35:28.625 INFO:tasks.rados.rados.0.smithi142.stdout:40: write initial oid 40 2020-06-12T02:35:28.625 INFO:tasks.rados.rados.0.smithi142.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2020-06-12T02:35:28.625 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:28.624+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:28.632 INFO:tasks.rados.rados.0.smithi142.stdout:40: writing smithi14213939-40 from 655473 to 1371949 tid 1 2020-06-12T02:35:28.640 INFO:tasks.rados.rados.0.smithi142.stdout:40: writing smithi14213939-40 from 2099033 to 2655473 tid 2 2020-06-12T02:35:28.640 INFO:tasks.rados.rados.0.smithi142.stdout:41: write initial oid 41 2020-06-12T02:35:28.640 INFO:tasks.rados.rados.0.smithi142.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2020-06-12T02:35:28.648 INFO:tasks.rados.rados.0.smithi142.stdout:41: writing smithi14213939-41 from 672280 to 1464005 tid 1 2020-06-12T02:35:28.656 INFO:tasks.rados.rados.0.smithi142.stdout:41: writing smithi14213939-41 from 2157515 to 2672280 tid 2 2020-06-12T02:35:28.656 INFO:tasks.rados.rados.0.smithi142.stdout:42: write initial oid 42 2020-06-12T02:35:28.656 INFO:tasks.rados.rados.0.smithi142.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2020-06-12T02:35:28.662 INFO:tasks.rados.rados.0.smithi142.stdout:42: writing smithi14213939-42 from 689087 to 1156061 tid 1 2020-06-12T02:35:28.670 INFO:tasks.rados.rados.0.smithi142.stdout:42: writing smithi14213939-42 from 1699644 to 2483976 tid 2 2020-06-12T02:35:28.671 INFO:tasks.rados.rados.0.smithi142.stdout:43: write initial oid 43 2020-06-12T02:35:28.671 INFO:tasks.rados.rados.0.smithi142.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2020-06-12T02:35:28.678 INFO:tasks.rados.rados.0.smithi142.stdout:43: writing smithi14213939-43 from 705894 to 1248117 tid 1 2020-06-12T02:35:28.686 INFO:tasks.rados.rados.0.smithi142.stdout:43: writing smithi14213939-43 from 1758126 to 2402469 tid 2 2020-06-12T02:35:28.686 INFO:tasks.rados.rados.0.smithi142.stdout: waiting on 16 2020-06-12T02:35:28.686 INFO:tasks.rados.rados.0.smithi142.stdout:29: finishing write tid 1 to smithi14213939-29 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:28: finishing write tid 2 to smithi14213939-28 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:28: finishing write tid 4 to smithi14213939-28 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:29: finishing write tid 2 to smithi14213939-29 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:28: finishing write tid 5 to smithi14213939-28 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 28 v 3 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:35:28.687 INFO:tasks.rados.rados.0.smithi142.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2020-06-12T02:35:28.688 INFO:tasks.rados.rados.0.smithi142.stdout:29: finishing write tid 4 to smithi14213939-29 2020-06-12T02:35:28.688 INFO:tasks.rados.rados.0.smithi142.stdout:28: done (15 left) 2020-06-12T02:35:28.688 INFO:tasks.rados.rados.0.smithi142.stdout:44: write initial oid 44 2020-06-12T02:35:28.688 INFO:tasks.rados.rados.0.smithi142.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2020-06-12T02:35:28.692 INFO:tasks.rados.rados.0.smithi142.stdout:44: writing smithi14213939-44 from 722701 to 1340173 tid 1 2020-06-12T02:35:28.701 INFO:tasks.rados.rados.0.smithi142.stdout:44: writing smithi14213939-44 from 1816608 to 2604609 tid 2 2020-06-12T02:35:28.701 INFO:tasks.rados.rados.0.smithi142.stdout: waiting on 16 2020-06-12T02:35:28.701 INFO:tasks.rados.rados.0.smithi142.stdout:29: finishing write tid 5 to smithi14213939-29 2020-06-12T02:35:28.702 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 29 v 12 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-06-12T02:35:28.702 INFO:tasks.rados.rados.0.smithi142.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:35:28.702 INFO:tasks.rados.rados.0.smithi142.stdout:30: finishing write tid 1 to smithi14213939-30 2020-06-12T02:35:28.703 INFO:tasks.rados.rados.0.smithi142.stdout:30: finishing write tid 2 to smithi14213939-30 2020-06-12T02:35:28.704 INFO:tasks.rados.rados.0.smithi142.stdout:30: finishing write tid 4 to smithi14213939-30 2020-06-12T02:35:28.704 INFO:tasks.rados.rados.0.smithi142.stdout:30: finishing write tid 5 to smithi14213939-30 2020-06-12T02:35:28.705 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-06-12T02:35:28.705 INFO:tasks.rados.rados.0.smithi142.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2020-06-12T02:35:28.705 INFO:tasks.rados.rados.0.smithi142.stdout:31: finishing write tid 1 to smithi14213939-31 2020-06-12T02:35:28.706 INFO:tasks.rados.rados.0.smithi142.stdout:31: finishing write tid 2 to smithi14213939-31 2020-06-12T02:35:28.706 INFO:tasks.rados.rados.0.smithi142.stdout:31: finishing write tid 4 to smithi14213939-31 2020-06-12T02:35:28.706 INFO:tasks.rados.rados.0.smithi142.stdout:31: finishing write tid 5 to smithi14213939-31 2020-06-12T02:35:28.707 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 12 (ObjNum 30 snap 0 seq_num 30) dirty exists 2020-06-12T02:35:28.707 INFO:tasks.rados.rados.0.smithi142.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2020-06-12T02:35:28.707 INFO:tasks.rados.rados.0.smithi142.stdout:32: finishing write tid 1 to smithi14213939-32 2020-06-12T02:35:28.707 INFO:tasks.rados.rados.0.smithi142.stdout:32: finishing write tid 2 to smithi14213939-32 2020-06-12T02:35:28.708 INFO:tasks.rados.rados.0.smithi142.stdout:32: finishing write tid 4 to smithi14213939-32 2020-06-12T02:35:28.708 INFO:tasks.rados.rados.0.smithi142.stdout:33: finishing write tid 1 to smithi14213939-33 2020-06-12T02:35:28.708 INFO:tasks.rados.rados.0.smithi142.stdout:32: finishing write tid 5 to smithi14213939-32 2020-06-12T02:35:28.709 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 32 v 9 (ObjNum 31 snap 0 seq_num 31) dirty exists 2020-06-12T02:35:28.709 INFO:tasks.rados.rados.0.smithi142.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2020-06-12T02:35:28.710 INFO:tasks.rados.rados.0.smithi142.stdout:33: finishing write tid 2 to smithi14213939-33 2020-06-12T02:35:28.710 INFO:tasks.rados.rados.0.smithi142.stdout:33: finishing write tid 4 to smithi14213939-33 2020-06-12T02:35:28.710 INFO:tasks.rados.rados.0.smithi142.stdout:33: finishing write tid 5 to smithi14213939-33 2020-06-12T02:35:28.711 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 33 v 15 (ObjNum 32 snap 0 seq_num 32) dirty exists 2020-06-12T02:35:28.711 INFO:tasks.rados.rados.0.smithi142.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2020-06-12T02:35:28.712 INFO:tasks.rados.rados.0.smithi142.stdout:34: finishing write tid 1 to smithi14213939-34 2020-06-12T02:35:28.712 INFO:tasks.rados.rados.0.smithi142.stdout:34: finishing write tid 2 to smithi14213939-34 2020-06-12T02:35:28.713 INFO:tasks.rados.rados.0.smithi142.stdout:34: finishing write tid 4 to smithi14213939-34 2020-06-12T02:35:28.713 INFO:tasks.rados.rados.0.smithi142.stdout:34: finishing write tid 5 to smithi14213939-34 2020-06-12T02:35:28.713 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 34 v 9 (ObjNum 33 snap 0 seq_num 33) dirty exists 2020-06-12T02:35:28.714 INFO:tasks.rados.rados.0.smithi142.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2020-06-12T02:35:28.714 INFO:tasks.rados.rados.0.smithi142.stdout:35: finishing write tid 1 to smithi14213939-35 2020-06-12T02:35:28.714 INFO:tasks.rados.rados.0.smithi142.stdout:35: finishing write tid 2 to smithi14213939-35 2020-06-12T02:35:28.715 INFO:tasks.rados.rados.0.smithi142.stdout:35: finishing write tid 4 to smithi14213939-35 2020-06-12T02:35:28.715 INFO:tasks.rados.rados.0.smithi142.stdout:36: finishing write tid 1 to smithi14213939-36 2020-06-12T02:35:28.715 INFO:tasks.rados.rados.0.smithi142.stdout:35: finishing write tid 5 to smithi14213939-35 2020-06-12T02:35:28.716 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 9 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-06-12T02:35:28.717 INFO:tasks.rados.rados.0.smithi142.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2020-06-12T02:35:28.717 INFO:tasks.rados.rados.0.smithi142.stdout:36: finishing write tid 2 to smithi14213939-36 2020-06-12T02:35:28.718 INFO:tasks.rados.rados.0.smithi142.stdout:36: finishing write tid 4 to smithi14213939-36 2020-06-12T02:35:28.718 INFO:tasks.rados.rados.0.smithi142.stdout:37: finishing write tid 1 to smithi14213939-37 2020-06-12T02:35:28.718 INFO:tasks.rados.rados.0.smithi142.stdout:36: finishing write tid 5 to smithi14213939-36 2020-06-12T02:35:28.719 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 12 (ObjNum 35 snap 0 seq_num 35) dirty exists 2020-06-12T02:35:28.719 INFO:tasks.rados.rados.0.smithi142.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2020-06-12T02:35:28.719 INFO:tasks.rados.rados.0.smithi142.stdout:37: finishing write tid 2 to smithi14213939-37 2020-06-12T02:35:28.720 INFO:tasks.rados.rados.0.smithi142.stdout:37: finishing write tid 4 to smithi14213939-37 2020-06-12T02:35:28.720 INFO:tasks.rados.rados.0.smithi142.stdout:37: finishing write tid 5 to smithi14213939-37 2020-06-12T02:35:28.720 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 37 v 15 (ObjNum 36 snap 0 seq_num 36) dirty exists 2020-06-12T02:35:28.721 INFO:tasks.rados.rados.0.smithi142.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2020-06-12T02:35:28.721 INFO:tasks.rados.rados.0.smithi142.stdout:38: finishing write tid 1 to smithi14213939-38 2020-06-12T02:35:28.721 INFO:tasks.rados.rados.0.smithi142.stdout:38: finishing write tid 2 to smithi14213939-38 2020-06-12T02:35:28.722 INFO:tasks.rados.rados.0.smithi142.stdout:38: finishing write tid 4 to smithi14213939-38 2020-06-12T02:35:28.722 INFO:tasks.rados.rados.0.smithi142.stdout:38: finishing write tid 5 to smithi14213939-38 2020-06-12T02:35:28.723 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 38 v 18 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-06-12T02:35:28.723 INFO:tasks.rados.rados.0.smithi142.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2020-06-12T02:35:28.723 INFO:tasks.rados.rados.0.smithi142.stdout:39: finishing write tid 1 to smithi14213939-39 2020-06-12T02:35:28.724 INFO:tasks.rados.rados.0.smithi142.stdout:39: finishing write tid 2 to smithi14213939-39 2020-06-12T02:35:28.724 INFO:tasks.rados.rados.0.smithi142.stdout:39: finishing write tid 4 to smithi14213939-39 2020-06-12T02:35:28.724 INFO:tasks.rados.rados.0.smithi142.stdout:39: finishing write tid 5 to smithi14213939-39 2020-06-12T02:35:28.725 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 39 v 15 (ObjNum 38 snap 0 seq_num 38) dirty exists 2020-06-12T02:35:28.725 INFO:tasks.rados.rados.0.smithi142.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2020-06-12T02:35:28.725 INFO:tasks.rados.rados.0.smithi142.stdout:40: finishing write tid 1 to smithi14213939-40 2020-06-12T02:35:28.726 INFO:tasks.rados.rados.0.smithi142.stdout:40: finishing write tid 2 to smithi14213939-40 2020-06-12T02:35:28.726 INFO:tasks.rados.rados.0.smithi142.stdout:40: finishing write tid 4 to smithi14213939-40 2020-06-12T02:35:28.726 INFO:tasks.rados.rados.0.smithi142.stdout:40: finishing write tid 5 to smithi14213939-40 2020-06-12T02:35:28.727 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 40 v 3 (ObjNum 39 snap 0 seq_num 39) dirty exists 2020-06-12T02:35:28.727 INFO:tasks.rados.rados.0.smithi142.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2020-06-12T02:35:28.727 INFO:tasks.rados.rados.0.smithi142.stdout:41: finishing write tid 1 to smithi14213939-41 2020-06-12T02:35:28.727 INFO:tasks.rados.rados.0.smithi142.stdout:41: finishing write tid 2 to smithi14213939-41 2020-06-12T02:35:28.727 INFO:tasks.rados.rados.0.smithi142.stdout:41: finishing write tid 4 to smithi14213939-41 2020-06-12T02:35:28.728 INFO:tasks.rados.rados.0.smithi142.stdout:41: finishing write tid 5 to smithi14213939-41 2020-06-12T02:35:28.728 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2020-06-12T02:35:28.728 INFO:tasks.rados.rados.0.smithi142.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2020-06-12T02:35:28.728 INFO:tasks.rados.rados.0.smithi142.stdout:42: finishing write tid 1 to smithi14213939-42 2020-06-12T02:35:28.728 INFO:tasks.rados.rados.0.smithi142.stdout:42: finishing write tid 2 to smithi14213939-42 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:42: finishing write tid 4 to smithi14213939-42 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:42: finishing write tid 5 to smithi14213939-42 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 42 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:43: finishing write tid 1 to smithi14213939-43 2020-06-12T02:35:28.729 INFO:tasks.rados.rados.0.smithi142.stdout:43: finishing write tid 2 to smithi14213939-43 2020-06-12T02:35:28.730 INFO:tasks.rados.rados.0.smithi142.stdout:43: finishing write tid 4 to smithi14213939-43 2020-06-12T02:35:28.730 INFO:tasks.rados.rados.0.smithi142.stdout:43: finishing write tid 5 to smithi14213939-43 2020-06-12T02:35:28.730 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-06-12T02:35:28.730 INFO:tasks.rados.rados.0.smithi142.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2020-06-12T02:35:28.730 INFO:tasks.rados.rados.0.smithi142.stdout:29: done (15 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:30: done (14 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:31: done (13 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:32: done (12 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:33: done (11 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:34: done (10 left) 2020-06-12T02:35:28.731 INFO:tasks.rados.rados.0.smithi142.stdout:35: done (9 left) 2020-06-12T02:35:28.732 INFO:tasks.rados.rados.0.smithi142.stdout:36: done (8 left) 2020-06-12T02:35:28.732 INFO:tasks.rados.rados.0.smithi142.stdout:37: done (7 left) 2020-06-12T02:35:28.732 INFO:tasks.rados.rados.0.smithi142.stdout:38: done (6 left) 2020-06-12T02:35:28.732 INFO:tasks.rados.rados.0.smithi142.stdout:39: done (5 left) 2020-06-12T02:35:28.732 INFO:tasks.rados.rados.0.smithi142.stdout:40: done (4 left) 2020-06-12T02:35:28.733 INFO:tasks.rados.rados.0.smithi142.stdout:41: done (3 left) 2020-06-12T02:35:28.733 INFO:tasks.rados.rados.0.smithi142.stdout:42: done (2 left) 2020-06-12T02:35:28.733 INFO:tasks.rados.rados.0.smithi142.stdout:43: done (1 left) 2020-06-12T02:35:28.734 INFO:tasks.rados.rados.0.smithi142.stdout:45: write initial oid 45 2020-06-12T02:35:28.734 INFO:tasks.rados.rados.0.smithi142.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2020-06-12T02:35:28.737 INFO:tasks.rados.rados.0.smithi142.stdout:45: writing smithi14213939-45 from 739508 to 1432229 tid 1 2020-06-12T02:35:28.738 INFO:tasks.rados.rados.0.smithi142.stdout:45: writing smithi14213939-45 from 1875090 to 2523102 tid 2 2020-06-12T02:35:28.738 INFO:tasks.rados.rados.0.smithi142.stdout:46: write initial oid 46 2020-06-12T02:35:28.738 INFO:tasks.rados.rados.0.smithi142.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2020-06-12T02:35:28.739 INFO:tasks.rados.rados.0.smithi142.stdout:46: writing smithi14213939-46 from 756315 to 1524285 tid 1 2020-06-12T02:35:28.739 INFO:tasks.rados.rados.0.smithi142.stdout:46: writing smithi14213939-46 from 1933572 to 2725242 tid 2 2020-06-12T02:35:28.739 INFO:tasks.rados.rados.0.smithi142.stdout:47: write initial oid 47 2020-06-12T02:35:28.740 INFO:tasks.rados.rados.0.smithi142.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2020-06-12T02:35:28.740 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:125 1.9s0 1:9d744368:::smithi14213939-32:head [write 521017~798131,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.520850+0000", 2020-06-12T02:35:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.19771813099999999, 2020-06-12T02:35:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067788270000000003, 2020-06-12T02:35:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 125 2020-06-12T02:35:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.520850+0000", 2020-06-12T02:35:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.520850+0000", 2020-06-12T02:35:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046044100000000002 2020-06-12T02:35:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521310+0000", 2020-06-12T02:35:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0606e-05 2020-06-12T02:35:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521321+0000", 2020-06-12T02:35:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8085e-05 2020-06-12T02:35:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521339+0000", 2020-06-12T02:35:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.498e-06 2020-06-12T02:35:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521346+0000", 2020-06-12T02:35:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2020-06-12T02:35:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521407+0000", 2020-06-12T02:35:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024566200000000001 2020-06-12T02:35:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.521652+0000", 2020-06-12T02:35:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015603920000000001 2020-06-12T02:35:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.523213+0000", 2020-06-12T02:35:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00176804 2020-06-12T02:35:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.524981+0000", 2020-06-12T02:35:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024855379999999998 2020-06-12T02:35:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.527466+0000", 2020-06-12T02:35:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162316 2020-06-12T02:35:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.527629+0000", 2020-06-12T02:35:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067788270000000003 2020-06-12T02:35:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:126 1.9s0 1:9d744368:::smithi14213939-32:head [write 1747530~482340] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.526017+0000", 2020-06-12T02:35:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.19255097700000001, 2020-06-12T02:35:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088996720000000008, 2020-06-12T02:35:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 126 2020-06-12T02:35:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526017+0000", 2020-06-12T02:35:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526017+0000", 2020-06-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023300600000000001 2020-06-12T02:35:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526250+0000", 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1610000000000003e-06 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526258+0000", 2020-06-12T02:35:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4365000000000001e-05 2020-06-12T02:35:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526272+0000", 2020-06-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4919999999999998e-06 2020-06-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526279+0000", 2020-06-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399e-05 2020-06-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526330+0000", 2020-06-12T02:35:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000140827 2020-06-12T02:35:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526471+0000", 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001565346 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.528036+0000", 2020-06-12T02:35:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8894999999999997e-05 2020-06-12T02:35:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.528105+0000", 2020-06-12T02:35:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000936118 2020-06-12T02:35:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.529041+0000", 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022405900000000002 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531282+0000", 2020-06-12T02:35:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035282930000000001 2020-06-12T02:35:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.534810+0000", 2020-06-12T02:35:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010618 2020-06-12T02:35:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.534917+0000", 2020-06-12T02:35:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088996720000000008 2020-06-12T02:35:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:127 1.9s0 1:9d744368:::smithi14213939-32:head [setxattr _header (56) in=7b,truncate 2521017] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.526350+0000", 2020-06-12T02:35:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.19221781099999999, 2020-06-12T02:35:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0099289800000000004, 2020-06-12T02:35:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 127 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526350+0000", 2020-06-12T02:35:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526350+0000", 2020-06-12T02:35:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010054 2020-06-12T02:35:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526451+0000", 2020-06-12T02:35:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4529999999999996e-06 2020-06-12T02:35:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526458+0000", 2020-06-12T02:35:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3186000000000001e-05 2020-06-12T02:35:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526481+0000", 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9949999999999996e-06 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526486+0000", 2020-06-12T02:35:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4192e-05 2020-06-12T02:35:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526530+0000", 2020-06-12T02:35:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134053 2020-06-12T02:35:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526664+0000", 2020-06-12T02:35:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032901179999999999 2020-06-12T02:35:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.529955+0000", 2020-06-12T02:35:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6681999999999994e-05 2020-06-12T02:35:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.530041+0000", 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056979899999999996 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.530611+0000", 2020-06-12T02:35:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080266500000000004 2020-06-12T02:35:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531414+0000", 2020-06-12T02:35:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047543150000000003 2020-06-12T02:35:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.536168+0000", 2020-06-12T02:35:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110982 2020-06-12T02:35:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.536279+0000", 2020-06-12T02:35:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0099289800000000004 2020-06-12T02:35:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:128 1.9s0 1:9d744368:::smithi14213939-32:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.526540+0000", 2020-06-12T02:35:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.192027635, 2020-06-12T02:35:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011964257000000001, 2020-06-12T02:35:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 128 2020-06-12T02:35:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526540+0000", 2020-06-12T02:35:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526540+0000", 2020-06-12T02:35:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4687999999999997e-05 2020-06-12T02:35:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526575+0000", 2020-06-12T02:35:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8849999999999998e-06 2020-06-12T02:35:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526580+0000", 2020-06-12T02:35:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5840000000000001e-06 2020-06-12T02:35:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526589+0000", 2020-06-12T02:35:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7169999999999999e-06 2020-06-12T02:35:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526594+0000", 2020-06-12T02:35:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107753 2020-06-12T02:35:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526702+0000", 2020-06-12T02:35:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132247 2020-06-12T02:35:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.526834+0000", 2020-06-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004378837 2020-06-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531213+0000", 2020-06-12T02:35:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5220000000000002e-05 2020-06-12T02:35:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531278+0000", 2020-06-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053319389999999999 2020-06-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.536610+0000", 2020-06-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8422000000000002e-05 2020-06-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.536689+0000", 2020-06-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018159649999999999 2020-06-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.538504+0000", 2020-06-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011964257000000001 2020-06-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:129 1.7s0 1:ea758f11:::smithi14213939-33:head [write 537824~473380,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.531749+0000", 2020-06-12T02:35:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.18681901200000001, 2020-06-12T02:35:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060111510000000002, 2020-06-12T02:35:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 129 2020-06-12T02:35:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531749+0000", 2020-06-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531749+0000", 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000193525 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531942+0000", 2020-06-12T02:35:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0099999999999998e-06 2020-06-12T02:35:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531949+0000", 2020-06-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9570000000000001e-05 2020-06-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531969+0000", 2020-06-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5050000000000004e-06 2020-06-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.531975+0000", 2020-06-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4659000000000001e-05 2020-06-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.532020+0000", 2020-06-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016675500000000001 2020-06-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.532187+0000", 2020-06-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000946881 2020-06-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.533134+0000", 2020-06-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017627680000000001 2020-06-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.534897+0000", 2020-06-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027660990000000002 2020-06-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.537663+0000", 2020-06-12T02:35:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7379000000000004e-05 2020-06-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.537760+0000", 2020-06-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060111510000000002 2020-06-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:130 1.7s0 1:ea758f11:::smithi14213939-33:head [write 1806012~625998] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.539923+0000", 2020-06-12T02:35:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.17864502099999999, 2020-06-12T02:35:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067348859999999998, 2020-06-12T02:35:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 130 2020-06-12T02:35:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.539923+0000", 2020-06-12T02:35:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.539923+0000", 2020-06-12T02:35:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025704100000000001 2020-06-12T02:35:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540180+0000", 2020-06-12T02:35:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5390000000000007e-06 2020-06-12T02:35:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540188+0000", 2020-06-12T02:35:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5630000000000001e-05 2020-06-12T02:35:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540204+0000", 2020-06-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4949999999999999e-06 2020-06-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540210+0000", 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4663999999999998e-05 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540254+0000", 2020-06-12T02:35:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110672 2020-06-12T02:35:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540365+0000", 2020-06-12T02:35:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014936299999999999 2020-06-12T02:35:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.541858+0000", 2020-06-12T02:35:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030873630000000001 2020-06-12T02:35:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.544946+0000", 2020-06-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0016384150000000001 2020-06-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.546584+0000", 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3436999999999995e-05 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.546658+0000", 2020-06-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067348859999999998 2020-06-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:131 1.7s0 1:ea758f11:::smithi14213939-33:head [setxattr _header (56) in=7b,truncate 2537824] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.540265+0000", 2020-06-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.17830289099999999, 2020-06-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075837409999999997, 2020-06-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 131 2020-06-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540265+0000", 2020-06-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540265+0000", 2020-06-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7212000000000005e-05 2020-06-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540342+0000", 2020-06-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6019999999999999e-06 2020-06-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540348+0000", 2020-06-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2439000000000001e-05 2020-06-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540360+0000", 2020-06-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1999999999999996e-06 2020-06-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540364+0000", 2020-06-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002911126 2020-06-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.543276+0000", 2020-06-12T02:35:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014800499999999999 2020-06-12T02:35:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.543424+0000", 2020-06-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087758499999999995 2020-06-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.544301+0000", 2020-06-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018052179999999999 2020-06-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.546106+0000", 2020-06-12T02:35:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0016216449999999999 2020-06-12T02:35:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.547728+0000", 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120709 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.547849+0000", 2020-06-12T02:35:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075837409999999997 2020-06-12T02:35:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:132 1.7s0 1:ea758f11:::smithi14213939-33:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.540406+0000", 2020-06-12T02:35:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.17816152099999999, 2020-06-12T02:35:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010343165, 2020-06-12T02:35:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 132 2020-06-12T02:35:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540406+0000", 2020-06-12T02:35:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540406+0000", 2020-06-12T02:35:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2438000000000003e-05 2020-06-12T02:35:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540449+0000", 2020-06-12T02:35:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.446e-06 2020-06-12T02:35:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540454+0000", 2020-06-12T02:35:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0631e-05 2020-06-12T02:35:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540465+0000", 2020-06-12T02:35:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4879999999999999e-06 2020-06-12T02:35:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.540468+0000", 2020-06-12T02:35:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043406449999999997 2020-06-12T02:35:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.544809+0000", 2020-06-12T02:35:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129018 2020-06-12T02:35:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.544938+0000", 2020-06-12T02:35:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00339142 2020-06-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.548329+0000", 2020-06-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011810499999999999 2020-06-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.548448+0000", 2020-06-12T02:35:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002301974 2020-06-12T02:35:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.550749+0000", 2020-06-12T02:35:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010343165 2020-06-12T02:35:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:157 1.as0 1:583b628a:::smithi14213939-40:head [write 655473~716476,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.636479+0000", 2020-06-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.082089313999999997, 2020-06-12T02:35:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088054810000000004, 2020-06-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 157 2020-06-12T02:35:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636479+0000", 2020-06-12T02:35:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636479+0000", 2020-06-12T02:35:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026852899999999999 2020-06-12T02:35:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636747+0000", 2020-06-12T02:35:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1031e-05 2020-06-12T02:35:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636758+0000", 2020-06-12T02:35:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8034999999999999e-05 2020-06-12T02:35:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636776+0000", 2020-06-12T02:35:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1439999999999992e-06 2020-06-12T02:35:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636785+0000", 2020-06-12T02:35:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7497999999999997e-05 2020-06-12T02:35:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.636843+0000", 2020-06-12T02:35:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022533000000000001 2020-06-12T02:35:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637068+0000", 2020-06-12T02:35:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017522449999999999 2020-06-12T02:35:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.638820+0000", 2020-06-12T02:35:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023044860000000001 2020-06-12T02:35:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.641125+0000", 2020-06-12T02:35:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039892900000000004 2020-06-12T02:35:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.645114+0000", 2020-06-12T02:35:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016989300000000001 2020-06-12T02:35:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.645284+0000", 2020-06-12T02:35:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088054810000000004 2020-06-12T02:35:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:158 1.as0 1:583b628a:::smithi14213939-40:head [write 2099033~556440] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.644027+0000", 2020-06-12T02:35:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.074540929000000006, 2020-06-12T02:35:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085292649999999994, 2020-06-12T02:35:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 158 2020-06-12T02:35:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644027+0000", 2020-06-12T02:35:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644027+0000", 2020-06-12T02:35:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022990400000000001 2020-06-12T02:35:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644257+0000", 2020-06-12T02:35:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8760000000000005e-06 2020-06-12T02:35:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644265+0000", 2020-06-12T02:35:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6305999999999999e-05 2020-06-12T02:35:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644281+0000", 2020-06-12T02:35:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2509999999999994e-06 2020-06-12T02:35:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644289+0000", 2020-06-12T02:35:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1832000000000001e-05 2020-06-12T02:35:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644341+0000", 2020-06-12T02:35:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000117287 2020-06-12T02:35:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644458+0000", 2020-06-12T02:35:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001213808 2020-06-12T02:35:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.645672+0000", 2020-06-12T02:35:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101279 2020-06-12T02:35:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.645773+0000", 2020-06-12T02:35:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013811170000000001 2020-06-12T02:35:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647155+0000", 2020-06-12T02:35:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046214960000000001 2020-06-12T02:35:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.651776+0000", 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064814500000000004 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.652424+0000", 2020-06-12T02:35:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013196400000000001 2020-06-12T02:35:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.652556+0000", 2020-06-12T02:35:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085292649999999994 2020-06-12T02:35:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:159 1.as0 1:583b628a:::smithi14213939-40:head [setxattr _header (56) in=7b,truncate 2655473] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.644341+0000", 2020-06-12T02:35:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.074226598000000005, 2020-06-12T02:35:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092465840000000004, 2020-06-12T02:35:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 159 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644341+0000", 2020-06-12T02:35:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644341+0000", 2020-06-12T02:35:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8479e-05 2020-06-12T02:35:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644400+0000", 2020-06-12T02:35:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1290000000000004e-06 2020-06-12T02:35:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644405+0000", 2020-06-12T02:35:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3000000000000007e-06 2020-06-12T02:35:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644414+0000", 2020-06-12T02:35:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644418+0000", 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2484000000000006e-05 2020-06-12T02:35:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644490+0000", 2020-06-12T02:35:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4451999999999996e-05 2020-06-12T02:35:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644585+0000", 2020-06-12T02:35:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047653640000000002 2020-06-12T02:35:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.649350+0000", 2020-06-12T02:35:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011638599999999999 2020-06-12T02:35:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.649466+0000", 2020-06-12T02:35:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00065237400000000005 2020-06-12T02:35:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.650119+0000", 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020296509999999999 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.652148+0000", 2020-06-12T02:35:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001315734 2020-06-12T02:35:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.653464+0000", 2020-06-12T02:35:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012365999999999999 2020-06-12T02:35:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.653588+0000", 2020-06-12T02:35:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092465840000000004 2020-06-12T02:35:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:160 1.as0 1:583b628a:::smithi14213939-40:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.644454+0000", 2020-06-12T02:35:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.074113395999999998, 2020-06-12T02:35:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011669072000000001, 2020-06-12T02:35:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 160 2020-06-12T02:35:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644454+0000", 2020-06-12T02:35:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644454+0000", 2020-06-12T02:35:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5459000000000001e-05 2020-06-12T02:35:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644490+0000", 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5109999999999997e-06 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644494+0000", 2020-06-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1154e-05 2020-06-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644506+0000", 2020-06-12T02:35:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.196e-06 2020-06-12T02:35:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644509+0000", 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111444 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644620+0000", 2020-06-12T02:35:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114953 2020-06-12T02:35:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.644735+0000", 2020-06-12T02:35:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071083650000000002 2020-06-12T02:35:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.651844+0000", 2020-06-12T02:35:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143967 2020-06-12T02:35:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.651988+0000", 2020-06-12T02:35:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021123409999999998 2020-06-12T02:35:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.654100+0000", 2020-06-12T02:35:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8558000000000001e-05 2020-06-12T02:35:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.654198+0000", 2020-06-12T02:35:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019251240000000001 2020-06-12T02:35:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.656124+0000", 2020-06-12T02:35:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011669072000000001 2020-06-12T02:35:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.as0 21/18 ECSubWriteReply(tid=67, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.647077+0000", 2020-06-12T02:35:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.071490559999999995, 2020-06-12T02:35:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045931740000000002, 2020-06-12T02:35:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647077+0000", 2020-06-12T02:35:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647077+0000", 2020-06-12T02:35:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8420000000000001e-05 2020-06-12T02:35:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647126+0000", 2020-06-12T02:35:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7009999999999996e-06 2020-06-12T02:35:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647133+0000", 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4968e-05 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647148+0000", 2020-06-12T02:35:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8079999999999999e-06 2020-06-12T02:35:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.647155+0000", 2020-06-12T02:35:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044952079999999997 2020-06-12T02:35:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.651650+0000", 2020-06-12T02:35:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0069e-05 2020-06-12T02:35:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.651670+0000", 2020-06-12T02:35:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045931740000000002 2020-06-12T02:35:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:165 1.es0 1:7b491eff:::smithi14213939-42:head [write 689087~466974,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.666569+0000", 2020-06-12T02:35:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.051999142999999998, 2020-06-12T02:35:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006006422, 2020-06-12T02:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 165 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666569+0000", 2020-06-12T02:35:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666569+0000", 2020-06-12T02:35:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026214800000000003 2020-06-12T02:35:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666831+0000", 2020-06-12T02:35:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8389999999999996e-06 2020-06-12T02:35:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666840+0000", 2020-06-12T02:35:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6137000000000002e-05 2020-06-12T02:35:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666856+0000", 2020-06-12T02:35:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2570000000000001e-06 2020-06-12T02:35:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666863+0000", 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0820000000000003e-05 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.666934+0000", 2020-06-12T02:35:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021151000000000001 2020-06-12T02:35:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.667145+0000", 2020-06-12T02:35:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014014990000000001 2020-06-12T02:35:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.668547+0000", 2020-06-12T02:35:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001817529 2020-06-12T02:35:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.670364+0000", 2020-06-12T02:35:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021406469999999999 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.672505+0000", 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0036000000000005e-05 2020-06-12T02:35:29.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.672575+0000", 2020-06-12T02:35:29.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006006422 2020-06-12T02:35:29.004 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.005 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.005 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:166 1.es0 1:7b491eff:::smithi14213939-42:head [write 1699644~784332] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.006 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.674497+0000", 2020-06-12T02:35:29.006 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.044070353999999999, 2020-06-12T02:35:29.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082552379999999998, 2020-06-12T02:35:29.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 166 2020-06-12T02:35:29.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674497+0000", 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674497+0000", 2020-06-12T02:35:29.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032457900000000002 2020-06-12T02:35:29.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674822+0000", 2020-06-12T02:35:29.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0049e-05 2020-06-12T02:35:29.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674832+0000", 2020-06-12T02:35:29.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0890000000000002e-05 2020-06-12T02:35:29.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674853+0000", 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2730000000000008e-06 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674862+0000", 2020-06-12T02:35:29.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8315999999999997e-05 2020-06-12T02:35:29.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674901+0000", 2020-06-12T02:35:29.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0222000000000005e-05 2020-06-12T02:35:29.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674991+0000", 2020-06-12T02:35:29.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001264931 2020-06-12T02:35:29.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.676256+0000", 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029822289999999999 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.679238+0000", 2020-06-12T02:35:29.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003406344 2020-06-12T02:35:29.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.682644+0000", 2020-06-12T02:35:29.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000108405 2020-06-12T02:35:29.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.682753+0000", 2020-06-12T02:35:29.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082552379999999998 2020-06-12T02:35:29.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.019 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:167 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (56) in=7b,truncate 2689087] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.674934+0000", 2020-06-12T02:35:29.020 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.043633474999999998, 2020-06-12T02:35:29.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085048510000000008, 2020-06-12T02:35:29.021 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.021 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.021 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.021 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.022 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 167 2020-06-12T02:35:29.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.022 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674934+0000", 2020-06-12T02:35:29.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.674934+0000", 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6435999999999996e-05 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675031+0000", 2020-06-12T02:35:29.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5049999999999996e-06 2020-06-12T02:35:29.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675040+0000", 2020-06-12T02:35:29.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4256e-05 2020-06-12T02:35:29.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675055+0000", 2020-06-12T02:35:29.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2710000000000003e-06 2020-06-12T02:35:29.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675062+0000", 2020-06-12T02:35:29.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025676140000000002 2020-06-12T02:35:29.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.677629+0000", 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010148400000000001 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.677731+0000", 2020-06-12T02:35:29.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059283199999999995 2020-06-12T02:35:29.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.678324+0000", 2020-06-12T02:35:29.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001408067 2020-06-12T02:35:29.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.679732+0000", 2020-06-12T02:35:29.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035554089999999998 2020-06-12T02:35:29.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.683287+0000", 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000151977 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.683439+0000", 2020-06-12T02:35:29.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085048510000000008 2020-06-12T02:35:29.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.034 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.035 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:168 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:29.035 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.675123+0000", 2020-06-12T02:35:29.035 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.043444965000000002, 2020-06-12T02:35:29.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010085800000000001, 2020-06-12T02:35:29.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:29.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.036 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 168 2020-06-12T02:35:29.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.037 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675123+0000", 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675123+0000", 2020-06-12T02:35:29.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6643e-05 2020-06-12T02:35:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675180+0000", 2020-06-12T02:35:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0919999999999998e-06 2020-06-12T02:35:29.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675188+0000", 2020-06-12T02:35:29.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5197999999999999e-05 2020-06-12T02:35:29.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675203+0000", 2020-06-12T02:35:29.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1370000000000001e-06 2020-06-12T02:35:29.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.675208+0000", 2020-06-12T02:35:29.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038118869999999999 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.679020+0000", 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163451 2020-06-12T02:35:29.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.679183+0000", 2020-06-12T02:35:29.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045936689999999999 2020-06-12T02:35:29.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.683777+0000", 2020-06-12T02:35:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106706 2020-06-12T02:35:29.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.683884+0000", 2020-06-12T02:35:29.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013250169999999999 2020-06-12T02:35:29.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.685209+0000", 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010085800000000001 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:173 1.es0 1:7e821f7f:::smithi14213939-44:head [write 722701~617472,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.048 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.696111+0000", 2020-06-12T02:35:29.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.022456994000000001, 2020-06-12T02:35:29.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081093840000000007, 2020-06-12T02:35:29.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 173 2020-06-12T02:35:29.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.050 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696111+0000", 2020-06-12T02:35:29.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696111+0000", 2020-06-12T02:35:29.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028885100000000002 2020-06-12T02:35:29.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696400+0000", 2020-06-12T02:35:29.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.004e-05 2020-06-12T02:35:29.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696410+0000", 2020-06-12T02:35:29.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2325000000000001e-05 2020-06-12T02:35:29.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696432+0000", 2020-06-12T02:35:29.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0861e-05 2020-06-12T02:35:29.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696443+0000", 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7286999999999994e-05 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696520+0000", 2020-06-12T02:35:29.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024435700000000001 2020-06-12T02:35:29.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.696765+0000", 2020-06-12T02:35:29.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001930296 2020-06-12T02:35:29.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.698695+0000", 2020-06-12T02:35:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022831090000000002 2020-06-12T02:35:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.700978+0000", 2020-06-12T02:35:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031120090000000002 2020-06-12T02:35:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704090+0000", 2020-06-12T02:35:29.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013024900000000001 2020-06-12T02:35:29.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704220+0000", 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081093840000000007 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.063 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:174 1.es0 1:7e821f7f:::smithi14213939-44:head [write 1816608~788001] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.063 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.703848+0000", 2020-06-12T02:35:29.063 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.014719784, 2020-06-12T02:35:29.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060793849999999997, 2020-06-12T02:35:29.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.064 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.064 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 174 2020-06-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.703848+0000", 2020-06-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.703848+0000", 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046736400000000001 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704315+0000", 2020-06-12T02:35:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6390000000000004e-06 2020-06-12T02:35:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704325+0000", 2020-06-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3723999999999999e-05 2020-06-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704349+0000", 2020-06-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5889999999999999e-06 2020-06-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704355+0000", 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034034400000000002 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704696+0000", 2020-06-12T02:35:29.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011383399999999999 2020-06-12T02:35:29.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704810+0000", 2020-06-12T02:35:29.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017413000000000001 2020-06-12T02:35:29.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.706551+0000", 2020-06-12T02:35:29.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025923809999999999 2020-06-12T02:35:29.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.709143+0000", 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069433099999999996 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.709838+0000", 2020-06-12T02:35:29.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9878999999999998e-05 2020-06-12T02:35:29.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.709927+0000", 2020-06-12T02:35:29.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060793849999999997 2020-06-12T02:35:29.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.078 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:175 1.es0 1:7e821f7f:::smithi14213939-44:head [setxattr _header (56) in=7b,truncate 2722701] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.078 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.704422+0000", 2020-06-12T02:35:29.078 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.014145389, 2020-06-12T02:35:29.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075017069999999998, 2020-06-12T02:35:29.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.079 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.079 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 175 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704422+0000", 2020-06-12T02:35:29.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704422+0000", 2020-06-12T02:35:29.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8533000000000001e-05 2020-06-12T02:35:29.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704511+0000", 2020-06-12T02:35:29.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.072e-06 2020-06-12T02:35:29.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704519+0000", 2020-06-12T02:35:29.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3691e-05 2020-06-12T02:35:29.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704533+0000", 2020-06-12T02:35:29.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.704539+0000", 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003525809 2020-06-12T02:35:29.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.708065+0000", 2020-06-12T02:35:29.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132569 2020-06-12T02:35:29.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.708197+0000", 2020-06-12T02:35:29.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00048369299999999999 2020-06-12T02:35:29.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.708681+0000", 2020-06-12T02:35:29.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028261879999999999 2020-06-12T02:35:29.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.711507+0000", 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032466400000000001 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.711832+0000", 2020-06-12T02:35:29.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2226999999999996e-05 2020-06-12T02:35:29.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.711924+0000", 2020-06-12T02:35:29.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075017069999999998 2020-06-12T02:35:29.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.092 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:29.093 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:28.735+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:29.093 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:29.098 INFO:tasks.rados.rados.0.smithi142.stdout:47: writing smithi14213939-47 from 773122 to 1332694 tid 1 2020-06-12T02:35:29.098 INFO:tasks.rados.rados.0.smithi142.stdout:47: writing smithi14213939-47 from 1992054 to 2643735 tid 2 2020-06-12T02:35:29.098 INFO:tasks.rados.rados.0.smithi142.stdout:48: write initial oid 48 2020-06-12T02:35:29.099 INFO:tasks.rados.rados.0.smithi142.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2020-06-12T02:35:29.099 INFO:tasks.rados.rados.0.smithi142.stdout:48: writing smithi14213939-48 from 789929 to 1424750 tid 1 2020-06-12T02:35:29.099 INFO:tasks.rados.rados.0.smithi142.stdout:48: writing smithi14213939-48 from 2050536 to 2789929 tid 2 2020-06-12T02:35:29.099 INFO:tasks.rados.rados.0.smithi142.stdout:49: write initial oid 49 2020-06-12T02:35:29.099 INFO:tasks.rados.rados.0.smithi142.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2020-06-12T02:35:29.100 INFO:tasks.rados.rados.0.smithi142.stdout:49: writing smithi14213939-49 from 406736 to 1116806 tid 1 2020-06-12T02:35:29.100 INFO:tasks.rados.rados.0.smithi142.stdout:49: writing smithi14213939-49 from 1709018 to 2364368 tid 2 2020-06-12T02:35:29.100 INFO:tasks.rados.rados.0.smithi142.stdout:50: write initial oid 50 2020-06-12T02:35:29.100 INFO:tasks.rados.rados.0.smithi142.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2020-06-12T02:35:29.100 INFO:tasks.rados.rados.0.smithi142.stdout:50: writing smithi14213939-50 from 423543 to 1208862 tid 1 2020-06-12T02:35:29.101 INFO:tasks.rados.rados.0.smithi142.stdout:50: writing smithi14213939-50 from 1767500 to 2566508 tid 2 2020-06-12T02:35:29.101 INFO:tasks.rados.rados.0.smithi142.stdout:51: snap_create 2020-06-12T02:35:29.101 INFO:tasks.rados.rados.0.smithi142.stdout:44: finishing write tid 1 to smithi14213939-44 2020-06-12T02:35:29.101 INFO:tasks.rados.rados.0.smithi142.stdout:44: finishing write tid 2 to smithi14213939-44 2020-06-12T02:35:29.101 INFO:tasks.rados.rados.0.smithi142.stdout:44: finishing write tid 4 to smithi14213939-44 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:44: finishing write tid 5 to smithi14213939-44 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 44 v 9 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:45: finishing write tid 1 to smithi14213939-45 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:45: finishing write tid 2 to smithi14213939-45 2020-06-12T02:35:29.102 INFO:tasks.rados.rados.0.smithi142.stdout:45: finishing write tid 4 to smithi14213939-45 2020-06-12T02:35:29.103 INFO:tasks.rados.rados.0.smithi142.stdout:45: finishing write tid 5 to smithi14213939-45 2020-06-12T02:35:29.103 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 45 v 9 (ObjNum 44 snap 0 seq_num 44) dirty exists 2020-06-12T02:35:29.103 INFO:tasks.rados.rados.0.smithi142.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2020-06-12T02:35:29.103 INFO:tasks.rados.rados.0.smithi142.stdout:46: finishing write tid 1 to smithi14213939-46 2020-06-12T02:35:29.103 INFO:tasks.rados.rados.0.smithi142.stdout:46: finishing write tid 2 to smithi14213939-46 2020-06-12T02:35:29.104 INFO:tasks.rados.rados.0.smithi142.stdout:46: finishing write tid 4 to smithi14213939-46 2020-06-12T02:35:29.104 INFO:tasks.rados.rados.0.smithi142.stdout:46: finishing write tid 5 to smithi14213939-46 2020-06-12T02:35:29.104 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 46 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2020-06-12T02:35:29.104 INFO:tasks.rados.rados.0.smithi142.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2020-06-12T02:35:29.104 INFO:tasks.rados.rados.0.smithi142.stdout:47: finishing write tid 1 to smithi14213939-47 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:47: finishing write tid 2 to smithi14213939-47 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:47: finishing write tid 4 to smithi14213939-47 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:47: finishing write tid 5 to smithi14213939-47 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2020-06-12T02:35:29.105 INFO:tasks.rados.rados.0.smithi142.stdout:48: finishing write tid 1 to smithi14213939-48 2020-06-12T02:35:29.106 INFO:tasks.rados.rados.0.smithi142.stdout:48: finishing write tid 2 to smithi14213939-48 2020-06-12T02:35:29.106 INFO:tasks.rados.rados.0.smithi142.stdout:48: finishing write tid 4 to smithi14213939-48 2020-06-12T02:35:29.106 INFO:tasks.rados.rados.0.smithi142.stdout:48: finishing write tid 5 to smithi14213939-48 2020-06-12T02:35:29.106 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 3 (ObjNum 47 snap 0 seq_num 47) dirty exists 2020-06-12T02:35:29.106 INFO:tasks.rados.rados.0.smithi142.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2020-06-12T02:35:29.107 INFO:tasks.rados.rados.0.smithi142.stdout:49: finishing write tid 1 to smithi14213939-49 2020-06-12T02:35:29.107 INFO:tasks.rados.rados.0.smithi142.stdout:49: finishing write tid 2 to smithi14213939-49 2020-06-12T02:35:29.107 INFO:tasks.rados.rados.0.smithi142.stdout:49: finishing write tid 4 to smithi14213939-49 2020-06-12T02:35:29.107 INFO:tasks.rados.rados.0.smithi142.stdout:49: finishing write tid 5 to smithi14213939-49 2020-06-12T02:35:29.107 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2020-06-12T02:35:29.108 INFO:tasks.rados.rados.0.smithi142.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2020-06-12T02:35:29.108 INFO:tasks.rados.rados.0.smithi142.stdout:50: finishing write tid 1 to smithi14213939-50 2020-06-12T02:35:29.108 INFO:tasks.rados.rados.0.smithi142.stdout:50: finishing write tid 2 to smithi14213939-50 2020-06-12T02:35:29.108 INFO:tasks.rados.rados.0.smithi142.stdout:50: finishing write tid 4 to smithi14213939-50 2020-06-12T02:35:29.108 INFO:tasks.rados.rados.0.smithi142.stdout:50: finishing write tid 5 to smithi14213939-50 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 50 v 18 (ObjNum 49 snap 0 seq_num 49) dirty exists 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:44: done (7 left) 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:45: done (6 left) 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:46: done (5 left) 2020-06-12T02:35:29.109 INFO:tasks.rados.rados.0.smithi142.stdout:47: done (4 left) 2020-06-12T02:35:29.110 INFO:tasks.rados.rados.0.smithi142.stdout:48: done (3 left) 2020-06-12T02:35:29.110 INFO:tasks.rados.rados.0.smithi142.stdout:49: done (2 left) 2020-06-12T02:35:29.110 INFO:tasks.rados.rados.0.smithi142.stdout:50: done (1 left) 2020-06-12T02:35:29.110 INFO:tasks.rados.rados.0.smithi142.stdout:51: done (0 left) 2020-06-12T02:35:29.110 INFO:tasks.rados.rados.0.smithi142.stdout:52: snap_create 2020-06-12T02:35:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:29.111 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:29.114 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:29.095+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:29.196 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:29.195+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:29.252 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:29.252 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:29.261 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:29.298 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:29.299+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:29.363 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:29.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:29.364 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:29.373 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:29.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:29.399+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:29.490 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:145 1.ds0 1:b752a38e:::smithi14213939-37:head [write 605052~774376,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89889446500000003, 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081256230000000002, 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 145 2020-06-12T02:35:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00053313999999999998 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591379+0000", 2020-06-12T02:35:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6824999999999999e-05 2020-06-12T02:35:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591396+0000", 2020-06-12T02:35:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4289000000000001e-05 2020-06-12T02:35:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591420+0000", 2020-06-12T02:35:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:35:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591433+0000", 2020-06-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0865000000000006e-05 2020-06-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591514+0000", 2020-06-12T02:35:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027453999999999998 2020-06-12T02:35:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591788+0000", 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018796609999999999 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.593668+0000", 2020-06-12T02:35:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018390730000000001 2020-06-12T02:35:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.595507+0000", 2020-06-12T02:35:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033349949999999999 2020-06-12T02:35:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598842+0000", 2020-06-12T02:35:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012942699999999999 2020-06-12T02:35:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598971+0000", 2020-06-12T02:35:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081256230000000002 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:146 1.ds0 1:b752a38e:::smithi14213939-37:head [write 1923587~633336] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89186670499999998, 2020-06-12T02:35:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011364222, 2020-06-12T02:35:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 146 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023479100000000001 2020-06-12T02:35:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598108+0000", 2020-06-12T02:35:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5719999999999997e-06 2020-06-12T02:35:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598116+0000", 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3506000000000001e-05 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598129+0000", 2020-06-12T02:35:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2336e-05 2020-06-12T02:35:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598142+0000", 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9764e-05 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598192+0000", 2020-06-12T02:35:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013577500000000001 2020-06-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598327+0000", 2020-06-12T02:35:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010142160000000001 2020-06-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.599342+0000", 2020-06-12T02:35:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4664000000000001e-05 2020-06-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.599426+0000", 2020-06-12T02:35:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019771789999999999 2020-06-12T02:35:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.601403+0000", 2020-06-12T02:35:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074435500000000002 2020-06-12T02:35:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.608847+0000", 2020-06-12T02:35:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025534499999999998 2020-06-12T02:35:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609102+0000", 2020-06-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013552400000000001 2020-06-12T02:35:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609238+0000", 2020-06-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011364222 2020-06-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:147 1.ds0 1:b752a38e:::smithi14213939-37:head [setxattr _header (56) in=7b,truncate 2605052] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89153036399999996, 2020-06-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011264615, 2020-06-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 147 2020-06-12T02:35:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1422999999999995e-05 2020-06-12T02:35:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598301+0000", 2020-06-12T02:35:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5480000000000002e-06 2020-06-12T02:35:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598310+0000", 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4932999999999999e-05 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598325+0000", 2020-06-12T02:35:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2900000000000002e-06 2020-06-12T02:35:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598330+0000", 2020-06-12T02:35:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3238999999999995e-05 2020-06-12T02:35:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598403+0000", 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000190316 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598594+0000", 2020-06-12T02:35:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046041509999999999 2020-06-12T02:35:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603198+0000", 2020-06-12T02:35:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013647400000000001 2020-06-12T02:35:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603334+0000", 2020-06-12T02:35:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058424599999999996 2020-06-12T02:35:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603919+0000", 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053348730000000004 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609253+0000", 2020-06-12T02:35:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7345999999999999e-05 2020-06-12T02:35:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609351+0000", 2020-06-12T02:35:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000123776 2020-06-12T02:35:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609475+0000", 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011264615 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:148 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89136055300000006, 2020-06-12T02:35:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013621273999999999, 2020-06-12T02:35:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 148 2020-06-12T02:35:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-05 2020-06-12T02:35:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598432+0000", 2020-06-12T02:35:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9130000000000003e-06 2020-06-12T02:35:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598440+0000", 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5525000000000001e-05 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598455+0000", 2020-06-12T02:35:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9540000000000001e-06 2020-06-12T02:35:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598461+0000", 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016353799999999999 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598625+0000", 2020-06-12T02:35:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2236000000000003e-05 2020-06-12T02:35:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598717+0000", 2020-06-12T02:35:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071921629999999997 2020-06-12T02:35:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605909+0000", 2020-06-12T02:35:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9365999999999997e-05 2020-06-12T02:35:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606008+0000", 2020-06-12T02:35:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035207960000000001 2020-06-12T02:35:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609529+0000", 2020-06-12T02:35:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014839000000000001 2020-06-12T02:35:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609677+0000", 2020-06-12T02:35:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023235529999999999 2020-06-12T02:35:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612001+0000", 2020-06-12T02:35:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013621273999999999 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.ds0 21/18 ECSubWriteReply(tid=48, last_complete=21'13, committed=1, applied=1))", 2020-06-12T02:35:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.600203+0000", 2020-06-12T02:35:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.88953684, 2020-06-12T02:35:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005588081, 2020-06-12T02:35:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600203+0000", 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600203+0000", 2020-06-12T02:35:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6167000000000001e-05 2020-06-12T02:35:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600240+0000", 2020-06-12T02:35:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4529999999999999e-06 2020-06-12T02:35:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600246+0000", 2020-06-12T02:35:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6800000000000005e-06 2020-06-12T02:35:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600256+0000", 2020-06-12T02:35:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8709999999999996e-06 2020-06-12T02:35:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600261+0000", 2020-06-12T02:35:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055171860000000003 2020-06-12T02:35:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605778+0000", 2020-06-12T02:35:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3723999999999999e-05 2020-06-12T02:35:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605792+0000", 2020-06-12T02:35:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005588081 2020-06-12T02:35:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.ds0 21/18 ECSubWriteReply(tid=48, last_complete=21'13, committed=1, applied=1))", 2020-06-12T02:35:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.600311+0000", 2020-06-12T02:35:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.88942910500000005, 2020-06-12T02:35:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055098530000000003, 2020-06-12T02:35:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600311+0000", 2020-06-12T02:35:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600311+0000", 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4798000000000001e-05 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600346+0000", 2020-06-12T02:35:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.955e-06 2020-06-12T02:35:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600351+0000", 2020-06-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8030000000000003e-06 2020-06-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600360+0000", 2020-06-12T02:35:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1729999999999999e-06 2020-06-12T02:35:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.600363+0000", 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005449008 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605812+0000", 2020-06-12T02:35:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1160000000000005e-06 2020-06-12T02:35:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605821+0000", 2020-06-12T02:35:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055098530000000003 2020-06-12T02:35:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:149 1.ds0 1:ba86b5df:::smithi14213939-38:head [write 621859~449625,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.88558532000000001, 2020-06-12T02:35:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082004299999999999, 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 149 2020-06-12T02:35:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028979199999999998 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604445+0000", 2020-06-12T02:35:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1564e-05 2020-06-12T02:35:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604456+0000", 2020-06-12T02:35:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8079999999999999e-05 2020-06-12T02:35:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604484+0000", 2020-06-12T02:35:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0930999999999999e-05 2020-06-12T02:35:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604495+0000", 2020-06-12T02:35:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015740400000000001 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606069+0000", 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020112099999999999 2020-06-12T02:35:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606271+0000", 2020-06-12T02:35:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015820470000000001 2020-06-12T02:35:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.607853+0000", 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021353829999999998 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609988+0000", 2020-06-12T02:35:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022306740000000002 2020-06-12T02:35:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612219+0000", 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013679799999999999 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612355+0000", 2020-06-12T02:35:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082004299999999999 2020-06-12T02:35:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:150 1.ds0 1:ba86b5df:::smithi14213939-38:head [write 1865716~756143] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.87636984900000003, 2020-06-12T02:35:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082459820000000007, 2020-06-12T02:35:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 150 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032702099999999998 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613697+0000", 2020-06-12T02:35:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4079999999999998e-06 2020-06-12T02:35:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613706+0000", 2020-06-12T02:35:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0704e-05 2020-06-12T02:35:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613727+0000", 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0299999999999999e-06 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613733+0000", 2020-06-12T02:35:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0865000000000007e-05 2020-06-12T02:35:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613803+0000", 2020-06-12T02:35:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0322999999999997e-05 2020-06-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613884+0000", 2020-06-12T02:35:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001405417 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.615289+0000", 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031335880000000001 2020-06-12T02:35:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618423+0000", 2020-06-12T02:35:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030860839999999998 2020-06-12T02:35:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.621509+0000", 2020-06-12T02:35:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010754199999999999 2020-06-12T02:35:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.621616+0000", 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082459820000000007 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:151 1.ds0 1:ba86b5df:::smithi14213939-38:head [setxattr _header (56) in=7b,truncate 2621859] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.87595305700000003, 2020-06-12T02:35:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084782320000000005, 2020-06-12T02:35:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 151 2020-06-12T02:35:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9617999999999997e-05 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613857+0000", 2020-06-12T02:35:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1700000000000002e-06 2020-06-12T02:35:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613863+0000", 2020-06-12T02:35:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0539e-05 2020-06-12T02:35:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613874+0000", 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6910000000000002e-06 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613879+0000", 2020-06-12T02:35:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028255379999999998 2020-06-12T02:35:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.616705+0000", 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116805 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.616822+0000", 2020-06-12T02:35:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067296599999999999 2020-06-12T02:35:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.617495+0000", 2020-06-12T02:35:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023724760000000001 2020-06-12T02:35:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.619867+0000", 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022906060000000002 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622158+0000", 2020-06-12T02:35:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107823 2020-06-12T02:35:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622265+0000", 2020-06-12T02:35:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084782320000000005 2020-06-12T02:35:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:152 1.ds0 1:ba86b5df:::smithi14213939-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.87582309599999997, 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010821862999999999, 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 152 2020-06-12T02:35:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9952e-05 2020-06-12T02:35:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613957+0000", 2020-06-12T02:35:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3739999999999997e-06 2020-06-12T02:35:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613963+0000", 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613973+0000", 2020-06-12T02:35:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5039999999999998e-06 2020-06-12T02:35:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613976+0000", 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042943549999999997 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618271+0000", 2020-06-12T02:35:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014506999999999999 2020-06-12T02:35:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618416+0000", 2020-06-12T02:35:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042548839999999996 2020-06-12T02:35:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622671+0000", 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000158002 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622829+0000", 2020-06-12T02:35:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019102629999999999 2020-06-12T02:35:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.624739+0000", 2020-06-12T02:35:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010821862999999999 2020-06-12T02:35:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:153 1.5s0 1:ad55f8d3:::smithi14213939-39:head [write 638666~524874,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.620265+0000", 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.86947512100000002, 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057786460000000001, 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 153 2020-06-12T02:35:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620265+0000", 2020-06-12T02:35:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620265+0000", 2020-06-12T02:35:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022109399999999999 2020-06-12T02:35:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620486+0000", 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0346000000000001e-05 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620497+0000", 2020-06-12T02:35:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7645000000000001e-05 2020-06-12T02:35:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620514+0000", 2020-06-12T02:35:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2640000000000008e-06 2020-06-12T02:35:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620523+0000", 2020-06-12T02:35:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9608999999999998e-05 2020-06-12T02:35:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620582+0000", 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000177367 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.620760+0000", 2020-06-12T02:35:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014615069999999999 2020-06-12T02:35:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622221+0000", 2020-06-12T02:35:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026044839999999998 2020-06-12T02:35:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.624826+0000", 2020-06-12T02:35:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001132798 2020-06-12T02:35:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.625958+0000", 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5531999999999994e-05 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.626044+0000", 2020-06-12T02:35:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057786460000000001 2020-06-12T02:35:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:154 1.5s0 1:ad55f8d3:::smithi14213939-39:head [write 1924198~637005] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.86133336699999996, 2020-06-12T02:35:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068908299999999997, 2020-06-12T02:35:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 154 2020-06-12T02:35:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024628200000000001 2020-06-12T02:35:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628653+0000", 2020-06-12T02:35:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.652e-06 2020-06-12T02:35:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628660+0000", 2020-06-12T02:35:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4579000000000001e-05 2020-06-12T02:35:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628674+0000", 2020-06-12T02:35:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.799e-06 2020-06-12T02:35:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628683+0000", 2020-06-12T02:35:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6310999999999998e-05 2020-06-12T02:35:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628730+0000", 2020-06-12T02:35:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116628 2020-06-12T02:35:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628846+0000", 2020-06-12T02:35:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001487211 2020-06-12T02:35:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.630333+0000", 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045569649999999996 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634890+0000", 2020-06-12T02:35:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032598399999999997 2020-06-12T02:35:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.635216+0000", 2020-06-12T02:35:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1419000000000001e-05 2020-06-12T02:35:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.635298+0000", 2020-06-12T02:35:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068908299999999997 2020-06-12T02:35:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:155 1.5s0 1:ad55f8d3:::smithi14213939-39:head [setxattr _header (56) in=7b,truncate 2638666] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.86101904900000004, 2020-06-12T02:35:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0090905959999999994, 2020-06-12T02:35:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 155 2020-06-12T02:35:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5779999999999999e-05 2020-06-12T02:35:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628767+0000", 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2889999999999999e-06 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628771+0000", 2020-06-12T02:35:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1910000000000006e-06 2020-06-12T02:35:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628781+0000", 2020-06-12T02:35:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5129999999999998e-06 2020-06-12T02:35:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628785+0000", 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029422530000000001 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.631727+0000", 2020-06-12T02:35:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029156000000000001 2020-06-12T02:35:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.632019+0000", 2020-06-12T02:35:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015823090000000001 2020-06-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.633601+0000", 2020-06-12T02:35:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036863619999999999 2020-06-12T02:35:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637288+0000", 2020-06-12T02:35:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000416835 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637704+0000", 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010750400000000001 2020-06-12T02:35:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637812+0000", 2020-06-12T02:35:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0090905959999999994 2020-06-12T02:35:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:156 1.5s0 1:ad55f8d3:::smithi14213939-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.86092801299999999, 2020-06-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01245312, 2020-06-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 156 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6395999999999999e-05 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628839+0000", 2020-06-12T02:35:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8310000000000003e-06 2020-06-12T02:35:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628843+0000", 2020-06-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2210000000000003e-06 2020-06-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628852+0000", 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.604e-06 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628854+0000", 2020-06-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058571650000000001 2020-06-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634712+0000", 2020-06-12T02:35:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2899999999999997e-05 2020-06-12T02:35:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634784+0000", 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035095019999999998 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.638294+0000", 2020-06-12T02:35:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046368400000000001 2020-06-12T02:35:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.638758+0000", 2020-06-12T02:35:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025078169999999999 2020-06-12T02:35:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.641265+0000", 2020-06-12T02:35:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01245312 2020-06-12T02:35:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:181 1.ds0 1:bb6dbdab:::smithi14213939-46:head [write 756315~767970,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.76180192800000002, 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092224190000000008, 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 181 2020-06-12T02:35:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035021599999999998 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728289+0000", 2020-06-12T02:35:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0243e-05 2020-06-12T02:35:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728299+0000", 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7340999999999999e-05 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728316+0000", 2020-06-12T02:35:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0406e-05 2020-06-12T02:35:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728327+0000", 2020-06-12T02:35:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6210000000000005e-05 2020-06-12T02:35:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728393+0000", 2020-06-12T02:35:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020636299999999999 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728599+0000", 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0016753689999999999 2020-06-12T02:35:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.730275+0000", 2020-06-12T02:35:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034489989999999999 2020-06-12T02:35:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733724+0000", 2020-06-12T02:35:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031888139999999999 2020-06-12T02:35:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736912+0000", 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024845800000000001 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737161+0000", 2020-06-12T02:35:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092224190000000008 2020-06-12T02:35:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:182 1.ds0 1:bb6dbdab:::smithi14213939-46:head [write 1933572~791670] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.75445226499999996, 2020-06-12T02:35:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012461573, 2020-06-12T02:35:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 182 2020-06-12T02:35:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041378600000000003 2020-06-12T02:35:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735702+0000", 2020-06-12T02:35:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5549999999999999e-06 2020-06-12T02:35:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735708+0000", 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5680000000000005e-06 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735718+0000", 2020-06-12T02:35:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4590000000000001e-06 2020-06-12T02:35:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735725+0000", 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9313000000000001e-05 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735765+0000", 2020-06-12T02:35:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8070000000000001e-05 2020-06-12T02:35:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735863+0000", 2020-06-12T02:35:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018879039999999999 2020-06-12T02:35:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737751+0000", 2020-06-12T02:35:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114169 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737865+0000", 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012543020000000001 2020-06-12T02:35:29.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.739119+0000", 2020-06-12T02:35:29.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045317939999999996 2020-06-12T02:35:29.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743651+0000", 2020-06-12T02:35:29.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039882140000000003 2020-06-12T02:35:29.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747639+0000", 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110439 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747750+0000", 2020-06-12T02:35:29.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012461573 2020-06-12T02:35:29.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.735 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:183 1.ds0 1:bb6dbdab:::smithi14213939-46:head [setxattr _header (56) in=7b,truncate 2756315] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:29.736 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.753981024, 2020-06-12T02:35:29.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012270312, 2020-06-12T02:35:29.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:29.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.738 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.738 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 183 2020-06-12T02:35:29.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.738 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:29.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0630000000000002e-05 2020-06-12T02:35:29.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735800+0000", 2020-06-12T02:35:29.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:35:29.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735804+0000", 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4160000000000001e-06 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735810+0000", 2020-06-12T02:35:29.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3170000000000002e-06 2020-06-12T02:35:29.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735813+0000", 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9417e-05 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735913+0000", 2020-06-12T02:35:29.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020714999999999999 2020-06-12T02:35:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736120+0000", 2020-06-12T02:35:29.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040667250000000002 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740187+0000", 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143969 2020-06-12T02:35:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740331+0000", 2020-06-12T02:35:29.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064127699999999999 2020-06-12T02:35:29.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740972+0000", 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002884696 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743857+0000", 2020-06-12T02:35:29.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040699050000000004 2020-06-12T02:35:29.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:29.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747927+0000", 2020-06-12T02:35:29.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103037 2020-06-12T02:35:29.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748030+0000", 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012270312 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.752 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:184 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:29.752 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:29.752 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.753900248, 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014384129000000001, 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:29.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:29.754 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 184 2020-06-12T02:35:29.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.754 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:29.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3234000000000002e-05 2020-06-12T02:35:29.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735863+0000", 2020-06-12T02:35:29.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3569999999999998e-06 2020-06-12T02:35:29.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735867+0000", 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.934e-06 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735874+0000", 2020-06-12T02:35:29.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3779999999999999e-06 2020-06-12T02:35:29.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735876+0000", 2020-06-12T02:35:29.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028229200000000001 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736158+0000", 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6572999999999999e-05 2020-06-12T02:35:29.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736245+0000", 2020-06-12T02:35:29.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072511590000000001 2020-06-12T02:35:29.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743496+0000", 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5433000000000006e-05 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:29.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743591+0000", 2020-06-12T02:35:29.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048337859999999996 2020-06-12T02:35:29.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748425+0000", 2020-06-12T02:35:29.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2206999999999995e-05 2020-06-12T02:35:29.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748497+0000", 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001726776 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.750224+0000", 2020-06-12T02:35:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014384129000000001 2020-06-12T02:35:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.ds0 21/18 ECSubWriteReply(tid=65, last_complete=21'19, committed=1, applied=1))", 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.738360+0000", 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.75138067600000003, 2020-06-12T02:35:29.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050679669999999996, 2020-06-12T02:35:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738360+0000", 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738360+0000", 2020-06-12T02:35:29.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1529000000000002e-05 2020-06-12T02:35:29.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738401+0000", 2020-06-12T02:35:29.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.097e-06 2020-06-12T02:35:29.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738408+0000", 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0804e-05 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738419+0000", 2020-06-12T02:35:29.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4550000000000003e-06 2020-06-12T02:35:29.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.738425+0000", 2020-06-12T02:35:29.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004987699 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743412+0000", 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5383000000000002e-05 2020-06-12T02:35:29.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743428+0000", 2020-06-12T02:35:29.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050679669999999996 2020-06-12T02:35:29.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.3s2 21/18 ECSubWrite(tid=49, reqid=client.4555.0:198, at_version=21'17, trim_to=0'0, roll_forward_to=21'16))", 2020-06-12T02:35:29.776 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.798796+0000", 2020-06-12T02:35:29.777 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.69094407199999996, 2020-06-12T02:35:29.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053248009999999997, 2020-06-12T02:35:29.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:29.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:29.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.798796+0000", 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:29.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.798796+0000", 2020-06-12T02:35:29.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001114924 2020-06-12T02:35:29.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.799911+0000", 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6650000000000001e-05 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:29.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.799938+0000", 2020-06-12T02:35:29.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.99e-05 2020-06-12T02:35:29.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:29.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.799988+0000", 2020-06-12T02:35:29.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.876e-06 2020-06-12T02:35:29.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.799998+0000", 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4703999999999998e-05 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:29.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.800042+0000", 2020-06-12T02:35:29.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2791e-05 2020-06-12T02:35:29.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:29.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.800055+0000", 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040118380000000002 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.804067+0000", 2020-06-12T02:35:29.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4117999999999999e-05 2020-06-12T02:35:29.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:29.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:29.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:29.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.804121+0000", 2020-06-12T02:35:29.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053248009999999997 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:29.787 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:29.789 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:29.790 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:29.788+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:29.892 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:29.891+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:29.949 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:29.951 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:29.951 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:29.951 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:29.960 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:29.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:29.995+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:30.057 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:30.057 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:30.058 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:30.058 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:30.058 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:30.066 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:30.094 INFO:tasks.rados.rados.0.smithi142.stdout:52: done (0 left) 2020-06-12T02:35:30.094 INFO:tasks.rados.rados.0.smithi142.stdout:53: read oid 30 snap -1 2020-06-12T02:35:30.094 INFO:tasks.rados.rados.0.smithi142.stdout:53: expect (ObjNum 29 snap 0 seq_num 29) 2020-06-12T02:35:30.094 INFO:tasks.rados.rados.0.smithi142.stdout:54: copy_from oid 9 from oid 29 current snap is 2 2020-06-12T02:35:30.095 INFO:tasks.rados.rados.0.smithi142.stdout:55: write oid 47 current snap is 2 2020-06-12T02:35:30.095 INFO:tasks.rados.rados.0.smithi142.stdout:55: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2020-06-12T02:35:30.095 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:30.095+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:30.104 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:35:30.105 INFO:tasks.rados.rados.0.smithi142.stdout:55: writing smithi14213939-47 from 440350 to 900918 tid 1 2020-06-12T02:35:30.111 INFO:tasks.rados.rados.0.smithi142.stdout:55: writing smithi14213939-47 from 1309629 to 1852295 tid 2 2020-06-12T02:35:30.118 INFO:tasks.rados.rados.0.smithi142.stdout:55: writing smithi14213939-47 from 2323973 to 2840350 tid 3 2020-06-12T02:35:30.118 INFO:tasks.rados.rados.0.smithi142.stdout:56: rollback oid 1 current snap is 2 2020-06-12T02:35:30.119 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 1 to 0 2020-06-12T02:35:30.119 INFO:tasks.rados.rados.0.smithi142.stdout:57: snap_create 2020-06-12T02:35:30.121 INFO:tasks.rados.rados.0.smithi142.stdout:53: expect (ObjNum 29 snap 0 seq_num 29) 2020-06-12T02:35:30.185 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:189 1.1s0 1:82c302db:::smithi14213939-48:head [write 789929~634821,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4271294430000001, 2020-06-12T02:35:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002, 2020-06-12T02:35:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2020-06-12T02:35:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023093300000000001 2020-06-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759588+0000", 2020-06-12T02:35:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4509999999999997e-06 2020-06-12T02:35:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759595+0000", 2020-06-12T02:35:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7010000000000008e-06 2020-06-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759604+0000", 2020-06-12T02:35:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1289999999999998e-06 2020-06-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759611+0000", 2020-06-12T02:35:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3968999999999997e-05 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759675+0000", 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021891900000000001 2020-06-12T02:35:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759894+0000", 2020-06-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001270703 2020-06-12T02:35:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.761165+0000", 2020-06-12T02:35:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00150369 2020-06-12T02:35:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.762669+0000", 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043003470000000004 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766969+0000", 2020-06-12T02:35:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5901999999999993e-05 2020-06-12T02:35:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767035+0000", 2020-06-12T02:35:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002 2020-06-12T02:35:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=24, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.766255+0000", 2020-06-12T02:35:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.420231649, 2020-06-12T02:35:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001931, 2020-06-12T02:35:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766255+0000", 2020-06-12T02:35:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766255+0000", 2020-06-12T02:35:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7335000000000002e-05 2020-06-12T02:35:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766352+0000", 2020-06-12T02:35:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4270999999999999e-05 2020-06-12T02:35:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766367+0000", 2020-06-12T02:35:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3402999999999999e-05 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766390+0000", 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0944000000000001e-05 2020-06-12T02:35:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766401+0000", 2020-06-12T02:35:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6032999999999999e-05 2020-06-12T02:35:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766437+0000", 2020-06-12T02:35:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1114000000000001e-05 2020-06-12T02:35:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766448+0000", 2020-06-12T02:35:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001931 2020-06-12T02:35:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=24, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.419696219, 2020-06-12T02:35:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061191200000000005, 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3546e-05 2020-06-12T02:35:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766824+0000", 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9850000000000003e-06 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766830+0000", 2020-06-12T02:35:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9080000000000001e-06 2020-06-12T02:35:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766839+0000", 2020-06-12T02:35:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2270000000000004e-06 2020-06-12T02:35:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766843+0000", 2020-06-12T02:35:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8799999999999999e-05 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766902+0000", 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050044599999999999 2020-06-12T02:35:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767402+0000", 2020-06-12T02:35:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061191200000000005 2020-06-12T02:35:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:190 1.1s0 1:82c302db:::smithi14213939-48:head [write 2050536~739393] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.419240719, 2020-06-12T02:35:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429, 2020-06-12T02:35:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 190 2020-06-12T02:35:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029680499999999997 2020-06-12T02:35:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767543+0000", 2020-06-12T02:35:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5650000000000007e-06 2020-06-12T02:35:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767552+0000", 2020-06-12T02:35:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3889000000000001e-05 2020-06-12T02:35:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767576+0000", 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9229999999999997e-06 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767586+0000", 2020-06-12T02:35:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2401999999999997e-05 2020-06-12T02:35:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767639+0000", 2020-06-12T02:35:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015624000000000001 2020-06-12T02:35:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767795+0000", 2020-06-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001732513 2020-06-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769527+0000", 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033399290000000002 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772867+0000", 2020-06-12T02:35:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022057689999999998 2020-06-12T02:35:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775073+0000", 2020-06-12T02:35:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6394000000000001e-05 2020-06-12T02:35:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775149+0000", 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:191 1.1s0 1:82c302db:::smithi14213939-48:head [setxattr _header (56) in=7b,truncate 2789929] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.418853192, 2020-06-12T02:35:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997, 2020-06-12T02:35:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 191 2020-06-12T02:35:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0799999999999998e-05 2020-06-12T02:35:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767724+0000", 2020-06-12T02:35:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8809999999999996e-06 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767732+0000", 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2539e-05 2020-06-12T02:35:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767745+0000", 2020-06-12T02:35:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3629999999999996e-06 2020-06-12T02:35:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767752+0000", 2020-06-12T02:35:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036784539999999998 2020-06-12T02:35:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771431+0000", 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109088 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771540+0000", 2020-06-12T02:35:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075071299999999997 2020-06-12T02:35:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772290+0000", 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00092961699999999999 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773220+0000", 2020-06-12T02:35:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025830850000000002 2020-06-12T02:35:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775803+0000", 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170428 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775973+0000", 2020-06-12T02:35:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997 2020-06-12T02:35:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:192 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.418698888, 2020-06-12T02:35:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999, 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 192 2020-06-12T02:35:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:35:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767818+0000", 2020-06-12T02:35:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6110000000000004e-06 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767822+0000", 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8060000000000006e-06 2020-06-12T02:35:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767832+0000", 2020-06-12T02:35:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3510000000000004e-06 2020-06-12T02:35:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767836+0000", 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050647340000000004 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772901+0000", 2020-06-12T02:35:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109873 2020-06-12T02:35:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773011+0000", 2020-06-12T02:35:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035580400000000002 2020-06-12T02:35:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776569+0000", 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6688999999999996e-05 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776656+0000", 2020-06-12T02:35:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001371709 2020-06-12T02:35:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778027+0000", 2020-06-12T02:35:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999 2020-06-12T02:35:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=25, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.417593828, 2020-06-12T02:35:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038996019999999998, 2020-06-12T02:35:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0754000000000006e-05 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768974+0000", 2020-06-12T02:35:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1004e-05 2020-06-12T02:35:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768985+0000", 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1078999999999999e-05 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769006+0000", 2020-06-12T02:35:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6809999999999998e-06 2020-06-12T02:35:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769013+0000", 2020-06-12T02:35:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037642629999999999 2020-06-12T02:35:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772778+0000", 2020-06-12T02:35:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4820999999999999e-05 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772792+0000", 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038996019999999998 2020-06-12T02:35:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=25, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4170340880000001, 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034158930000000001, 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9397999999999998e-05 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769492+0000", 2020-06-12T02:35:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5809999999999999e-06 2020-06-12T02:35:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769500+0000", 2020-06-12T02:35:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2683999999999999e-05 2020-06-12T02:35:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769512+0000", 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5160000000000002e-06 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769518+0000", 2020-06-12T02:35:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033130910000000002 2020-06-12T02:35:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772831+0000", 2020-06-12T02:35:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7623000000000002e-05 2020-06-12T02:35:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772868+0000", 2020-06-12T02:35:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034158930000000001 2020-06-12T02:35:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=26, last_complete=21'2, committed=1, applied=1))", 2020-06-12T02:35:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.773964+0000", 2020-06-12T02:35:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4125227359999999, 2020-06-12T02:35:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000108786, 2020-06-12T02:35:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773964+0000", 2020-06-12T02:35:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773964+0000", 2020-06-12T02:35:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9153999999999998e-05 2020-06-12T02:35:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774003+0000", 2020-06-12T02:35:30.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8530000000000003e-06 2020-06-12T02:35:30.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774010+0000", 2020-06-12T02:35:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0784e-05 2020-06-12T02:35:30.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774021+0000", 2020-06-12T02:35:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2390000000000002e-06 2020-06-12T02:35:30.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774026+0000", 2020-06-12T02:35:30.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6627e-05 2020-06-12T02:35:30.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774063+0000", 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0129000000000001e-05 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774073+0000", 2020-06-12T02:35:30.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000108786 2020-06-12T02:35:30.316 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.316 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.317 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=27, last_complete=21'3, committed=1, applied=1))", 2020-06-12T02:35:30.317 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.774735+0000", 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4117520800000001, 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106952, 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774735+0000", 2020-06-12T02:35:30.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774735+0000", 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7746000000000001e-05 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774772+0000", 2020-06-12T02:35:30.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5659999999999997e-06 2020-06-12T02:35:30.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774778+0000", 2020-06-12T02:35:30.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:35:30.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774787+0000", 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8550000000000004e-06 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774791+0000", 2020-06-12T02:35:30.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9279000000000001e-05 2020-06-12T02:35:30.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774830+0000", 2020-06-12T02:35:30.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1191e-05 2020-06-12T02:35:30.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774842+0000", 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106952 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.327 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=26, last_complete=21'2, committed=1, applied=1))", 2020-06-12T02:35:30.327 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.774893+0000", 2020-06-12T02:35:30.327 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.411593469, 2020-06-12T02:35:30.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026786099999999999, 2020-06-12T02:35:30.327 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774893+0000", 2020-06-12T02:35:30.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774893+0000", 2020-06-12T02:35:30.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4016e-05 2020-06-12T02:35:30.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774937+0000", 2020-06-12T02:35:30.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.746e-06 2020-06-12T02:35:30.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774945+0000", 2020-06-12T02:35:30.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2544999999999999e-05 2020-06-12T02:35:30.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774958+0000", 2020-06-12T02:35:30.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3469999999999998e-06 2020-06-12T02:35:30.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774963+0000", 2020-06-12T02:35:30.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7494000000000001e-05 2020-06-12T02:35:30.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.774990+0000", 2020-06-12T02:35:30.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017071299999999999 2020-06-12T02:35:30.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775161+0000", 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026786099999999999 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.337 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=27, last_complete=21'3, committed=1, applied=1))", 2020-06-12T02:35:30.337 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:30.337 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.411029922, 2020-06-12T02:35:30.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010889020000000001, 2020-06-12T02:35:30.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.338 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.338 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:30.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0878999999999995e-05 2020-06-12T02:35:30.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775548+0000", 2020-06-12T02:35:30.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3131e-05 2020-06-12T02:35:30.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775561+0000", 2020-06-12T02:35:30.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2762e-05 2020-06-12T02:35:30.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775584+0000", 2020-06-12T02:35:30.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0137e-05 2020-06-12T02:35:30.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775594+0000", 2020-06-12T02:35:30.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1502999999999998e-05 2020-06-12T02:35:30.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775645+0000", 2020-06-12T02:35:30.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090048999999999999 2020-06-12T02:35:30.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776546+0000", 2020-06-12T02:35:30.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010889020000000001 2020-06-12T02:35:30.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpRead(1.1s0 21/18 ECSubRead(tid=29, to_read={1:82c302db:::smithi14213939-48:head=0,4096,0}, subchunks={1:82c302db:::smithi14213939-48:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:30.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.776781+0000", 2020-06-12T02:35:30.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4097052569999999, 2020-06-12T02:35:30.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034299100000000001, 2020-06-12T02:35:30.353 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.353 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.353 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776781+0000", 2020-06-12T02:35:30.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776781+0000", 2020-06-12T02:35:30.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776781+0000", 2020-06-12T02:35:30.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776781+0000", 2020-06-12T02:35:30.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4409999999999998e-05 2020-06-12T02:35:30.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776816+0000", 2020-06-12T02:35:30.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3550000000000005e-06 2020-06-12T02:35:30.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776824+0000", 2020-06-12T02:35:30.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3226000000000007e-05 2020-06-12T02:35:30.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776897+0000", 2020-06-12T02:35:30.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022699999999999999 2020-06-12T02:35:30.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777124+0000", 2020-06-12T02:35:30.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034299100000000001 2020-06-12T02:35:30.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.364 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.365 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpReadReply(1.1s0 21/18 ECSubReadReply(tid=29, attrs_read=0))", 2020-06-12T02:35:30.365 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.777117+0000", 2020-06-12T02:35:30.365 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4093694329999999, 2020-06-12T02:35:30.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6954999999999997e-05, 2020-06-12T02:35:30.366 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.366 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.366 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777117+0000", 2020-06-12T02:35:30.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777117+0000", 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777117+0000", 2020-06-12T02:35:30.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777117+0000", 2020-06-12T02:35:30.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3896e-05 2020-06-12T02:35:30.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777131+0000", 2020-06-12T02:35:30.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7309999999999998e-06 2020-06-12T02:35:30.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777137+0000", 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1344999999999999e-05 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777168+0000", 2020-06-12T02:35:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5982999999999998e-05 2020-06-12T02:35:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777204+0000", 2020-06-12T02:35:30.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6954999999999997e-05 2020-06-12T02:35:30.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.374 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpReadReply(1.1s0 21/18 ECSubReadReply(tid=29, attrs_read=0))", 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.777763+0000", 2020-06-12T02:35:30.375 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4087241909999999, 2020-06-12T02:35:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029101499999999999, 2020-06-12T02:35:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777763+0000", 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777763+0000", 2020-06-12T02:35:30.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:35:30.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777805+0000", 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3030000000000005e-06 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777814+0000", 2020-06-12T02:35:30.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3193000000000001e-05 2020-06-12T02:35:30.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777827+0000", 2020-06-12T02:35:30.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4440000000000001e-06 2020-06-12T02:35:30.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777831+0000", 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1068999999999997e-05 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777863+0000", 2020-06-12T02:35:30.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019096 2020-06-12T02:35:30.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778054+0000", 2020-06-12T02:35:30.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029101499999999999 2020-06-12T02:35:30.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=28, last_complete=21'3, committed=1, applied=1))", 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.777988+0000", 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4084983069999999, 2020-06-12T02:35:30.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854999999999999, 2020-06-12T02:35:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777988+0000", 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.777988+0000", 2020-06-12T02:35:30.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0330000000000002e-05 2020-06-12T02:35:30.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778029+0000", 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1070000000000001e-06 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778035+0000", 2020-06-12T02:35:30.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.732e-05 2020-06-12T02:35:30.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778052+0000", 2020-06-12T02:35:30.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9639999999999997e-06 2020-06-12T02:35:30.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778059+0000", 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7277000000000002e-05 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778096+0000", 2020-06-12T02:35:30.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0552e-05 2020-06-12T02:35:30.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778107+0000", 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854999999999999 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.395 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=28, last_complete=21'3, committed=1, applied=1))", 2020-06-12T02:35:30.395 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.778518+0000", 2020-06-12T02:35:30.395 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4079685609999999, 2020-06-12T02:35:30.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013408300000000001, 2020-06-12T02:35:30.395 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778518+0000", 2020-06-12T02:35:30.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:30.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:30.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778518+0000", 2020-06-12T02:35:30.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8832999999999999e-05 2020-06-12T02:35:30.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:30.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778557+0000", 2020-06-12T02:35:30.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3729999999999993e-06 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778565+0000", 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2751e-05 2020-06-12T02:35:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778578+0000", 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7720000000000002e-06 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778583+0000", 2020-06-12T02:35:30.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4793999999999999e-05 2020-06-12T02:35:30.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:30.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778618+0000", 2020-06-12T02:35:30.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4560000000000001e-05 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778652+0000", 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013408300000000001 2020-06-12T02:35:30.403 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:30.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:30.404 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:30.406 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:30.407 INFO:tasks.rados.rados.0.smithi142.stdout:55: finishing write tid 1 to smithi14213939-47 2020-06-12T02:35:30.407 INFO:tasks.rados.rados.0.smithi142.stdout:54: finishing copy_from to smithi14213939-9 2020-06-12T02:35:30.407 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 9 v 12 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-06-12T02:35:30.408 INFO:tasks.rados.rados.0.smithi142.stdout:54: finishing copy_from racing read to smithi14213939-9 2020-06-12T02:35:30.408 INFO:tasks.rados.rados.0.smithi142.stdout:56: finishing rollback tid 0 to smithi14213939-1 2020-06-12T02:35:30.408 INFO:tasks.rados.rados.0.smithi142.stdout:56: finishing rollback tid 1 to smithi14213939-1 2020-06-12T02:35:30.408 INFO:tasks.rados.rados.0.smithi142.stdout:56: finishing rollback tid 2 to smithi14213939-1 2020-06-12T02:35:30.408 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 1 v 7 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:55: finishing write tid 2 to smithi14213939-47 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:55: finishing write tid 3 to smithi14213939-47 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:55: finishing write tid 5 to smithi14213939-47 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:55: finishing write tid 6 to smithi14213939-47 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 19 (ObjNum 50 snap 2 seq_num 50) dirty exists 2020-06-12T02:35:30.409 INFO:tasks.rados.rados.0.smithi142.stdout:55: left oid 47 (ObjNum 50 snap 2 seq_num 50) 2020-06-12T02:35:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:30.200+0000 7f69db715700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:30.410 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:30.212+0000 7f69da4b3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:30.410 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:30.404+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:30.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:30.507+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:30.524 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:30.525 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:30.534 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:30.625 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:30.627+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:30.690 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:30.691 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:30.691 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:30.691 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:30.691 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:30.700 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:30.741 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:30.743+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:30.816 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:30.812+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:30.856 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:30.856 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:30.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:30.857 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:30.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.857 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:197 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 423543~785319,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.857 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:30.858 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.0684979320000001, 2020-06-12T02:35:30.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994, 2020-06-12T02:35:30.858 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.858 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:30.859 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:30.859 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.859 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 197 2020-06-12T02:35:30.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.860 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:30.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:30.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001251102 2020-06-12T02:35:30.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788888+0000", 2020-06-12T02:35:30.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2089999999999994e-06 2020-06-12T02:35:30.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788897+0000", 2020-06-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6551000000000001e-05 2020-06-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788914+0000", 2020-06-12T02:35:30.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:35:30.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788920+0000", 2020-06-12T02:35:30.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4307000000000002e-05 2020-06-12T02:35:30.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788955+0000", 2020-06-12T02:35:30.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017733199999999999 2020-06-12T02:35:30.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:30.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.789132+0000", 2020-06-12T02:35:30.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018899590000000001 2020-06-12T02:35:30.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.791022+0000", 2020-06-12T02:35:30.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025592739999999998 2020-06-12T02:35:30.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.793581+0000", 2020-06-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020861529999999999 2020-06-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795667+0000", 2020-06-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8508000000000001e-05 2020-06-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795746+0000", 2020-06-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994 2020-06-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.877 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:198 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 1767500~799008] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.877 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:30.877 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.060335689, 2020-06-12T02:35:30.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782, 2020-06-12T02:35:30.878 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.878 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.878 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 198 2020-06-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:30.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:30.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099562999999999995 2020-06-12T02:35:30.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796795+0000", 2020-06-12T02:35:30.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1195e-05 2020-06-12T02:35:30.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796806+0000", 2020-06-12T02:35:30.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4831e-05 2020-06-12T02:35:30.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796831+0000", 2020-06-12T02:35:30.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3913e-05 2020-06-12T02:35:30.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796844+0000", 2020-06-12T02:35:30.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5038999999999999e-05 2020-06-12T02:35:30.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796909+0000", 2020-06-12T02:35:30.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000111087 2020-06-12T02:35:30.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:30.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797021+0000", 2020-06-12T02:35:30.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014743670000000001 2020-06-12T02:35:30.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.798495+0000", 2020-06-12T02:35:30.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029768920000000001 2020-06-12T02:35:30.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801472+0000", 2020-06-12T02:35:30.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037560470000000002 2020-06-12T02:35:30.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:30.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805228+0000", 2020-06-12T02:35:30.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0780999999999999e-05 2020-06-12T02:35:30.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805299+0000", 2020-06-12T02:35:30.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782 2020-06-12T02:35:30.895 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.895 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.896 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.896 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:199 1.3s0 1:cff5b50f:::smithi14213939-50:head [setxattr _header (56) in=7b,truncate 2823543] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:30.896 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.0592073059999998, 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995, 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:30.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:30.898 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.898 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 199 2020-06-12T02:35:30.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.898 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:30.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:30.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106302 2020-06-12T02:35:30.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797034+0000", 2020-06-12T02:35:30.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0084e-05 2020-06-12T02:35:30.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797044+0000", 2020-06-12T02:35:30.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7399999999999999e-05 2020-06-12T02:35:30.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797061+0000", 2020-06-12T02:35:30.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0890000000000002e-06 2020-06-12T02:35:30.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797068+0000", 2020-06-12T02:35:30.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027601829999999998 2020-06-12T02:35:30.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799828+0000", 2020-06-12T02:35:30.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121823 2020-06-12T02:35:30.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:30.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799950+0000", 2020-06-12T02:35:30.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074876700000000001 2020-06-12T02:35:30.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:30.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.800699+0000", 2020-06-12T02:35:30.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028159669999999999 2020-06-12T02:35:30.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:30.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.803515+0000", 2020-06-12T02:35:30.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019210270000000001 2020-06-12T02:35:30.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:30.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805436+0000", 2020-06-12T02:35:30.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9416000000000001e-05 2020-06-12T02:35:30.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805505+0000", 2020-06-12T02:35:30.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995 2020-06-12T02:35:30.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.919 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.920 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:200 1.3s0 1:cff5b50f:::smithi14213939-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:30.920 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:30.920 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.0590022609999998, 2020-06-12T02:35:30.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427, 2020-06-12T02:35:30.920 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.921 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:30.921 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:30.922 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:30.922 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:30.922 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 200 2020-06-12T02:35:30.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.924 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:30.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:30.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1226e-05 2020-06-12T02:35:30.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797194+0000", 2020-06-12T02:35:30.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0248000000000001e-05 2020-06-12T02:35:30.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797204+0000", 2020-06-12T02:35:30.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7323e-05 2020-06-12T02:35:30.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797221+0000", 2020-06-12T02:35:30.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0959999999999997e-06 2020-06-12T02:35:30.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797227+0000", 2020-06-12T02:35:30.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004271403 2020-06-12T02:35:30.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801499+0000", 2020-06-12T02:35:30.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0492000000000001e-05 2020-06-12T02:35:30.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801579+0000", 2020-06-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004303973 2020-06-12T02:35:30.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805883+0000", 2020-06-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6344000000000001e-05 2020-06-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805939+0000", 2020-06-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016273220000000001 2020-06-12T02:35:30.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.807567+0000", 2020-06-12T02:35:30.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427 2020-06-12T02:35:30.942 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.942 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.943 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.944 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWriteReply(1.3s0 21/18 ECSubWriteReply(tid=48, last_complete=21'16, committed=1, applied=1))", 2020-06-12T02:35:30.944 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797774+0000", 2020-06-12T02:35:30.944 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.058360295, 2020-06-12T02:35:30.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036492999999999999, 2020-06-12T02:35:30.945 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.945 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.946 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797774+0000", 2020-06-12T02:35:30.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797774+0000", 2020-06-12T02:35:30.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8591999999999999e-05 2020-06-12T02:35:30.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797813+0000", 2020-06-12T02:35:30.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4860000000000002e-06 2020-06-12T02:35:30.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797819+0000", 2020-06-12T02:35:30.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2675e-05 2020-06-12T02:35:30.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797832+0000", 2020-06-12T02:35:30.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4161e-05 2020-06-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797846+0000", 2020-06-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035571629999999999 2020-06-12T02:35:30.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801403+0000", 2020-06-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0222999999999999e-05 2020-06-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801424+0000", 2020-06-12T02:35:30.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036492999999999999 2020-06-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.960 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWriteReply(1.3s0 21/18 ECSubWriteReply(tid=48, last_complete=21'16, committed=1, applied=1))", 2020-06-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797932+0000", 2020-06-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.0582026959999999, 2020-06-12T02:35:30.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035410900000000002, 2020-06-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.962 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797932+0000", 2020-06-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797932+0000", 2020-06-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9295999999999998e-05 2020-06-12T02:35:30.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797971+0000", 2020-06-12T02:35:30.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2650000000000004e-06 2020-06-12T02:35:30.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797976+0000", 2020-06-12T02:35:30.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7960000000000001e-06 2020-06-12T02:35:30.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797985+0000", 2020-06-12T02:35:30.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2579999999999998e-06 2020-06-12T02:35:30.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797992+0000", 2020-06-12T02:35:30.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003451188 2020-06-12T02:35:30.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801444+0000", 2020-06-12T02:35:30.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9286999999999999e-05 2020-06-12T02:35:30.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801473+0000", 2020-06-12T02:35:30.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035410900000000002 2020-06-12T02:35:30.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.977 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.2s1 23/18 ECSubRead(tid=24, to_read={1:40342bec:::smithi14213939-47:head=217088,4096,0,446464,4096,0}, subchunks={1:40342bec:::smithi14213939-47:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:30.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.111133+0000", 2020-06-12T02:35:30.978 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.74500171599999998, 2020-06-12T02:35:30.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00096904499999999998, 2020-06-12T02:35:30.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111133+0000", 2020-06-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111133+0000", 2020-06-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8812000000000003e-05 2020-06-12T02:35:30.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111222+0000", 2020-06-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9667999999999999e-05 2020-06-12T02:35:30.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111241+0000", 2020-06-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5551e-05 2020-06-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111267+0000", 2020-06-12T02:35:30.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4416000000000001e-05 2020-06-12T02:35:30.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111281+0000", 2020-06-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010401800000000001 2020-06-12T02:35:30.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111385+0000", 2020-06-12T02:35:30.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071657999999999997 2020-06-12T02:35:30.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:30.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.112102+0000", 2020-06-12T02:35:30.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00096904499999999998 2020-06-12T02:35:30.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.993 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:30.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:30.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.994 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=23, reqid=client.4555.0:208, at_version=23'14, trim_to=0'0, roll_forward_to=21'12))", 2020-06-12T02:35:30.994 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.114813+0000", 2020-06-12T02:35:30.994 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.741322013, 2020-06-12T02:35:30.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037622659999999998, 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:30.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.114813+0000", 2020-06-12T02:35:30.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:30.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:30.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.114813+0000", 2020-06-12T02:35:30.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035927499999999999 2020-06-12T02:35:30.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:30.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115172+0000", 2020-06-12T02:35:30.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6829999999999997e-05 2020-06-12T02:35:30.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:30.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115219+0000", 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.915e-05 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115248+0000", 2020-06-12T02:35:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4127e-05 2020-06-12T02:35:31.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115262+0000", 2020-06-12T02:35:31.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0734000000000003e-05 2020-06-12T02:35:31.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115343+0000", 2020-06-12T02:35:31.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3652e-05 2020-06-12T02:35:31.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.115366+0000", 2020-06-12T02:35:31.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031195979999999999 2020-06-12T02:35:31.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.118486+0000", 2020-06-12T02:35:31.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8900000000000006e-05 2020-06-12T02:35:31.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.118575+0000", 2020-06-12T02:35:31.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037622659999999998 2020-06-12T02:35:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.006 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=25, reqid=client.4555.0:206, at_version=23'16, trim_to=0'0, roll_forward_to=21'12))", 2020-06-12T02:35:31.006 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:31.006 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.73484712399999996, 2020-06-12T02:35:31.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431, 2020-06-12T02:35:31.006 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.007 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.007 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:31.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017964389999999999 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123084+0000", 2020-06-12T02:35:31.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8554000000000002e-05 2020-06-12T02:35:31.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123142+0000", 2020-06-12T02:35:31.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4759999999999999e-05 2020-06-12T02:35:31.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123177+0000", 2020-06-12T02:35:31.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8295999999999999e-05 2020-06-12T02:35:31.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123196+0000", 2020-06-12T02:35:31.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3685999999999997e-05 2020-06-12T02:35:31.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123289+0000", 2020-06-12T02:35:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6406000000000001e-05 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123316+0000", 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083341979999999993 2020-06-12T02:35:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131650+0000", 2020-06-12T02:35:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015409199999999999 2020-06-12T02:35:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131804+0000", 2020-06-12T02:35:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431 2020-06-12T02:35:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.72819886300000003, 2020-06-12T02:35:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574, 2020-06-12T02:35:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015987799999999999 2020-06-12T02:35:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128096+0000", 2020-06-12T02:35:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8012e-05 2020-06-12T02:35:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128154+0000", 2020-06-12T02:35:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1575000000000001e-05 2020-06-12T02:35:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128195+0000", 2020-06-12T02:35:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0976e-05 2020-06-12T02:35:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128216+0000", 2020-06-12T02:35:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138028 2020-06-12T02:35:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128354+0000", 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1136999999999997e-05 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128385+0000", 2020-06-12T02:35:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050820539999999999 2020-06-12T02:35:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133467+0000", 2020-06-12T02:35:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1913999999999998e-05 2020-06-12T02:35:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133519+0000", 2020-06-12T02:35:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574 2020-06-12T02:35:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=7, reqid=client.4555.0:214, at_version=23'6, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.72451770599999998, 2020-06-12T02:35:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845, 2020-06-12T02:35:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3839999999999997e-05 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131701+0000", 2020-06-12T02:35:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2039000000000003e-05 2020-06-12T02:35:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131733+0000", 2020-06-12T02:35:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2753999999999999e-05 2020-06-12T02:35:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131756+0000", 2020-06-12T02:35:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3559e-05 2020-06-12T02:35:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131769+0000", 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9615000000000003e-05 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131849+0000", 2020-06-12T02:35:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6756e-05 2020-06-12T02:35:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131865+0000", 2020-06-12T02:35:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052282830000000002 2020-06-12T02:35:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137094+0000", 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3998999999999995e-05 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137158+0000", 2020-06-12T02:35:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845 2020-06-12T02:35:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.723983987, 2020-06-12T02:35:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004, 2020-06-12T02:35:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104829 2020-06-12T02:35:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132255+0000", 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7648e-05 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132283+0000", 2020-06-12T02:35:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6242999999999999e-05 2020-06-12T02:35:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132309+0000", 2020-06-12T02:35:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.927e-06 2020-06-12T02:35:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132319+0000", 2020-06-12T02:35:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095454700000000003 2020-06-12T02:35:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133274+0000", 2020-06-12T02:35:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2116999999999999e-05 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133286+0000", 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046015589999999999 2020-06-12T02:35:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137887+0000", 2020-06-12T02:35:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6152999999999998e-05 2020-06-12T02:35:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137924+0000", 2020-06-12T02:35:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004 2020-06-12T02:35:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=29, reqid=client.4555.0:206, at_version=0'0, trim_to=0'0, roll_forward_to=23'16))", 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.72299603400000001, 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048139669999999997, 2020-06-12T02:35:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001028658 2020-06-12T02:35:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134167+0000", 2020-06-12T02:35:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5588999999999999e-05 2020-06-12T02:35:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134183+0000", 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7093000000000001e-05 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134200+0000", 2020-06-12T02:35:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1079999999999993e-06 2020-06-12T02:35:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134208+0000", 2020-06-12T02:35:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8622000000000002e-05 2020-06-12T02:35:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134267+0000", 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1372999999999999e-05 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134278+0000", 2020-06-12T02:35:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036337880000000002 2020-06-12T02:35:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137912+0000", 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0735999999999998e-05 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137953+0000", 2020-06-12T02:35:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048139669999999997 2020-06-12T02:35:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=9, reqid=client.4555.0:215, at_version=0'0, trim_to=0'0, roll_forward_to=23'7))", 2020-06-12T02:35:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.138488+0000", 2020-06-12T02:35:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.71764651800000001, 2020-06-12T02:35:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026732919999999999, 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138488+0000", 2020-06-12T02:35:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138488+0000", 2020-06-12T02:35:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0784000000000001e-05 2020-06-12T02:35:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138529+0000", 2020-06-12T02:35:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4698999999999999e-05 2020-06-12T02:35:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138544+0000", 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2963e-05 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138567+0000", 2020-06-12T02:35:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1097999999999999e-05 2020-06-12T02:35:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138578+0000", 2020-06-12T02:35:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899000000000001e-05 2020-06-12T02:35:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138634+0000", 2020-06-12T02:35:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4518999999999999e-05 2020-06-12T02:35:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138648+0000", 2020-06-12T02:35:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024437019999999999 2020-06-12T02:35:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.141092+0000", 2020-06-12T02:35:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9628000000000005e-05 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.141161+0000", 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026732919999999999 2020-06-12T02:35:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.2s1 23/18 ECSubRead(tid=30, to_read={1:40342bec:::smithi14213939-47:head=651264,4096,0,925696,4096,0}, subchunks={1:40342bec:::smithi14213939-47:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.140441+0000", 2020-06-12T02:35:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.71569378699999997, 2020-06-12T02:35:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042976439999999998, 2020-06-12T02:35:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140441+0000", 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140441+0000", 2020-06-12T02:35:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4668000000000001e-05 2020-06-12T02:35:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140475+0000", 2020-06-12T02:35:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0747000000000001e-05 2020-06-12T02:35:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140486+0000", 2020-06-12T02:35:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5204e-05 2020-06-12T02:35:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140501+0000", 2020-06-12T02:35:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1809999999999998e-06 2020-06-12T02:35:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140508+0000", 2020-06-12T02:35:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4613e-05 2020-06-12T02:35:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140562+0000", 2020-06-12T02:35:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041762309999999999 2020-06-12T02:35:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.144738+0000", 2020-06-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042976439999999998 2020-06-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.2s1 23/18 ECSubRead(tid=31, to_read={1:40342bec:::smithi14213939-47:head=1159168,4096,0}, subchunks={1:40342bec:::smithi14213939-47:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.71551976799999994, 2020-06-12T02:35:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044467580000000003, 2020-06-12T02:35:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2441999999999999e-05 2020-06-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140647+0000", 2020-06-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5429999999999996e-06 2020-06-12T02:35:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140655+0000", 2020-06-12T02:35:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1555e-05 2020-06-12T02:35:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140666+0000", 2020-06-12T02:35:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0039999999999999e-06 2020-06-12T02:35:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140674+0000", 2020-06-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041044219999999999 2020-06-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.144779+0000", 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028279200000000003 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.145062+0000", 2020-06-12T02:35:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044467580000000003 2020-06-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=26, reqid=client.4555.0:209, at_version=23'17, trim_to=0'0, roll_forward_to=23'14))", 2020-06-12T02:35:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.146261+0000", 2020-06-12T02:35:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.70987374299999995, 2020-06-12T02:35:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00215402, 2020-06-12T02:35:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146261+0000", 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146261+0000", 2020-06-12T02:35:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000338074 2020-06-12T02:35:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146599+0000", 2020-06-12T02:35:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7336999999999998e-05 2020-06-12T02:35:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146636+0000", 2020-06-12T02:35:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2118000000000001e-05 2020-06-12T02:35:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146658+0000", 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4416000000000001e-05 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146673+0000", 2020-06-12T02:35:31.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1335999999999997e-05 2020-06-12T02:35:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146734+0000", 2020-06-12T02:35:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6700000000000006e-06 2020-06-12T02:35:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.146744+0000", 2020-06-12T02:35:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016365220000000001 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148380+0000", 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4547e-05 2020-06-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148415+0000", 2020-06-12T02:35:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00215402 2020-06-12T02:35:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=27, reqid=client.4555.0:210, at_version=23'18, trim_to=0'0, roll_forward_to=23'14))", 2020-06-12T02:35:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.148245+0000", 2020-06-12T02:35:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.70788945000000003, 2020-06-12T02:35:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022375810000000002, 2020-06-12T02:35:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148245+0000", 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148245+0000", 2020-06-12T02:35:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039413099999999998 2020-06-12T02:35:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148639+0000", 2020-06-12T02:35:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0311000000000002e-05 2020-06-12T02:35:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148670+0000", 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1416e-05 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148691+0000", 2020-06-12T02:35:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2330000000000001e-05 2020-06-12T02:35:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148703+0000", 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4240999999999999e-05 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148748+0000", 2020-06-12T02:35:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8970000000000002e-06 2020-06-12T02:35:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.148754+0000", 2020-06-12T02:35:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016419659999999999 2020-06-12T02:35:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.150396+0000", 2020-06-12T02:35:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6289e-05 2020-06-12T02:35:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.150483+0000", 2020-06-12T02:35:31.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022375810000000002 2020-06-12T02:35:31.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.131 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=28, reqid=client.4555.0:211, at_version=23'19, trim_to=0'0, roll_forward_to=23'14))", 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.149334+0000", 2020-06-12T02:35:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.70680081400000005, 2020-06-12T02:35:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001683602, 2020-06-12T02:35:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149334+0000", 2020-06-12T02:35:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149334+0000", 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0042000000000003e-05 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149424+0000", 2020-06-12T02:35:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0062000000000001e-05 2020-06-12T02:35:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149454+0000", 2020-06-12T02:35:31.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5567000000000001e-05 2020-06-12T02:35:31.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149479+0000", 2020-06-12T02:35:31.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-06 2020-06-12T02:35:31.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149489+0000", 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010515599999999999 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149594+0000", 2020-06-12T02:35:31.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6144e-05 2020-06-12T02:35:31.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.149610+0000", 2020-06-12T02:35:31.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013591180000000001 2020-06-12T02:35:31.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.150969+0000", 2020-06-12T02:35:31.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8133999999999997e-05 2020-06-12T02:35:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.151017+0000", 2020-06-12T02:35:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001683602 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=32, reqid=client.4555.0:211, at_version=0'0, trim_to=0'0, roll_forward_to=23'19))", 2020-06-12T02:35:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.154989+0000", 2020-06-12T02:35:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.70114552799999996, 2020-06-12T02:35:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015842359999999999, 2020-06-12T02:35:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.154989+0000", 2020-06-12T02:35:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.154989+0000", 2020-06-12T02:35:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0945999999999995e-05 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155060+0000", 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0324999999999999e-05 2020-06-12T02:35:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155080+0000", 2020-06-12T02:35:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4638e-05 2020-06-12T02:35:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155105+0000", 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3274e-05 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155118+0000", 2020-06-12T02:35:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2113999999999994e-05 2020-06-12T02:35:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155190+0000", 2020-06-12T02:35:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7363999999999998e-05 2020-06-12T02:35:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.155208+0000", 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012992349999999999 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.156507+0000", 2020-06-12T02:35:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6340000000000005e-05 2020-06-12T02:35:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.156573+0000", 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015842359999999999 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:31.158 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:31.159 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:31.161 INFO:tasks.rados.rados.0.smithi142.stdout:53: done (4 left) 2020-06-12T02:35:31.161 INFO:tasks.rados.rados.0.smithi142.stdout:54: done (3 left) 2020-06-12T02:35:31.162 INFO:tasks.rados.rados.0.smithi142.stdout:55: done (2 left) 2020-06-12T02:35:31.162 INFO:tasks.rados.rados.0.smithi142.stdout:56: done (1 left) 2020-06-12T02:35:31.162 INFO:tasks.rados.rados.0.smithi142.stdout:57: done (0 left) 2020-06-12T02:35:31.163 INFO:tasks.rados.rados.0.smithi142.stdout:58: delete oid 17 current snap is 3 2020-06-12T02:35:31.163 INFO:tasks.rados.rados.0.smithi142.stdout:58: done (0 left) 2020-06-12T02:35:31.163 INFO:tasks.rados.rados.0.smithi142.stdout:59: read oid 46 snap -1 2020-06-12T02:35:31.163 INFO:tasks.rados.rados.0.smithi142.stdout:59: expect (ObjNum 45 snap 0 seq_num 45) 2020-06-12T02:35:31.163 INFO:tasks.rados.rados.0.smithi142.stdout:60: copy_from oid 48 from oid 42 current snap is 3 2020-06-12T02:35:31.164 INFO:tasks.rados.rados.0.smithi142.stdout:61: rollback oid 20 current snap is 3 2020-06-12T02:35:31.164 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 20 to 2 2020-06-12T02:35:31.164 INFO:tasks.rados.rados.0.smithi142.stdout:62: write oid 10 current snap is 3 2020-06-12T02:35:31.164 INFO:tasks.rados.rados.0.smithi142.stdout:62: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2020-06-12T02:35:31.165 INFO:tasks.rados.rados.0.smithi142.stdout:62: writing smithi14213939-10 from 473964 to 1085030 tid 1 2020-06-12T02:35:31.166 INFO:tasks.rados.rados.0.smithi142.stdout:62: writing smithi14213939-10 from 1826593 to 2372928 tid 2 2020-06-12T02:35:31.166 INFO:tasks.rados.rados.0.smithi142.stdout:62: writing smithi14213939-10 from 2778819 to 2873964 tid 3 2020-06-12T02:35:31.166 INFO:tasks.rados.rados.0.smithi142.stdout:63: snap_remove snap 0 2020-06-12T02:35:31.167 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:35:31.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:31.159+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:31.168 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:31.260 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:31.263+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:31.312 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:31.308+0000 7f79a293b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:31.316 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:31.316+0000 7f79a16d9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:31.318 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:31.318 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:31.319 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:31.328 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:31.346 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:31.361 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:31.360+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:31.369 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:31.403 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:31.415 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:31.438 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:31.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:31.461 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:31.463+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:31.483 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:31.484 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:31.484 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:31.493 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:31.508 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.511 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.512 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:31.568 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:31.568+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:31.646 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:31.647 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:31.656 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:31.663 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:31.660+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:31.733 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:31.734 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:31.734 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-06-12T02:35:31.766 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:31.767 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:31.767 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:31.767+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:31.771 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:31.852 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:31.840+0000 7f5aaf783700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:31.855 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:31.852+0000 7f5aae521700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:31.879 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:31.872+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:31.925 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:31.925 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:31.948 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:31.978 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:31.976+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:32.004 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:32.005 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:32.005 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 24, 2020-06-12T02:35:32.005 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "c120ba75-2438-45f0-aa6e-10a350976a3c", 2020-06-12T02:35:32.005 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2020-06-12T02:35:00.134323+0000", 2020-06-12T02:35:32.005 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2020-06-12T02:35:31.098759+0000", 2020-06-12T02:35:32.006 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:35:32.006 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:35:32.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-06-12T02:35:32.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5799936, 2020-06-12T02:35:32.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2020-06-12T02:35:32.007 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2020-06-12T02:35:32.007 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2020-06-12T02:35:32.008 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2020-06-12T02:35:32.008 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2020-06-12T02:35:32.008 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:32.008 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 6, 2020-06-12T02:35:32.008 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.94999998807907104, 2020-06-12T02:35:32.009 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-06-12T02:35:32.009 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.85000002384185791, 2020-06-12T02:35:32.009 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2020-06-12T02:35:32.009 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 1, 2020-06-12T02:35:32.009 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2020-06-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "jewel", 2020-06-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2020-06-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "octopus", 2020-06-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2020-06-12T02:35:32.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "unique_pool_0", 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2020-06-12T02:35:23.053307+0000", 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 8197, 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,ec_overwrites,selfmanaged_snaps", 2020-06-12T02:35:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 3, 2020-06-12T02:35:32.012 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 3, 2020-06-12T02:35:32.013 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 2, 2020-06-12T02:35:32.013 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 1, 2020-06-12T02:35:32.014 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2020-06-12T02:35:32.014 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2020-06-12T02:35:32.014 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 16, 2020-06-12T02:35:32.014 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 16, 2020-06-12T02:35:32.014 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 16, 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 16, 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 16, 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2020-06-12T02:35:32.015 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2020-06-12T02:35:32.016 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2020-06-12T02:35:32.016 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2020-06-12T02:35:32.016 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2020-06-12T02:35:32.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.016 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "24", 2020-06-12T02:35:32.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2020-06-12T02:35:32.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T02:35:32.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T02:35:32.018 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2020-06-12T02:35:32.018 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2020-06-12T02:35:32.018 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 4, 2020-06-12T02:35:32.018 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 24, 2020-06-12T02:35:32.019 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2020-06-12T02:35:32.019 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2020-06-12T02:35:32.019 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2020-06-12T02:35:32.019 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2020-06-12T02:35:32.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2020-06-12T02:35:32.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2020-06-12T02:35:32.020 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2020-06-12T02:35:32.020 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2020-06-12T02:35:32.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2020-06-12T02:35:32.021 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2020-06-12T02:35:32.024 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2020-06-12T02:35:32.024 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T02:35:32.024 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T02:35:32.025 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T02:35:32.025 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2020-06-12T02:35:32.025 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2020-06-12T02:35:32.025 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "teuthologyprofile", 2020-06-12T02:35:32.025 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2020-06-12T02:35:32.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2020-06-12T02:35:32.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.026 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2020-06-12T02:35:32.026 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2020-06-12T02:35:32.027 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2020-06-12T02:35:32.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2020-06-12T02:35:32.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2020-06-12T02:35:32.028 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T02:35:32.028 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2020-06-12T02:35:32.028 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2020-06-12T02:35:32.028 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 8192, 2020-06-12T02:35:32.028 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2020-06-12T02:35:32.029 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2020-06-12T02:35:32.029 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2020-06-12T02:35:32.029 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2020-06-12T02:35:32.029 INFO:teuthology.orchestra.run.smithi142.stdout: "rados": {} 2020-06-12T02:35:32.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.030 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:32.030 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2020-06-12T02:35:32.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.031 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:35:32.031 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c", 2020-06-12T02:35:32.031 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.031 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.032 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.032 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.032 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.032 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.032 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:32.033 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.033 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.033 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.033 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.033 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.034 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.034 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2020-06-12T02:35:32.034 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.035 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2020-06-12T02:35:32.035 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.037 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.037 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2020-06-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2020-06-12T02:35:32.039 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2020-06-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.042 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2020-06-12T02:35:32.042 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.045 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.045 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2020-06-12T02:35:32.045 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:32.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.045 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6811/12037", 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6813/12037", 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6817/12037", 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/12037", 2020-06-12T02:35:32.046 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.047 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.047 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:35:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "74343e4c-0406-4803-8619-520cbc1c60db", 2020-06-12T02:35:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.050 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:32.050 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.051 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.051 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.051 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2020-06-12T02:35:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2020-06-12T02:35:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2020-06-12T02:35:32.055 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2020-06-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2020-06-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2020-06-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2020-06-12T02:35:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2020-06-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6803/12047", 2020-06-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6805/12047", 2020-06-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6809/12047", 2020-06-12T02:35:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6807/12047", 2020-06-12T02:35:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:35:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "18348953-2ab3-44d7-9812-308a4e504ffd", 2020-06-12T02:35:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2020-06-12T02:35:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2020-06-12T02:35:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2020-06-12T02:35:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2020-06-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2020-06-12T02:35:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2020-06-12T02:35:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6819/12038", 2020-06-12T02:35:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6821/12038", 2020-06-12T02:35:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6825/12038", 2020-06-12T02:35:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6823/12038", 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:35:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "318d0252-36b6-489c-8cc7-eb5245346db4", 2020-06-12T02:35:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2020-06-12T02:35:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2020-06-12T02:35:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2020-06-12T02:35:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2020-06-12T02:35:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6832", 2020-06-12T02:35:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6833", 2020-06-12T02:35:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2020-06-12T02:35:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2020-06-12T02:35:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6827/12048", 2020-06-12T02:35:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6829/12048", 2020-06-12T02:35:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6833/12048", 2020-06-12T02:35:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6831/12048", 2020-06-12T02:35:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:35:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "e622cde1-ff3b-4df8-9e70-640bb7ce27fd", 2020-06-12T02:35:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6800", 2020-06-12T02:35:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6801", 2020-06-12T02:35:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6802", 2020-06-12T02:35:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6803", 2020-06-12T02:35:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6806", 2020-06-12T02:35:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6807", 2020-06-12T02:35:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6804", 2020-06-12T02:35:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6805", 2020-06-12T02:35:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6801/12021", 2020-06-12T02:35:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6803/12021", 2020-06-12T02:35:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6807/12021", 2020-06-12T02:35:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6805/12021", 2020-06-12T02:35:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:35:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "f7d22a59-77a8-4264-888e-3e486a4c0d82", 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 0, 2020-06-12T02:35:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6808", 2020-06-12T02:35:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6811", 2020-06-12T02:35:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6814", 2020-06-12T02:35:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6817", 2020-06-12T02:35:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6823", 2020-06-12T02:35:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6828", 2020-06-12T02:35:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6820", 2020-06-12T02:35:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6822", 2020-06-12T02:35:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6811/12020", 2020-06-12T02:35:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6817/12020", 2020-06-12T02:35:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6828/12020", 2020-06-12T02:35:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6822/12020", 2020-06-12T02:35:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:35:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "60e271cc-4c4c-4397-87be-8c52ffab68d4", 2020-06-12T02:35:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6809", 2020-06-12T02:35:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6812", 2020-06-12T02:35:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6815", 2020-06-12T02:35:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6818", 2020-06-12T02:35:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6830", 2020-06-12T02:35:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6831", 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6825", 2020-06-12T02:35:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6826", 2020-06-12T02:35:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6812/12022", 2020-06-12T02:35:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6818/12022", 2020-06-12T02:35:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6831/12022", 2020-06-12T02:35:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6826/12022", 2020-06-12T02:35:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:35:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "0f243681-edad-4e3d-9980-cfc55c5f93ab", 2020-06-12T02:35:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6810", 2020-06-12T02:35:32.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6813", 2020-06-12T02:35:32.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.158 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:32.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6816", 2020-06-12T02:35:32.159 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.160 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6819", 2020-06-12T02:35:32.160 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.161 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:32.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6827", 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6829", 2020-06-12T02:35:32.162 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.163 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:32.163 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6821", 2020-06-12T02:35:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:32.165 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6824", 2020-06-12T02:35:32.165 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:32.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.166 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6813/12023", 2020-06-12T02:35:32.166 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6819/12023", 2020-06-12T02:35:32.167 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6829/12023", 2020-06-12T02:35:32.167 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6824/12023", 2020-06-12T02:35:32.167 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:32.167 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:32.167 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.168 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:35:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.169 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.062298+0000", 2020-06-12T02:35:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.170 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:35:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.171 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.172 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.896452+0000", 2020-06-12T02:35:32.172 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.172 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:35:32.173 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.173 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.173 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.173 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.173 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.174 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.113001+0000", 2020-06-12T02:35:32.174 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.174 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:35:32.175 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.175 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.175 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.175 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.176 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.176 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.092632+0000", 2020-06-12T02:35:32.176 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.177 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:35:32.177 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.177 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.177 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.178 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.178 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.178 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.886001+0000", 2020-06-12T02:35:32.178 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:35:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.179 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.878867+0000", 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.181 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:35:32.181 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.181 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.181 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.116299+0000", 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:32.183 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:35:32.183 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:32.183 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:32.183 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:32.183 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:32.184 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:32.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.109814+0000", 2020-06-12T02:35:32.184 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:32.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.184 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:32.185 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2020-06-12T02:35:32.185 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2020-06-12T02:35:32.185 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2020-06-12T02:35:32.185 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2020-06-12T02:35:32.185 INFO:teuthology.orchestra.run.smithi142.stdout: "blacklist": {}, 2020-06-12T02:35:32.186 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2020-06-12T02:35:32.186 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2020-06-12T02:35:32.186 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:35:32.186 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:35:32.186 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2020-06-12T02:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.187 INFO:teuthology.orchestra.run.smithi142.stdout: "teuthologyprofile": { 2020-06-12T02:35:32.188 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-device-class": "", 2020-06-12T02:35:32.188 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:35:32.188 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-root": "default", 2020-06-12T02:35:32.188 INFO:teuthology.orchestra.run.smithi142.stdout: "jerasure-per-chunk-alignment": "false", 2020-06-12T02:35:32.188 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:35:32.189 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:35:32.189 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:35:32.189 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:35:32.189 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van", 2020-06-12T02:35:32.189 INFO:teuthology.orchestra.run.smithi142.stdout: "w": "8" 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [], 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2020-06-12T02:35:32.190 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2020-06-12T02:35:32.191 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {} 2020-06-12T02:35:32.191 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:32.193 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.194 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:32.191+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:32.194 INFO:tasks.rados.rados.0.smithi142.stdout:63: done (4 left) 2020-06-12T02:35:32.195 INFO:tasks.rados.rados.0.smithi142.stdout:64: write oid 2 current snap is 3 2020-06-12T02:35:32.195 INFO:tasks.rados.rados.0.smithi142.stdout:64: seq_num 53 ranges {490771=686315,1885075=406346} 2020-06-12T02:35:32.195 INFO:tasks.rados.rados.0.smithi142.stdout:64: writing smithi14213939-2 from 490771 to 1177086 tid 1 2020-06-12T02:35:32.195 INFO:tasks.rados.rados.0.smithi142.stdout:64: writing smithi14213939-2 from 1885075 to 2291421 tid 2 2020-06-12T02:35:32.195 INFO:tasks.rados.rados.0.smithi142.stdout:61: finishing rollback tid 0 to smithi14213939-20 2020-06-12T02:35:32.196 INFO:tasks.rados.rados.0.smithi142.stdout:61: finishing rollback tid 1 to smithi14213939-20 2020-06-12T02:35:32.196 INFO:tasks.rados.rados.0.smithi142.stdout:61: finishing rollback tid 2 to smithi14213939-20 2020-06-12T02:35:32.196 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 20 v 10 (ObjNum 19 snap 0 seq_num 19) dirty exists 2020-06-12T02:35:32.196 INFO:tasks.rados.rados.0.smithi142.stdout:59: expect (ObjNum 45 snap 0 seq_num 45) 2020-06-12T02:35:32.197 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:32.198 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': 'c120ba75-2438-45f0-aa6e-10a350976a3c', 'created': '2020-06-12T02:35:00.134323+0000', 'modified': '2020-06-12T02:35:31.098759+0000', 'last_up_change': '2020-06-12T02:35:08.937742+0000', 'last_in_change': '2020-06-12T02:35:08.937742+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 1, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'unique_pool_0', 'create_time': '2020-06-12T02:35:23.053307+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 3, 'min_size': 2, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 24, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'teuthologyprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6810', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6811', 'nonce': 12037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6812', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6813', 'nonce': 12037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6816', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6817', 'nonce': 12037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6814', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6815', 'nonce': 12037}]}, 'public_addr': '172.21.15.142:6811/12037', 'cluster_addr': '172.21.15.142:6813/12037', 'heartbeat_back_addr': '172.21.15.142:6817/12037', 'heartbeat_front_addr': '172.21.15.142:6815/12037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '74343e4c-0406-4803-8619-520cbc1c60db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 12047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 12047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6808', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6809', 'nonce': 12047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 12047}]}, 'public_addr': '172.21.15.142:6803/12047', 'cluster_addr': '172.21.15.142:6805/12047', 'heartbeat_back_addr': '172.21.15.142:6809/12047', 'heartbeat_front_addr': '172.21.15.142:6807/12047', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18348953-2ab3-44d7-9812-308a4e504ffd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6818', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6819', 'nonce': 12038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6820', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6821', 'nonce': 12038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6824', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6825', 'nonce': 12038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6822', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6823', 'nonce': 12038}]}, 'public_addr': '172.21.15.142:6819/12038', 'cluster_addr': '172.21.15.142:6821/12038', 'heartbeat_back_addr': '172.21.15.142:6825/12038', 'heartbeat_front_addr': '172.21.15.142:6823/12038', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '318d0252-36b6-489c-8cc7-eb5245346db4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6826', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6827', 'nonce': 12048}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6828', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6829', 'nonce': 12048}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 12048}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6830', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6831', 'nonce': 12048}]}, 'public_addr': '172.21.15.142:6827/12048', 'cluster_addr': '172.21.15.142:6829/12048', 'heartbeat_back_addr': '172.21.15.142:6833/12048', 'heartbeat_front_addr': '172.21.15.142:6831/12048', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'e622cde1-ff3b-4df8-9e70-640bb7ce27fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6800', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 12021}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6802', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 12021}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6806', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 12021}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6804', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 12021}]}, 'public_addr': '172.21.15.117:6801/12021', 'cluster_addr': '172.21.15.117:6803/12021', 'heartbeat_back_addr': '172.21.15.117:6807/12021', 'heartbeat_front_addr': '172.21.15.117:6805/12021', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f7d22a59-77a8-4264-888e-3e486a4c0d82', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6808', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 12020}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6814', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6817', 'nonce': 12020}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6823', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6828', 'nonce': 12020}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6820', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6822', 'nonce': 12020}]}, 'public_addr': '172.21.15.117:6811/12020', 'cluster_addr': '172.21.15.117:6817/12020', 'heartbeat_back_addr': '172.21.15.117:6828/12020', 'heartbeat_front_addr': '172.21.15.117:6822/12020', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '60e271cc-4c4c-4397-87be-8c52ffab68d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6809', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 12022}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6815', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6818', 'nonce': 12022}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6830', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6831', 'nonce': 12022}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6825', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6826', 'nonce': 12022}]}, 'public_addr': '172.21.15.117:6812/12022', 'cluster_addr': '172.21.15.117:6818/12022', 'heartbeat_back_addr': '172.21.15.117:6831/12022', 'heartbeat_front_addr': '172.21.15.117:6826/12022', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0f243681-edad-4e3d-9980-cfc55c5f93ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6810', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 12023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6816', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6819', 'nonce': 12023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6827', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6829', 'nonce': 12023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6821', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6824', 'nonce': 12023}]}, 'public_addr': '172.21.15.117:6813/12023', 'cluster_addr': '172.21.15.117:6819/12023', 'heartbeat_back_addr': '172.21.15.117:6829/12023', 'heartbeat_front_addr': '172.21.15.117:6824/12023', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.062298+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.896452+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.113001+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.092632+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.886001+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.878867+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.116299+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.109814+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}, 'teuthologyprofile': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van', 'w': '8'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-06-12T02:35:32.199 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:32.226 INFO:tasks.rados.rados.0.smithi142.stdout:62: finishing write tid 1 to smithi14213939-10 2020-06-12T02:35:32.226 INFO:tasks.rados.rados.0.smithi142.stdout:60: finishing copy_from to smithi14213939-48 2020-06-12T02:35:32.226 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2020-06-12T02:35:32.226 INFO:tasks.rados.rados.0.smithi142.stdout:60: finishing copy_from racing read to smithi14213939-48 2020-06-12T02:35:32.227 INFO:tasks.rados.rados.0.smithi142.stdout:62: finishing write tid 2 to smithi14213939-10 2020-06-12T02:35:32.227 INFO:tasks.rados.rados.0.smithi142.stdout:62: finishing write tid 3 to smithi14213939-10 2020-06-12T02:35:32.227 INFO:tasks.rados.rados.0.smithi142.stdout:62: finishing write tid 5 to smithi14213939-10 2020-06-12T02:35:32.227 INFO:tasks.rados.rados.0.smithi142.stdout:62: finishing write tid 6 to smithi14213939-10 2020-06-12T02:35:32.227 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 10 v 14 (ObjNum 52 snap 3 seq_num 52) dirty exists 2020-06-12T02:35:32.228 INFO:tasks.rados.rados.0.smithi142.stdout:62: left oid 10 (ObjNum 52 snap 3 seq_num 52) 2020-06-12T02:35:32.228 INFO:tasks.rados.rados.0.smithi142.stdout:64: finishing write tid 1 to smithi14213939-2 2020-06-12T02:35:32.228 INFO:tasks.rados.rados.0.smithi142.stdout:64: finishing write tid 2 to smithi14213939-2 2020-06-12T02:35:32.228 INFO:tasks.rados.rados.0.smithi142.stdout:64: finishing write tid 4 to smithi14213939-2 2020-06-12T02:35:32.228 INFO:tasks.rados.rados.0.smithi142.stdout:64: finishing write tid 5 to smithi14213939-2 2020-06-12T02:35:32.229 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 2 v 22 (ObjNum 53 snap 3 seq_num 53) dirty exists 2020-06-12T02:35:32.229 INFO:tasks.rados.rados.0.smithi142.stdout:64: left oid 2 (ObjNum 53 snap 3 seq_num 53) 2020-06-12T02:35:32.229 INFO:tasks.rados.rados.0.smithi142.stdout:59: done (4 left) 2020-06-12T02:35:32.230 INFO:tasks.rados.rados.0.smithi142.stdout:60: done (3 left) 2020-06-12T02:35:32.230 INFO:tasks.rados.rados.0.smithi142.stdout:61: done (2 left) 2020-06-12T02:35:32.230 INFO:tasks.rados.rados.0.smithi142.stdout:62: done (1 left) 2020-06-12T02:35:32.230 INFO:tasks.rados.rados.0.smithi142.stdout:64: done (0 left) 2020-06-12T02:35:32.231 INFO:tasks.rados.rados.0.smithi142.stdout:65: snap_remove snap 1 2020-06-12T02:35:32.295 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:32.292+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:32.339 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:32.332+0000 7f0fbbbcc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.354 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.363 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:32.396 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:32.396+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:32.475 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.475 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.484 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:32.531 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:32.531+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:32.544 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:32.544+0000 7f0fba169700 0 --2- 172.21.15.142:0/3884847669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fb412d170 0x7f0fb412d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-06-12T02:35:32.551 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:32.544+0000 7f0fba96a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:32.589 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.589 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.607 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:32.608 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:32.596+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:32.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:32.709 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:32.709 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:32.708+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:32.716 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.716 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.719 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2020-06-12T02:35:32.122024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63311111,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":52,"num_read_kb":26,"num_write":104,"num_write_kb":28923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8489032,"kb_used_data":100360,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746485688,"statfs":{"total":773094113280,"available":764401344512,"internally_reserved":8589934592,"allocated":102768640,"data_stored":101665818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.030485"},"pg_stats":[{"pgid":"1.f","version":"21'6","reported_seq":"20","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.671694+0000","last_change":"2020-06-12T02:35:25.071463+0000","last_active":"2020-06-12T02:35:28.671694+0000","last_peered":"2020-06-12T02:35:28.671694+0000","last_clean":"2020-06-12T02:35:28.671694+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:35:28.671694+0000","last_undegraded":"2020-06-12T02:35:28.671694+0000","last_fullsized":"2020-06-12T02:35:28.671694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5092455,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":8,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.e","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.083222+0000","last_change":"2020-06-12T02:35:25.072337+0000","last_active":"2020-06-12T02:35:25.083222+0000","last_peered":"2020-06-12T02:35:25.083222+0000","last_clean":"2020-06-12T02:35:25.083222+0000","last_became_active":"2020-06-12T02:35:25.071798+0000","last_became_peered":"2020-06-12T02:35:25.071798+0000","last_unstale":"2020-06-12T02:35:25.083222+0000","last_undegraded":"2020-06-12T02:35:25.083222+0000","last_fullsized":"2020-06-12T02:35:25.083222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.d","version":"21'21","reported_seq":"40","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.750164+0000","last_change":"2020-06-12T02:35:25.082104+0000","last_active":"2020-06-12T02:35:28.750164+0000","last_peered":"2020-06-12T02:35:28.750164+0000","last_clean":"2020-06-12T02:35:28.750164+0000","last_became_active":"2020-06-12T02:35:25.081562+0000","last_became_peered":"2020-06-12T02:35:25.081562+0000","last_unstale":"2020-06-12T02:35:28.750164+0000","last_undegraded":"2020-06-12T02:35:28.750164+0000","last_fullsized":"2020-06-12T02:35:28.750164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17075681,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":14,"num_read_kb":7,"num_write":28,"num_write_kb":8143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.c","version":"21'3","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.124445+0000","last_change":"2020-06-12T02:35:25.068603+0000","last_active":"2020-06-12T02:35:28.124445+0000","last_peered":"2020-06-12T02:35:28.124445+0000","last_clean":"2020-06-12T02:35:28.124445+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:35:28.124445+0000","last_undegraded":"2020-06-12T02:35:28.124445+0000","last_fullsized":"2020-06-12T02:35:28.124445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2016807,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.b","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.073520+0000","last_change":"2020-06-12T02:35:25.071560+0000","last_active":"2020-06-12T02:35:25.073520+0000","last_peered":"2020-06-12T02:35:25.073520+0000","last_clean":"2020-06-12T02:35:25.073520+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:35:25.073520+0000","last_undegraded":"2020-06-12T02:35:25.073520+0000","last_fullsized":"2020-06-12T02:35:25.073520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.a","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.083094+0000","last_change":"2020-06-12T02:35:25.072598+0000","last_active":"2020-06-12T02:35:25.083094+0000","last_peered":"2020-06-12T02:35:25.083094+0000","last_clean":"2020-06-12T02:35:25.083094+0000","last_became_active":"2020-06-12T02:35:25.072055+0000","last_became_peered":"2020-06-12T02:35:25.072055+0000","last_unstale":"2020-06-12T02:35:25.083094+0000","last_undegraded":"2020-06-12T02:35:25.083094+0000","last_fullsized":"2020-06-12T02:35:25.083094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.9","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.083058+0000","last_change":"2020-06-12T02:35:25.071439+0000","last_active":"2020-06-12T02:35:25.083058+0000","last_peered":"2020-06-12T02:35:25.083058+0000","last_clean":"2020-06-12T02:35:25.083058+0000","last_became_active":"2020-06-12T02:35:25.070746+0000","last_became_peered":"2020-06-12T02:35:25.070746+0000","last_unstale":"2020-06-12T02:35:25.083058+0000","last_undegraded":"2020-06-12T02:35:25.083058+0000","last_fullsized":"2020-06-12T02:35:25.083058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.8","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.083119+0000","last_change":"2020-06-12T02:35:25.074168+0000","last_active":"2020-06-12T02:35:25.083119+0000","last_peered":"2020-06-12T02:35:25.083119+0000","last_clean":"2020-06-12T02:35:25.083119+0000","last_became_active":"2020-06-12T02:35:25.073650+0000","last_became_peered":"2020-06-12T02:35:25.073650+0000","last_unstale":"2020-06-12T02:35:25.083119+0000","last_undegraded":"2020-06-12T02:35:25.083119+0000","last_fullsized":"2020-06-12T02:35:25.083119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.083171+0000","last_change":"2020-06-12T02:35:25.076360+0000","last_active":"2020-06-12T02:35:25.083171+0000","last_peered":"2020-06-12T02:35:25.083171+0000","last_clean":"2020-06-12T02:35:25.083171+0000","last_became_active":"2020-06-12T02:35:25.075901+0000","last_became_peered":"2020-06-12T02:35:25.075901+0000","last_unstale":"2020-06-12T02:35:25.083171+0000","last_undegraded":"2020-06-12T02:35:25.083171+0000","last_fullsized":"2020-06-12T02:35:25.083171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"21'6","reported_seq":"20","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.374409+0000","last_change":"2020-06-12T02:35:25.067505+0000","last_active":"2020-06-12T02:35:28.374409+0000","last_peered":"2020-06-12T02:35:28.374409+0000","last_clean":"2020-06-12T02:35:28.374409+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:35:28.374409+0000","last_undegraded":"2020-06-12T02:35:28.374409+0000","last_fullsized":"2020-06-12T02:35:28.374409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4521017,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":8,"num_write_kb":1927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"21'3","reported_seq":"16","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.777988+0000","last_change":"2020-06-12T02:35:25.065821+0000","last_active":"2020-06-12T02:35:28.777988+0000","last_peered":"2020-06-12T02:35:28.777988+0000","last_clean":"2020-06-12T02:35:28.777988+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:35:28.777988+0000","last_undegraded":"2020-06-12T02:35:28.777988+0000","last_fullsized":"2020-06-12T02:35:28.777988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2789929,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.082996+0000","last_change":"2020-06-12T02:35:25.070759+0000","last_active":"2020-06-12T02:35:25.082996+0000","last_peered":"2020-06-12T02:35:25.082996+0000","last_clean":"2020-06-12T02:35:25.082996+0000","last_became_active":"2020-06-12T02:35:25.069671+0000","last_became_peered":"2020-06-12T02:35:25.069671+0000","last_unstale":"2020-06-12T02:35:25.082996+0000","last_undegraded":"2020-06-12T02:35:25.082996+0000","last_fullsized":"2020-06-12T02:35:25.082996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"21'12","reported_seq":"27","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.757730+0000","last_change":"2020-06-12T02:35:25.079277+0000","last_active":"2020-06-12T02:35:28.757730+0000","last_peered":"2020-06-12T02:35:28.757730+0000","last_clean":"2020-06-12T02:35:28.757730+0000","last_became_active":"2020-06-12T02:35:25.074852+0000","last_became_peered":"2020-06-12T02:35:25.074852+0000","last_unstale":"2020-06-12T02:35:28.757730+0000","last_undegraded":"2020-06-12T02:35:28.757730+0000","last_fullsized":"2020-06-12T02:35:28.757730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9579858,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":16,"num_write_kb":3924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2020-06-12T02:35:25.073492+0000","last_change":"2020-06-12T02:35:25.071339+0000","last_active":"2020-06-12T02:35:25.073492+0000","last_peered":"2020-06-12T02:35:25.073492+0000","last_clean":"2020-06-12T02:35:25.073492+0000","last_became_active":"2020-06-12T02:35:25.070276+0000","last_became_peered":"2020-06-12T02:35:25.070276+0000","last_unstale":"2020-06-12T02:35:25.073492+0000","last_undegraded":"2020-06-12T02:35:25.073492+0000","last_fullsized":"2020-06-12T02:35:25.073492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"21'12","reported_seq":"28","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.599187+0000","last_change":"2020-06-12T02:35:25.070304+0000","last_active":"2020-06-12T02:35:28.599187+0000","last_peered":"2020-06-12T02:35:28.599187+0000","last_clean":"2020-06-12T02:35:28.599187+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:35:28.599187+0000","last_undegraded":"2020-06-12T02:35:28.599187+0000","last_fullsized":"2020-06-12T02:35:28.599187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10100875,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":16,"num_write_kb":4601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"21'15","reported_seq":"32","reported_epoch":"21","state":"active+clean","last_fresh":"2020-06-12T02:35:28.641226+0000","last_change":"2020-06-12T02:35:25.070850+0000","last_active":"2020-06-12T02:35:28.641226+0000","last_peered":"2020-06-12T02:35:28.641226+0000","last_clean":"2020-06-12T02:35:28.641226+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:35:28.641226+0000","last_undegraded":"2020-06-12T02:35:28.641226+0000","last_fullsized":"2020-06-12T02:35:28.641226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12134489,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":20,"num_write_kb":5702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":63311111,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":52,"num_read_kb":26,"num_write":104,"num_write_kb":28923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101101568,"data_stored":101101568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064292,"kb_used_data":15708,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93307548,"statfs":{"total":96636764160,"available":95546929152,"internally_reserved":1073741824,"allocated":16084992,"data_stored":15944701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7989999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.653}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2480000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3239999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0510000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7809999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072448,"kb_used_data":23864,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93299392,"statfs":{"total":96636764160,"available":95538577408,"internally_reserved":1073741824,"allocated":24436736,"data_stored":24296445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4420000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.359}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.641}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2770000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3339999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":66915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8849999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.391}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":66915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.718}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6960000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.637}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":66915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1219999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7730000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064704,"kb_used_data":16120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93307136,"statfs":{"total":96636764160,"available":95546507264,"internally_reserved":1073741824,"allocated":16506880,"data_stored":16366589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7240000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.387}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1080452,"kb_used_data":31868,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93291388,"statfs":{"total":96636764160,"available":95530381312,"internally_reserved":1073741824,"allocated":32632832,"data_stored":32492541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.911}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9380000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3690000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6640000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1060796,"kb_used_data":12212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93311044,"statfs":{"total":96636764160,"available":95550509056,"internally_reserved":1073741824,"allocated":12505088,"data_stored":12364797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1339999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1960000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5379999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6589999999999998}]}]}]}} 2020-06-12T02:35:32.796 INFO:tasks.thrashosds.thrasher:Setting 1.9 to [1, 5, 2, 6, 4, 3] 2020-06-12T02:35:32.797 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '1.9', '1', '5', '2', '6', '4', '3'] 2020-06-12T02:35:32.797 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 1.9 1 5 2 6 4 3 2020-06-12T02:35:32.799 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:32.841 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:32.840+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:32.915 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:32.908+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:32.959 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:32.960 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:32.964 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:32.974 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:32.944+0000 7f211800b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:32.975 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:32.968+0000 7f2116da9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:33.012 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:33.011+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:33.092 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:33.133 INFO:tasks.rados.rados.0.smithi142.stdout:65: done (0 left) 2020-06-12T02:35:33.134 INFO:tasks.rados.rados.0.smithi142.stdout:66: delete oid 38 current snap is 3 2020-06-12T02:35:33.140 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:33.132+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:33.141 INFO:teuthology.orchestra.run.smithi142.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-06-12T02:35:33.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:35:33.143 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-06-12T02:35:33.145 INFO:tasks.rados.rados.0.smithi142.stdout:66: done (0 left) 2020-06-12T02:35:33.146 INFO:tasks.rados.rados.0.smithi142.stdout:67: rollback oid 6 current snap is 3 2020-06-12T02:35:33.146 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 6 to 2 2020-06-12T02:35:33.146 INFO:tasks.rados.rados.0.smithi142.stdout:68: rollback oid 44 current snap is 3 2020-06-12T02:35:33.146 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 44 to 2 2020-06-12T02:35:33.147 INFO:tasks.rados.rados.0.smithi142.stdout:69: write oid 7 current snap is 3 2020-06-12T02:35:33.147 INFO:tasks.rados.rados.0.smithi142.stdout:69: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2020-06-12T02:35:33.152 INFO:tasks.rados.rados.0.smithi142.stdout:69: writing smithi14213939-7 from 524385 to 1077551 tid 1 2020-06-12T02:35:33.157 INFO:tasks.rados.rados.0.smithi142.stdout:69: writing smithi14213939-7 from 1602039 to 2012054 tid 2 2020-06-12T02:35:33.167 INFO:tasks.rados.rados.0.smithi142.stdout:69: writing smithi14213939-7 from 2577441 to 2924385 tid 3 2020-06-12T02:35:33.168 INFO:tasks.rados.rados.0.smithi142.stdout:70: write oid 43 current snap is 3 2020-06-12T02:35:33.168 INFO:tasks.rados.rados.0.smithi142.stdout:70: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2020-06-12T02:35:33.171 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:35:33.172 INFO:tasks.rados.rados.0.smithi142.stdout:70: writing smithi14213939-43 from 541192 to 1169607 tid 1 2020-06-12T02:35:33.179 INFO:tasks.rados.rados.0.smithi142.stdout:70: writing smithi14213939-43 from 1660521 to 2214194 tid 2 2020-06-12T02:35:33.183 INFO:tasks.rados.rados.0.smithi142.stdout:70: writing smithi14213939-43 from 2888511 to 2941192 tid 3 2020-06-12T02:35:33.184 INFO:tasks.rados.rados.0.smithi142.stdout:71: copy_from oid 40 from oid 24 current snap is 3 2020-06-12T02:35:33.184 INFO:tasks.rados.rados.0.smithi142.stdout:72: delete oid 49 current snap is 3 2020-06-12T02:35:33.185 INFO:tasks.rados.rados.0.smithi142.stdout:68: finishing rollback tid 0 to smithi14213939-44 2020-06-12T02:35:33.185 INFO:tasks.rados.rados.0.smithi142.stdout:67: finishing rollback tid 0 to smithi14213939-6 2020-06-12T02:35:33.185 INFO:tasks.rados.rados.0.smithi142.stdout:68: finishing rollback tid 1 to smithi14213939-44 2020-06-12T02:35:33.185 INFO:tasks.rados.rados.0.smithi142.stdout:67: finishing rollback tid 1 to smithi14213939-6 2020-06-12T02:35:33.186 INFO:tasks.rados.rados.0.smithi142.stdout:67: finishing rollback tid 2 to smithi14213939-6 2020-06-12T02:35:33.186 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 19 (ObjNum 5 snap 0 seq_num 5) dirty exists 2020-06-12T02:35:33.186 INFO:tasks.rados.rados.0.smithi142.stdout:68: finishing rollback tid 2 to smithi14213939-44 2020-06-12T02:35:33.186 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 44 v 13 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-06-12T02:35:33.186 INFO:tasks.rados.rados.0.smithi142.stdout:69: finishing write tid 1 to smithi14213939-7 2020-06-12T02:35:33.187 INFO:tasks.rados.rados.0.smithi142.stdout:70: finishing write tid 1 to smithi14213939-43 2020-06-12T02:35:33.188 INFO:tasks.rados.rados.0.smithi142.stdout:69: finishing write tid 2 to smithi14213939-7 2020-06-12T02:35:33.189 INFO:tasks.rados.rados.0.smithi142.stdout:69: finishing write tid 3 to smithi14213939-7 2020-06-12T02:35:33.189 INFO:tasks.rados.rados.0.smithi142.stdout:69: finishing write tid 5 to smithi14213939-7 2020-06-12T02:35:33.193 INFO:tasks.rados.rados.0.smithi142.stdout:69: finishing write tid 6 to smithi14213939-7 2020-06-12T02:35:33.193 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:35:33.194 INFO:tasks.rados.rados.0.smithi142.stdout:69: left oid 7 (ObjNum 55 snap 3 seq_num 55) 2020-06-12T02:35:33.195 INFO:tasks.rados.rados.0.smithi142.stdout:70: finishing write tid 2 to smithi14213939-43 2020-06-12T02:35:33.198 INFO:tasks.rados.rados.0.smithi142.stdout:70: finishing write tid 3 to smithi14213939-43 2020-06-12T02:35:33.204 INFO:tasks.rados.rados.0.smithi142.stdout:67: done (5 left) 2020-06-12T02:35:33.204 INFO:tasks.rados.rados.0.smithi142.stdout:68: done (4 left) 2020-06-12T02:35:33.204 INFO:tasks.rados.rados.0.smithi142.stdout:69: done (3 left) 2020-06-12T02:35:33.204 INFO:tasks.rados.rados.0.smithi142.stdout:72: done (2 left) 2020-06-12T02:35:33.205 INFO:tasks.rados.rados.0.smithi142.stdout:73: read oid 38 snap -1 2020-06-12T02:35:33.205 INFO:tasks.rados.rados.0.smithi142.stdout:73: expect deleted 2020-06-12T02:35:33.205 INFO:tasks.rados.rados.0.smithi142.stdout:74: write (excl) oid 35 current snap is 3 2020-06-12T02:35:33.205 INFO:tasks.rados.rados.0.smithi142.stdout:74: seq_num 58 ranges {574806=778913,2061132=557342} 2020-06-12T02:35:33.208 INFO:tasks.rados.rados.0.smithi142.stdout:74: writing smithi14213939-35 from 574806 to 1353719 tid 1 2020-06-12T02:35:33.213 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:33.212+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:33.217 INFO:tasks.rados.rados.0.smithi142.stdout:74: writing smithi14213939-35 from 2061132 to 2618474 tid 2 2020-06-12T02:35:33.218 INFO:tasks.rados.rados.0.smithi142.stdout:75: rollback oid 6 current snap is 3 2020-06-12T02:35:33.218 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 6 to 2 2020-06-12T02:35:33.218 INFO:tasks.rados.rados.0.smithi142.stdout:70: finishing write tid 5 to smithi14213939-43 2020-06-12T02:35:33.218 INFO:tasks.rados.rados.0.smithi142.stdout:70: finishing write tid 6 to smithi14213939-43 2020-06-12T02:35:33.218 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 43 v 23 (ObjNum 56 snap 3 seq_num 56) dirty exists 2020-06-12T02:35:33.219 INFO:tasks.rados.rados.0.smithi142.stdout:70: left oid 43 (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:33.219 INFO:tasks.rados.rados.0.smithi142.stdout:71: finishing copy_from to smithi14213939-40 2020-06-12T02:35:33.219 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 40 v 9 (ObjNum 23 snap 0 seq_num 23) dirty exists 2020-06-12T02:35:33.220 INFO:tasks.rados.rados.0.smithi142.stdout:71: finishing copy_from racing read to smithi14213939-40 2020-06-12T02:35:33.220 INFO:tasks.rados.rados.0.smithi142.stdout:70: done (4 left) 2020-06-12T02:35:33.220 INFO:tasks.rados.rados.0.smithi142.stdout:71: done (3 left) 2020-06-12T02:35:33.220 INFO:tasks.rados.rados.0.smithi142.stdout:73: done (2 left) 2020-06-12T02:35:33.220 INFO:tasks.rados.rados.0.smithi142.stdout:76: delete oid 27 current snap is 3 2020-06-12T02:35:33.221 INFO:tasks.rados.rados.0.smithi142.stdout:74: finishing write tid 1 to smithi14213939-35 2020-06-12T02:35:33.222 INFO:tasks.rados.rados.0.smithi142.stdout:75: finishing rollback tid 0 to smithi14213939-6 2020-06-12T02:35:33.223 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:33.223 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:33.224 INFO:tasks.rados.rados.0.smithi142.stdout:76: done (2 left) 2020-06-12T02:35:33.224 INFO:tasks.rados.rados.0.smithi142.stdout:77: write oid 22 current snap is 3 2020-06-12T02:35:33.224 INFO:tasks.rados.rados.0.smithi142.stdout:77: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2020-06-12T02:35:33.231 INFO:tasks.rados.rados.0.smithi142.stdout:77: writing smithi14213939-22 from 608420 to 1137831 tid 1 2020-06-12T02:35:33.236 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:33.239 INFO:tasks.rados.rados.0.smithi142.stdout:77: writing smithi14213939-22 from 1778096 to 2339107 tid 2 2020-06-12T02:35:33.244 INFO:tasks.rados.rados.0.smithi142.stdout:77: writing smithi14213939-22 from 2881850 to 3008420 tid 3 2020-06-12T02:35:33.244 INFO:tasks.rados.rados.0.smithi142.stdout:78: rollback oid 47 current snap is 3 2020-06-12T02:35:33.245 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 47 to 2 2020-06-12T02:35:33.245 INFO:tasks.rados.rados.0.smithi142.stdout:75: finishing rollback tid 1 to smithi14213939-6 2020-06-12T02:35:33.245 INFO:tasks.rados.rados.0.smithi142.stdout:75: finishing rollback tid 2 to smithi14213939-6 2020-06-12T02:35:33.245 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 22 (ObjNum 5 snap 0 seq_num 5) dirty exists 2020-06-12T02:35:33.245 INFO:tasks.rados.rados.0.smithi142.stdout:74: finishing write tid 2 to smithi14213939-35 2020-06-12T02:35:33.246 INFO:tasks.rados.rados.0.smithi142.stdout:74: finishing write tid 4 to smithi14213939-35 2020-06-12T02:35:33.246 INFO:tasks.rados.rados.0.smithi142.stdout:74: finishing write tid 5 to smithi14213939-35 2020-06-12T02:35:33.246 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 16 (ObjNum 58 snap 3 seq_num 58) dirty exists 2020-06-12T02:35:33.246 INFO:tasks.rados.rados.0.smithi142.stdout:74: left oid 35 (ObjNum 58 snap 3 seq_num 58) 2020-06-12T02:35:33.246 INFO:tasks.rados.rados.0.smithi142.stdout:77: finishing write tid 1 to smithi14213939-22 2020-06-12T02:35:33.247 INFO:tasks.rados.rados.0.smithi142.stdout:74: done (3 left) 2020-06-12T02:35:33.247 INFO:tasks.rados.rados.0.smithi142.stdout:75: done (2 left) 2020-06-12T02:35:33.247 INFO:tasks.rados.rados.0.smithi142.stdout:79: rollback oid 13 current snap is 3 2020-06-12T02:35:33.247 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 13 to 2 2020-06-12T02:35:33.247 INFO:tasks.rados.rados.0.smithi142.stdout:80: snap_create 2020-06-12T02:35:33.250 INFO:tasks.rados.rados.0.smithi142.stdout:77: finishing write tid 2 to smithi14213939-22 2020-06-12T02:35:33.252 INFO:tasks.rados.rados.0.smithi142.stdout:78: finishing rollback tid 0 to smithi14213939-47 2020-06-12T02:35:33.253 INFO:tasks.rados.rados.0.smithi142.stdout:79: finishing rollback tid 0 to smithi14213939-13 2020-06-12T02:35:33.256 INFO:tasks.rados.rados.0.smithi142.stdout:77: finishing write tid 3 to smithi14213939-22 2020-06-12T02:35:33.256 INFO:tasks.rados.rados.0.smithi142.stdout:77: finishing write tid 5 to smithi14213939-22 2020-06-12T02:35:33.257 INFO:tasks.rados.rados.0.smithi142.stdout:78: finishing rollback tid 1 to smithi14213939-47 2020-06-12T02:35:33.257 INFO:tasks.rados.rados.0.smithi142.stdout:78: finishing rollback tid 2 to smithi14213939-47 2020-06-12T02:35:33.257 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 31 (ObjNum 50 snap 2 seq_num 50) dirty exists 2020-06-12T02:35:33.257 INFO:tasks.rados.rados.0.smithi142.stdout:79: finishing rollback tid 1 to smithi14213939-13 2020-06-12T02:35:33.258 INFO:tasks.rados.rados.0.smithi142.stdout:79: finishing rollback tid 2 to smithi14213939-13 2020-06-12T02:35:33.258 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 18 (ObjNum 12 snap 0 seq_num 12) dirty exists 2020-06-12T02:35:33.258 INFO:tasks.rados.rados.0.smithi142.stdout:77: finishing write tid 6 to smithi14213939-22 2020-06-12T02:35:33.258 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 22 v 18 (ObjNum 60 snap 3 seq_num 60) dirty exists 2020-06-12T02:35:33.258 INFO:tasks.rados.rados.0.smithi142.stdout:77: left oid 22 (ObjNum 60 snap 3 seq_num 60) 2020-06-12T02:35:33.296 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:33.288+0000 7f33ed49c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:33.300 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:33.296+0000 7f33e7fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:33.314 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:33.312+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:33.345 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:33.345 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:33.355 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:33.441 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:33.440+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:33.502 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:33.503 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:33.512 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:33.528 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:33.557 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:33.556+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:33.615 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:33.612+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:33.662 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:33.656+0000 7f8eaaa7d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:33.664 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:33.664 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:33.666 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:33.664+0000 7f8eaaa7d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:33.675 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:33.697 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:33.717 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:33.718 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:33.716+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:33.736 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:33.759 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:33.801 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:33.810 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:33.817 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:33.819+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:33.918 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:33.916+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:33.962 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:145 1.ds0 1:b752a38e:::smithi14213939-37:head [write 605052~774376,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3717960170000003, 2020-06-12T02:35:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081256230000000002, 2020-06-12T02:35:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 145 2020-06-12T02:35:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.590846+0000", 2020-06-12T02:35:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00053313999999999998 2020-06-12T02:35:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591379+0000", 2020-06-12T02:35:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6824999999999999e-05 2020-06-12T02:35:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591396+0000", 2020-06-12T02:35:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4289000000000001e-05 2020-06-12T02:35:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591420+0000", 2020-06-12T02:35:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:35:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591433+0000", 2020-06-12T02:35:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0865000000000006e-05 2020-06-12T02:35:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591514+0000", 2020-06-12T02:35:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027453999999999998 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.591788+0000", 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018796609999999999 2020-06-12T02:35:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.593668+0000", 2020-06-12T02:35:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018390730000000001 2020-06-12T02:35:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.595507+0000", 2020-06-12T02:35:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033349949999999999 2020-06-12T02:35:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598842+0000", 2020-06-12T02:35:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012942699999999999 2020-06-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598971+0000", 2020-06-12T02:35:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081256230000000002 2020-06-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:146 1.ds0 1:b752a38e:::smithi14213939-37:head [write 1923587~633336] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3647682569999997, 2020-06-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011364222, 2020-06-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 146 2020-06-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.597874+0000", 2020-06-12T02:35:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023479100000000001 2020-06-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598108+0000", 2020-06-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5719999999999997e-06 2020-06-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598116+0000", 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3506000000000001e-05 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598129+0000", 2020-06-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2336e-05 2020-06-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598142+0000", 2020-06-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9764e-05 2020-06-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598192+0000", 2020-06-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013577500000000001 2020-06-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598327+0000", 2020-06-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010142160000000001 2020-06-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.599342+0000", 2020-06-12T02:35:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4664000000000001e-05 2020-06-12T02:35:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.599426+0000", 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019771789999999999 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.601403+0000", 2020-06-12T02:35:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074435500000000002 2020-06-12T02:35:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.608847+0000", 2020-06-12T02:35:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025534499999999998 2020-06-12T02:35:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609102+0000", 2020-06-12T02:35:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013552400000000001 2020-06-12T02:35:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609238+0000", 2020-06-12T02:35:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011364222 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:147 1.ds0 1:b752a38e:::smithi14213939-37:head [setxattr _header (56) in=7b,truncate 2605052] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.364431916, 2020-06-12T02:35:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011264615, 2020-06-12T02:35:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 147 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598210+0000", 2020-06-12T02:35:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1422999999999995e-05 2020-06-12T02:35:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598301+0000", 2020-06-12T02:35:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5480000000000002e-06 2020-06-12T02:35:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598310+0000", 2020-06-12T02:35:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4932999999999999e-05 2020-06-12T02:35:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598325+0000", 2020-06-12T02:35:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2900000000000002e-06 2020-06-12T02:35:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598330+0000", 2020-06-12T02:35:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3238999999999995e-05 2020-06-12T02:35:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598403+0000", 2020-06-12T02:35:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000190316 2020-06-12T02:35:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598594+0000", 2020-06-12T02:35:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046041509999999999 2020-06-12T02:35:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603198+0000", 2020-06-12T02:35:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013647400000000001 2020-06-12T02:35:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603334+0000", 2020-06-12T02:35:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058424599999999996 2020-06-12T02:35:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.603919+0000", 2020-06-12T02:35:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053348730000000004 2020-06-12T02:35:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609253+0000", 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7345999999999999e-05 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609351+0000", 2020-06-12T02:35:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000123776 2020-06-12T02:35:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609475+0000", 2020-06-12T02:35:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011264615 2020-06-12T02:35:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:148 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3642621049999999, 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013621273999999999, 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 148 2020-06-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598380+0000", 2020-06-12T02:35:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-05 2020-06-12T02:35:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598432+0000", 2020-06-12T02:35:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9130000000000003e-06 2020-06-12T02:35:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598440+0000", 2020-06-12T02:35:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5525000000000001e-05 2020-06-12T02:35:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598455+0000", 2020-06-12T02:35:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9540000000000001e-06 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598461+0000", 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016353799999999999 2020-06-12T02:35:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598625+0000", 2020-06-12T02:35:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2236000000000003e-05 2020-06-12T02:35:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.598717+0000", 2020-06-12T02:35:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071921629999999997 2020-06-12T02:35:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.605909+0000", 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9365999999999997e-05 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606008+0000", 2020-06-12T02:35:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035207960000000001 2020-06-12T02:35:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609529+0000", 2020-06-12T02:35:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014839000000000001 2020-06-12T02:35:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609677+0000", 2020-06-12T02:35:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023235529999999999 2020-06-12T02:35:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612001+0000", 2020-06-12T02:35:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013621273999999999 2020-06-12T02:35:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:149 1.ds0 1:ba86b5df:::smithi14213939-38:head [write 621859~449625,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3584868720000003, 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082004299999999999, 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 149 2020-06-12T02:35:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604155+0000", 2020-06-12T02:35:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028979199999999998 2020-06-12T02:35:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604445+0000", 2020-06-12T02:35:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1564e-05 2020-06-12T02:35:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604456+0000", 2020-06-12T02:35:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8079999999999999e-05 2020-06-12T02:35:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604484+0000", 2020-06-12T02:35:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0930999999999999e-05 2020-06-12T02:35:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.604495+0000", 2020-06-12T02:35:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015740400000000001 2020-06-12T02:35:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606069+0000", 2020-06-12T02:35:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020112099999999999 2020-06-12T02:35:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.606271+0000", 2020-06-12T02:35:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015820470000000001 2020-06-12T02:35:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.607853+0000", 2020-06-12T02:35:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021353829999999998 2020-06-12T02:35:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.609988+0000", 2020-06-12T02:35:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022306740000000002 2020-06-12T02:35:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612219+0000", 2020-06-12T02:35:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013679799999999999 2020-06-12T02:35:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.612355+0000", 2020-06-12T02:35:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082004299999999999 2020-06-12T02:35:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:150 1.ds0 1:ba86b5df:::smithi14213939-38:head [write 1865716~756143] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3492714010000002, 2020-06-12T02:35:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082459820000000007, 2020-06-12T02:35:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 150 2020-06-12T02:35:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613370+0000", 2020-06-12T02:35:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032702099999999998 2020-06-12T02:35:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613697+0000", 2020-06-12T02:35:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4079999999999998e-06 2020-06-12T02:35:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613706+0000", 2020-06-12T02:35:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0704e-05 2020-06-12T02:35:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613727+0000", 2020-06-12T02:35:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0299999999999999e-06 2020-06-12T02:35:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613733+0000", 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0865000000000007e-05 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613803+0000", 2020-06-12T02:35:34.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0322999999999997e-05 2020-06-12T02:35:34.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613884+0000", 2020-06-12T02:35:34.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001405417 2020-06-12T02:35:34.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.615289+0000", 2020-06-12T02:35:34.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031335880000000001 2020-06-12T02:35:34.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618423+0000", 2020-06-12T02:35:34.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030860839999999998 2020-06-12T02:35:34.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.621509+0000", 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010754199999999999 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.621616+0000", 2020-06-12T02:35:34.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082459820000000007 2020-06-12T02:35:34.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.082 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.083 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:151 1.ds0 1:ba86b5df:::smithi14213939-38:head [setxattr _header (56) in=7b,truncate 2621859] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.084 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:34.084 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.348854609, 2020-06-12T02:35:34.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084782320000000005, 2020-06-12T02:35:34.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 151 2020-06-12T02:35:34.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613787+0000", 2020-06-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9617999999999997e-05 2020-06-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613857+0000", 2020-06-12T02:35:34.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1700000000000002e-06 2020-06-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613863+0000", 2020-06-12T02:35:34.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0539e-05 2020-06-12T02:35:34.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613874+0000", 2020-06-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6910000000000002e-06 2020-06-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613879+0000", 2020-06-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028255379999999998 2020-06-12T02:35:34.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.616705+0000", 2020-06-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116805 2020-06-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.616822+0000", 2020-06-12T02:35:34.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067296599999999999 2020-06-12T02:35:34.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.617495+0000", 2020-06-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023724760000000001 2020-06-12T02:35:34.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.619867+0000", 2020-06-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022906060000000002 2020-06-12T02:35:34.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622158+0000", 2020-06-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107823 2020-06-12T02:35:34.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622265+0000", 2020-06-12T02:35:34.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084782320000000005 2020-06-12T02:35:34.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:152 1.ds0 1:ba86b5df:::smithi14213939-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:34.107 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:34.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3487246480000001, 2020-06-12T02:35:34.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010821862999999999, 2020-06-12T02:35:34.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.108 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 152 2020-06-12T02:35:34.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.109 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:34.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613917+0000", 2020-06-12T02:35:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9952e-05 2020-06-12T02:35:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613957+0000", 2020-06-12T02:35:34.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3739999999999997e-06 2020-06-12T02:35:34.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613963+0000", 2020-06-12T02:35:34.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:35:34.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613973+0000", 2020-06-12T02:35:34.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5039999999999998e-06 2020-06-12T02:35:34.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.613976+0000", 2020-06-12T02:35:34.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042943549999999997 2020-06-12T02:35:34.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618271+0000", 2020-06-12T02:35:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014506999999999999 2020-06-12T02:35:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.618416+0000", 2020-06-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042548839999999996 2020-06-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622671+0000", 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000158002 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.622829+0000", 2020-06-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019102629999999999 2020-06-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.624739+0000", 2020-06-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010821862999999999 2020-06-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:154 1.5s0 1:ad55f8d3:::smithi14213939-39:head [write 1924198~637005] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.123 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:34.123 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.334234919, 2020-06-12T02:35:34.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068908299999999997, 2020-06-12T02:35:34.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.123 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.124 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.124 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.124 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.124 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 154 2020-06-12T02:35:34.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.125 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:34.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628407+0000", 2020-06-12T02:35:34.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024628200000000001 2020-06-12T02:35:34.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628653+0000", 2020-06-12T02:35:34.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.652e-06 2020-06-12T02:35:34.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628660+0000", 2020-06-12T02:35:34.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4579000000000001e-05 2020-06-12T02:35:34.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628674+0000", 2020-06-12T02:35:34.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.799e-06 2020-06-12T02:35:34.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628683+0000", 2020-06-12T02:35:34.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6310999999999998e-05 2020-06-12T02:35:34.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628730+0000", 2020-06-12T02:35:34.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116628 2020-06-12T02:35:34.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628846+0000", 2020-06-12T02:35:34.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001487211 2020-06-12T02:35:34.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.630333+0000", 2020-06-12T02:35:34.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045569649999999996 2020-06-12T02:35:34.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634890+0000", 2020-06-12T02:35:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032598399999999997 2020-06-12T02:35:34.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.635216+0000", 2020-06-12T02:35:34.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1419000000000001e-05 2020-06-12T02:35:34.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.635298+0000", 2020-06-12T02:35:34.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068908299999999997 2020-06-12T02:35:34.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.143 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.144 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:155 1.5s0 1:ad55f8d3:::smithi14213939-39:head [setxattr _header (56) in=7b,truncate 2638666] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.144 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:34.144 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.333920601, 2020-06-12T02:35:34.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0090905959999999994, 2020-06-12T02:35:34.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.146 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 155 2020-06-12T02:35:34.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628721+0000", 2020-06-12T02:35:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5779999999999999e-05 2020-06-12T02:35:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628767+0000", 2020-06-12T02:35:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2889999999999999e-06 2020-06-12T02:35:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628771+0000", 2020-06-12T02:35:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1910000000000006e-06 2020-06-12T02:35:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628781+0000", 2020-06-12T02:35:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5129999999999998e-06 2020-06-12T02:35:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628785+0000", 2020-06-12T02:35:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029422530000000001 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.631727+0000", 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029156000000000001 2020-06-12T02:35:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.632019+0000", 2020-06-12T02:35:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015823090000000001 2020-06-12T02:35:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.633601+0000", 2020-06-12T02:35:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036863619999999999 2020-06-12T02:35:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637288+0000", 2020-06-12T02:35:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000416835 2020-06-12T02:35:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637704+0000", 2020-06-12T02:35:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010750400000000001 2020-06-12T02:35:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.637812+0000", 2020-06-12T02:35:34.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0090905959999999994 2020-06-12T02:35:34.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:156 1.5s0 1:ad55f8d3:::smithi14213939-39:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3338295650000003, 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01245312, 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.163 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.163 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.163 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 156 2020-06-12T02:35:34.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.163 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:34.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628812+0000", 2020-06-12T02:35:34.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6395999999999999e-05 2020-06-12T02:35:34.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628839+0000", 2020-06-12T02:35:34.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8310000000000003e-06 2020-06-12T02:35:34.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628843+0000", 2020-06-12T02:35:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2210000000000003e-06 2020-06-12T02:35:34.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628852+0000", 2020-06-12T02:35:34.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.604e-06 2020-06-12T02:35:34.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.628854+0000", 2020-06-12T02:35:34.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058571650000000001 2020-06-12T02:35:34.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634712+0000", 2020-06-12T02:35:34.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2899999999999997e-05 2020-06-12T02:35:34.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.634784+0000", 2020-06-12T02:35:34.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035095019999999998 2020-06-12T02:35:34.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.638294+0000", 2020-06-12T02:35:34.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046368400000000001 2020-06-12T02:35:34.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.638758+0000", 2020-06-12T02:35:34.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025078169999999999 2020-06-12T02:35:34.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.641265+0000", 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01245312 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.177 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:181 1.ds0 1:bb6dbdab:::smithi14213939-46:head [write 756315~767970,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.177 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:34.178 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2347034800000003, 2020-06-12T02:35:34.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092224190000000008, 2020-06-12T02:35:34.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.178 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.179 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 181 2020-06-12T02:35:34.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.180 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:34.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.727938+0000", 2020-06-12T02:35:34.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035021599999999998 2020-06-12T02:35:34.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728289+0000", 2020-06-12T02:35:34.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0243e-05 2020-06-12T02:35:34.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728299+0000", 2020-06-12T02:35:34.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7340999999999999e-05 2020-06-12T02:35:34.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728316+0000", 2020-06-12T02:35:34.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0406e-05 2020-06-12T02:35:34.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728327+0000", 2020-06-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6210000000000005e-05 2020-06-12T02:35:34.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728393+0000", 2020-06-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020636299999999999 2020-06-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.728599+0000", 2020-06-12T02:35:34.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0016753689999999999 2020-06-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.730275+0000", 2020-06-12T02:35:34.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034489989999999999 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733724+0000", 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031888139999999999 2020-06-12T02:35:34.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736912+0000", 2020-06-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024845800000000001 2020-06-12T02:35:34.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737161+0000", 2020-06-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092224190000000008 2020-06-12T02:35:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:182 1.ds0 1:bb6dbdab:::smithi14213939-46:head [write 1933572~791670] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.199 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:34.200 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.227353817, 2020-06-12T02:35:34.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012461573, 2020-06-12T02:35:34.200 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.200 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.200 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 182 2020-06-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735288+0000", 2020-06-12T02:35:34.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041378600000000003 2020-06-12T02:35:34.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735702+0000", 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5549999999999999e-06 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735708+0000", 2020-06-12T02:35:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5680000000000005e-06 2020-06-12T02:35:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735718+0000", 2020-06-12T02:35:34.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4590000000000001e-06 2020-06-12T02:35:34.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735725+0000", 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9313000000000001e-05 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735765+0000", 2020-06-12T02:35:34.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8070000000000001e-05 2020-06-12T02:35:34.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735863+0000", 2020-06-12T02:35:34.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018879039999999999 2020-06-12T02:35:34.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737751+0000", 2020-06-12T02:35:34.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114169 2020-06-12T02:35:34.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.737865+0000", 2020-06-12T02:35:34.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012543020000000001 2020-06-12T02:35:34.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.739119+0000", 2020-06-12T02:35:34.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045317939999999996 2020-06-12T02:35:34.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743651+0000", 2020-06-12T02:35:34.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039882140000000003 2020-06-12T02:35:34.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747639+0000", 2020-06-12T02:35:34.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110439 2020-06-12T02:35:34.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747750+0000", 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012461573 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.216 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:183 1.ds0 1:bb6dbdab:::smithi14213939-46:head [setxattr _header (56) in=7b,truncate 2756315] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.216 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:34.216 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2268825760000004, 2020-06-12T02:35:34.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012270312, 2020-06-12T02:35:34.217 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.217 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.217 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.217 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.217 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 183 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:34.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735759+0000", 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0630000000000002e-05 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735800+0000", 2020-06-12T02:35:34.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:35:34.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735804+0000", 2020-06-12T02:35:34.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4160000000000001e-06 2020-06-12T02:35:34.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735810+0000", 2020-06-12T02:35:34.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3170000000000002e-06 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735813+0000", 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9417e-05 2020-06-12T02:35:34.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735913+0000", 2020-06-12T02:35:34.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020714999999999999 2020-06-12T02:35:34.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736120+0000", 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040667250000000002 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740187+0000", 2020-06-12T02:35:34.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143969 2020-06-12T02:35:34.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740331+0000", 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064127699999999999 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.740972+0000", 2020-06-12T02:35:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002884696 2020-06-12T02:35:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743857+0000", 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040699050000000004 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.747927+0000", 2020-06-12T02:35:34.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103037 2020-06-12T02:35:34.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748030+0000", 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012270312 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.232 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:184 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:34.232 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:34.232 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2268017999999996, 2020-06-12T02:35:34.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014384129000000001, 2020-06-12T02:35:34.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.233 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.233 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 184 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:34.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735840+0000", 2020-06-12T02:35:34.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3234000000000002e-05 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735863+0000", 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3569999999999998e-06 2020-06-12T02:35:34.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735867+0000", 2020-06-12T02:35:34.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.934e-06 2020-06-12T02:35:34.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735874+0000", 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3779999999999999e-06 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735876+0000", 2020-06-12T02:35:34.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028229200000000001 2020-06-12T02:35:34.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736158+0000", 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6572999999999999e-05 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.736245+0000", 2020-06-12T02:35:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072511590000000001 2020-06-12T02:35:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743496+0000", 2020-06-12T02:35:34.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5433000000000006e-05 2020-06-12T02:35:34.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.743591+0000", 2020-06-12T02:35:34.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048337859999999996 2020-06-12T02:35:34.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748425+0000", 2020-06-12T02:35:34.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2206999999999995e-05 2020-06-12T02:35:34.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.748497+0000", 2020-06-12T02:35:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001726776 2020-06-12T02:35:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.750224+0000", 2020-06-12T02:35:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014384129000000001 2020-06-12T02:35:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(osd.0.14:1 1.ds0 1:b3d4b74b:::smithi14213939-29:head [assert-version v12,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.099506+0000", 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.8631357089999998, 2020-06-12T02:35:34.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013029358, 2020-06-12T02:35:34.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.248 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.248 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099506+0000", 2020-06-12T02:35:34.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099506+0000", 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0516e-05 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099587+0000", 2020-06-12T02:35:34.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:35:34.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099599+0000", 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.859e-05 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099617+0000", 2020-06-12T02:35:34.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2099999999999993e-06 2020-06-12T02:35:34.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099625+0000", 2020-06-12T02:35:34.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000126136 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099752+0000", 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7852e-05 2020-06-12T02:35:34.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:35:34.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.099779+0000", 2020-06-12T02:35:34.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076441490000000003 2020-06-12T02:35:34.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.107424+0000", 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119867 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.107543+0000", 2020-06-12T02:35:34.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049920920000000001 2020-06-12T02:35:34.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.112536+0000", 2020-06-12T02:35:34.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013029358 2020-06-12T02:35:34.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.258 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:218 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~2756315,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e24)", 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122084+0000", 2020-06-12T02:35:34.259 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.8405580000000001, 2020-06-12T02:35:34.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095126810000000003, 2020-06-12T02:35:34.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.260 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 218 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122084+0000", 2020-06-12T02:35:34.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122084+0000", 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103457 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122187+0000", 2020-06-12T02:35:34.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2777e-05 2020-06-12T02:35:34.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122200+0000", 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8082999999999999e-05 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122218+0000", 2020-06-12T02:35:34.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4379999999999995e-06 2020-06-12T02:35:34.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122227+0000", 2020-06-12T02:35:34.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032024199999999999 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122547+0000", 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4715999999999993e-05 2020-06-12T02:35:34.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122632+0000", 2020-06-12T02:35:34.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0089649680000000002 2020-06-12T02:35:34.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131597+0000", 2020-06-12T02:35:34.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095126810000000003 2020-06-12T02:35:34.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:219 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~2756315,checksum] snapc 0=[] ondisk+read+known_if_redirected e24)", 2020-06-12T02:35:34.270 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122316+0000", 2020-06-12T02:35:34.271 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.8403257649999998, 2020-06-12T02:35:34.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011227679000000001, 2020-06-12T02:35:34.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.272 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 219 2020-06-12T02:35:34.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.272 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122316+0000", 2020-06-12T02:35:34.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122316+0000", 2020-06-12T02:35:34.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103229 2020-06-12T02:35:34.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122419+0000", 2020-06-12T02:35:34.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5690000000000005e-06 2020-06-12T02:35:34.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122428+0000", 2020-06-12T02:35:34.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:35:34.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122443+0000", 2020-06-12T02:35:34.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.404e-06 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122449+0000", 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052422799999999996 2020-06-12T02:35:34.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122973+0000", 2020-06-12T02:35:34.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012108 2020-06-12T02:35:34.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123094+0000", 2020-06-12T02:35:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010449318000000001 2020-06-12T02:35:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.133544+0000", 2020-06-12T02:35:34.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011227679000000001 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.282 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:220 1.ds0 1:bb6dbdab:::smithi14213939-46:head [sparse-read 0~2756315] snapc 0=[] ondisk+read+known_if_redirected e24)", 2020-06-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122503+0000", 2020-06-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.8401389770000001, 2020-06-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383666000000001, 2020-06-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 220 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.284 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122503+0000", 2020-06-12T02:35:34.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122503+0000", 2020-06-12T02:35:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8987000000000003e-05 2020-06-12T02:35:34.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122562+0000", 2020-06-12T02:35:34.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8399999999999995e-06 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122570+0000", 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5038000000000001e-05 2020-06-12T02:35:34.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122585+0000", 2020-06-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7069999999999997e-06 2020-06-12T02:35:34.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122590+0000", 2020-06-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091087789999999991 2020-06-12T02:35:34.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131699+0000", 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131789+0000", 2020-06-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040971389999999996 2020-06-12T02:35:34.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.135887+0000", 2020-06-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383666000000001 2020-06-12T02:35:34.293 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.294 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpRead(1.ds0 24/18 ECSubRead(tid=73, to_read={1:bb6dbdab:::smithi14213939-46:head=0,1380352,0}, subchunks={1:bb6dbdab:::smithi14213939-46:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122905+0000", 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.8397364270000001, 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070498339999999996, 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.295 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122905+0000", 2020-06-12T02:35:34.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122905+0000", 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122905+0000", 2020-06-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122905+0000", 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1600000000000005e-05 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122987+0000", 2020-06-12T02:35:34.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0261999999999999e-05 2020-06-12T02:35:34.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122997+0000", 2020-06-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000443752 2020-06-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123441+0000", 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065142200000000003 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129955+0000", 2020-06-12T02:35:34.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070498339999999996 2020-06-12T02:35:34.303 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.303 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.303 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.303 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.304 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.304 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:34.307 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:34.307 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:34.308 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:34.308 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:34.308 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:34.308 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.308 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:34.310 INFO:tasks.rados.rados.0.smithi142.stdout:77: done (3 left) 2020-06-12T02:35:34.310 INFO:tasks.rados.rados.0.smithi142.stdout:78: done (2 left) 2020-06-12T02:35:34.310 INFO:tasks.rados.rados.0.smithi142.stdout:79: done (1 left) 2020-06-12T02:35:34.310 INFO:tasks.rados.rados.0.smithi142.stdout:80: done (0 left) 2020-06-12T02:35:34.311 INFO:tasks.rados.rados.0.smithi142.stdout:81: read oid 21 snap -1 2020-06-12T02:35:34.311 INFO:tasks.rados.rados.0.smithi142.stdout:81: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:35:34.311 INFO:tasks.rados.rados.0.smithi142.stdout:82: rollback oid 3 current snap is 4 2020-06-12T02:35:34.311 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 3 to 3 2020-06-12T02:35:34.312 INFO:tasks.rados.rados.0.smithi142.stdout:83: snap_create 2020-06-12T02:35:34.312 INFO:tasks.rados.rados.0.smithi142.stdout:82: finishing rollback tid 0 to smithi14213939-3 2020-06-12T02:35:34.312 INFO:tasks.rados.rados.0.smithi142.stdout:82: finishing rollback tid 1 to smithi14213939-3 2020-06-12T02:35:34.312 INFO:tasks.rados.rados.0.smithi142.stdout:82: finishing rollback tid 2 to smithi14213939-3 2020-06-12T02:35:34.312 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 3 v 28 (ObjNum 2 snap 0 seq_num 2) dirty exists 2020-06-12T02:35:34.313 INFO:tasks.rados.rados.0.smithi142.stdout:81: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:35:34.313 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:35:34.313 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:34.304+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:34.406 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:34.407+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:34.459 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:34.461 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:34.470 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:34.524 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:34.520+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:34.577 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:34.578 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:34.586 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:34.628 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:34.628+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:34.726 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:34.724+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:34.738 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:34.738 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:34.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:189 1.1s0 1:82c302db:::smithi14213939-48:head [write 789929~634821,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9803435870000001, 2020-06-12T02:35:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002, 2020-06-12T02:35:34.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.741 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2020-06-12T02:35:34.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.741 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:34.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023093300000000001 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759588+0000", 2020-06-12T02:35:34.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4509999999999997e-06 2020-06-12T02:35:34.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759595+0000", 2020-06-12T02:35:34.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7010000000000008e-06 2020-06-12T02:35:34.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759604+0000", 2020-06-12T02:35:34.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1289999999999998e-06 2020-06-12T02:35:34.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759611+0000", 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3968999999999997e-05 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759675+0000", 2020-06-12T02:35:34.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021891900000000001 2020-06-12T02:35:34.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759894+0000", 2020-06-12T02:35:34.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001270703 2020-06-12T02:35:34.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.761165+0000", 2020-06-12T02:35:34.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00150369 2020-06-12T02:35:34.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.762669+0000", 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043003470000000004 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766969+0000", 2020-06-12T02:35:34.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5901999999999993e-05 2020-06-12T02:35:34.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767035+0000", 2020-06-12T02:35:34.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002 2020-06-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.754 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=24, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:34.754 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:34.754 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9729103629999996, 2020-06-12T02:35:34.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061191200000000005, 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:34.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766790+0000", 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3546e-05 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766824+0000", 2020-06-12T02:35:34.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9850000000000003e-06 2020-06-12T02:35:34.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766830+0000", 2020-06-12T02:35:34.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9080000000000001e-06 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766839+0000", 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2270000000000004e-06 2020-06-12T02:35:34.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766843+0000", 2020-06-12T02:35:34.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8799999999999999e-05 2020-06-12T02:35:34.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766902+0000", 2020-06-12T02:35:34.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050044599999999999 2020-06-12T02:35:34.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767402+0000", 2020-06-12T02:35:34.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061191200000000005 2020-06-12T02:35:34.762 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.763 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.763 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:190 1.1s0 1:82c302db:::smithi14213939-48:head [write 2050536~739393] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.764 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:34.764 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9724548630000003, 2020-06-12T02:35:34.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429, 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 190 2020-06-12T02:35:34.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.766 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:34.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029680499999999997 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767543+0000", 2020-06-12T02:35:34.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5650000000000007e-06 2020-06-12T02:35:34.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767552+0000", 2020-06-12T02:35:34.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3889000000000001e-05 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767576+0000", 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9229999999999997e-06 2020-06-12T02:35:34.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767586+0000", 2020-06-12T02:35:34.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2401999999999997e-05 2020-06-12T02:35:34.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767639+0000", 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015624000000000001 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767795+0000", 2020-06-12T02:35:34.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001732513 2020-06-12T02:35:34.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769527+0000", 2020-06-12T02:35:34.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033399290000000002 2020-06-12T02:35:34.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772867+0000", 2020-06-12T02:35:34.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022057689999999998 2020-06-12T02:35:34.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775073+0000", 2020-06-12T02:35:34.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6394000000000001e-05 2020-06-12T02:35:34.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775149+0000", 2020-06-12T02:35:34.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.779 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:191 1.1s0 1:82c302db:::smithi14213939-48:head [setxattr _header (56) in=7b,truncate 2789929] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:34.780 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:34.780 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9720673360000003, 2020-06-12T02:35:34.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997, 2020-06-12T02:35:34.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.780 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 191 2020-06-12T02:35:34.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:34.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0799999999999998e-05 2020-06-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767724+0000", 2020-06-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8809999999999996e-06 2020-06-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767732+0000", 2020-06-12T02:35:34.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2539e-05 2020-06-12T02:35:34.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767745+0000", 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3629999999999996e-06 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767752+0000", 2020-06-12T02:35:34.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036784539999999998 2020-06-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771431+0000", 2020-06-12T02:35:34.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109088 2020-06-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771540+0000", 2020-06-12T02:35:34.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075071299999999997 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772290+0000", 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00092961699999999999 2020-06-12T02:35:34.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773220+0000", 2020-06-12T02:35:34.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025830850000000002 2020-06-12T02:35:34.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775803+0000", 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170428 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775973+0000", 2020-06-12T02:35:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997 2020-06-12T02:35:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.795 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:192 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:34.795 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:34.796 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9719130319999998, 2020-06-12T02:35:34.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999, 2020-06-12T02:35:34.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.797 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.797 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 192 2020-06-12T02:35:34.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.798 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:34.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:35:34.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767818+0000", 2020-06-12T02:35:34.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6110000000000004e-06 2020-06-12T02:35:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767822+0000", 2020-06-12T02:35:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8060000000000006e-06 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767832+0000", 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3510000000000004e-06 2020-06-12T02:35:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767836+0000", 2020-06-12T02:35:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050647340000000004 2020-06-12T02:35:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772901+0000", 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109873 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773011+0000", 2020-06-12T02:35:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035580400000000002 2020-06-12T02:35:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776569+0000", 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6688999999999996e-05 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776656+0000", 2020-06-12T02:35:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001371709 2020-06-12T02:35:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778027+0000", 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=25, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9708079720000002, 2020-06-12T02:35:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038996019999999998, 2020-06-12T02:35:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768893+0000", 2020-06-12T02:35:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0754000000000006e-05 2020-06-12T02:35:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768974+0000", 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1004e-05 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.768985+0000", 2020-06-12T02:35:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1078999999999999e-05 2020-06-12T02:35:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769006+0000", 2020-06-12T02:35:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6809999999999998e-06 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769013+0000", 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037642629999999999 2020-06-12T02:35:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772778+0000", 2020-06-12T02:35:34.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4820999999999999e-05 2020-06-12T02:35:34.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772792+0000", 2020-06-12T02:35:34.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038996019999999998 2020-06-12T02:35:34.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.818 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=25, last_complete=21'1, committed=1, applied=1))", 2020-06-12T02:35:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9702482320000003, 2020-06-12T02:35:34.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034158930000000001, 2020-06-12T02:35:34.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.820 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.820 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:34.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769453+0000", 2020-06-12T02:35:34.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9397999999999998e-05 2020-06-12T02:35:34.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769492+0000", 2020-06-12T02:35:34.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5809999999999999e-06 2020-06-12T02:35:34.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769500+0000", 2020-06-12T02:35:34.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2683999999999999e-05 2020-06-12T02:35:34.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769512+0000", 2020-06-12T02:35:34.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5160000000000002e-06 2020-06-12T02:35:34.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769518+0000", 2020-06-12T02:35:34.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033130910000000002 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772831+0000", 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7623000000000002e-05 2020-06-12T02:35:34.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772868+0000", 2020-06-12T02:35:34.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034158930000000001 2020-06-12T02:35:34.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.829 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.829 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.829 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 21/18 ECSubWriteReply(tid=27, last_complete=21'3, committed=1, applied=1))", 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.964244066, 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010889020000000001, 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.830 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:34.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775457+0000", 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0878999999999995e-05 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775548+0000", 2020-06-12T02:35:34.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3131e-05 2020-06-12T02:35:34.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775561+0000", 2020-06-12T02:35:34.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2762e-05 2020-06-12T02:35:34.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775584+0000", 2020-06-12T02:35:34.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0137e-05 2020-06-12T02:35:34.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775594+0000", 2020-06-12T02:35:34.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1502999999999998e-05 2020-06-12T02:35:34.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775645+0000", 2020-06-12T02:35:34.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090048999999999999 2020-06-12T02:35:34.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776546+0000", 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010889020000000001 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 24/18 ECSubWrite(tid=71, reqid=client.4555.0:217, at_version=24'17, trim_to=0'0, roll_forward_to=21'15))", 2020-06-12T02:35:34.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.117512+0000", 2020-06-12T02:35:34.840 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6221886080000001, 2020-06-12T02:35:34.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002380124, 2020-06-12T02:35:34.841 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.841 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.841 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117512+0000", 2020-06-12T02:35:34.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117512+0000", 2020-06-12T02:35:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111055 2020-06-12T02:35:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117623+0000", 2020-06-12T02:35:34.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6026000000000003e-05 2020-06-12T02:35:34.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117669+0000", 2020-06-12T02:35:34.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8806000000000002e-05 2020-06-12T02:35:34.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117698+0000", 2020-06-12T02:35:34.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3947999999999999e-05 2020-06-12T02:35:34.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117712+0000", 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9617999999999996e-05 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117792+0000", 2020-06-12T02:35:34.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5264000000000002e-05 2020-06-12T02:35:34.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.117807+0000", 2020-06-12T02:35:34.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020408119999999999 2020-06-12T02:35:34.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.119848+0000", 2020-06-12T02:35:34.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4595000000000002e-05 2020-06-12T02:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.119892+0000", 2020-06-12T02:35:34.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002380124 2020-06-12T02:35:34.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.852 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.853 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 24/18 ECSubWrite(tid=72, reqid=client.4555.0:217, at_version=0'0, trim_to=0'0, roll_forward_to=24'17))", 2020-06-12T02:35:34.853 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:34.853 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6176715380000002, 2020-06-12T02:35:34.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058427949999999996, 2020-06-12T02:35:34.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:34.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:34.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4416e-05 2020-06-12T02:35:34.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122104+0000", 2020-06-12T02:35:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7728e-05 2020-06-12T02:35:34.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122121+0000", 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9908999999999999e-05 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122141+0000", 2020-06-12T02:35:34.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0030999999999999e-05 2020-06-12T02:35:34.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122151+0000", 2020-06-12T02:35:34.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012700999999999999 2020-06-12T02:35:34.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122278+0000", 2020-06-12T02:35:34.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7526e-05 2020-06-12T02:35:34.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122306+0000", 2020-06-12T02:35:34.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005508191 2020-06-12T02:35:34.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127814+0000", 2020-06-12T02:35:34.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7983999999999999e-05 2020-06-12T02:35:34.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127872+0000", 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058427949999999996 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6175761460000002, 2020-06-12T02:35:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:35:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:34.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:34.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:35:34.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:35:34.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:35:34.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:35:34.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:35:34.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:35:34.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:35:34.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:35:34.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:35:34.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:35:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:35:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:35:34.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:35:34.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:35:34.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:35:34.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.882 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.884 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:35:34.884 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:34.884 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.617352704, 2020-06-12T02:35:34.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:35:34.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.886 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:34.886 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.886 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.887 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:35:34.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.888 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:34.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:34.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:35:34.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:35:34.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:35:34.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:35:34.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:35:34.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:35:34.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:35:34.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:35:34.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:35:34.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:35:34.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:35:34.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:35:34.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:35:34.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:35:34.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:35:34.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:35:34.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:34.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:35:34.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:35:34.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:35:34.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:35:34.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:35:34.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:35:34.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:35:34.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:35:34.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.910 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.912 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:223 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:34.912 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:34.912 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6172085169999999, 2020-06-12T02:35:34.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077260039999999999, 2020-06-12T02:35:34.913 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.913 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.914 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.914 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.914 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.915 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 223 2020-06-12T02:35:34.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.915 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:34.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:34.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7363e-05 2020-06-12T02:35:34.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122540+0000", 2020-06-12T02:35:34.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2260000000000002e-06 2020-06-12T02:35:34.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122546+0000", 2020-06-12T02:35:34.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1892999999999999e-05 2020-06-12T02:35:34.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122558+0000", 2020-06-12T02:35:34.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5790000000000003e-06 2020-06-12T02:35:34.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122563+0000", 2020-06-12T02:35:34.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010094279999999999 2020-06-12T02:35:34.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123573+0000", 2020-06-12T02:35:34.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024867200000000002 2020-06-12T02:35:34.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123821+0000", 2020-06-12T02:35:34.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096276900000000004 2020-06-12T02:35:34.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.124784+0000", 2020-06-12T02:35:34.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036262550000000001 2020-06-12T02:35:34.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128411+0000", 2020-06-12T02:35:34.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017171459999999999 2020-06-12T02:35:34.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130128+0000", 2020-06-12T02:35:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0673000000000004e-05 2020-06-12T02:35:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130218+0000", 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077260039999999999 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:224 1.6s0 1:6f0b6341:::smithi14213939-20:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:34.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:34.932 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.61708637, 2020-06-12T02:35:34.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087256139999999996, 2020-06-12T02:35:34.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.933 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.933 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.933 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.933 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 224 2020-06-12T02:35:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:34.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9580999999999998e-05 2020-06-12T02:35:34.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122664+0000", 2020-06-12T02:35:34.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1419999999999998e-06 2020-06-12T02:35:34.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122670+0000", 2020-06-12T02:35:34.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2041e-05 2020-06-12T02:35:34.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122682+0000", 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1010000000000002e-06 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122686+0000", 2020-06-12T02:35:34.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029059950000000002 2020-06-12T02:35:34.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.125592+0000", 2020-06-12T02:35:34.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013933000000000001 2020-06-12T02:35:34.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.125732+0000", 2020-06-12T02:35:34.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047521800000000002 2020-06-12T02:35:34.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.126207+0000", 2020-06-12T02:35:34.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002206338 2020-06-12T02:35:34.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128413+0000", 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002836636 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131250+0000", 2020-06-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0231999999999999e-05 2020-06-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131340+0000", 2020-06-12T02:35:34.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087256139999999996 2020-06-12T02:35:34.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.947 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:225 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:34.948 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:34.948 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.616970078, 2020-06-12T02:35:34.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001, 2020-06-12T02:35:34.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.949 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:34.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:34.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:34.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:34.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 225 2020-06-12T02:35:34.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.950 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:34.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:34.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9922000000000001e-05 2020-06-12T02:35:34.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122781+0000", 2020-06-12T02:35:34.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0399999999999998e-06 2020-06-12T02:35:34.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122787+0000", 2020-06-12T02:35:34.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1926999999999999e-05 2020-06-12T02:35:34.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122799+0000", 2020-06-12T02:35:34.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7280000000000001e-06 2020-06-12T02:35:34.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122802+0000", 2020-06-12T02:35:34.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004465063 2020-06-12T02:35:34.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127267+0000", 2020-06-12T02:35:34.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014145999999999999 2020-06-12T02:35:34.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127409+0000", 2020-06-12T02:35:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069305699999999996 2020-06-12T02:35:34.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:34.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128102+0000", 2020-06-12T02:35:34.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026151099999999999 2020-06-12T02:35:34.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:34.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130717+0000", 2020-06-12T02:35:34.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057126850000000003 2020-06-12T02:35:34.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:34.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136430+0000", 2020-06-12T02:35:34.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8999999999999995e-05 2020-06-12T02:35:34.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136519+0000", 2020-06-12T02:35:34.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001 2020-06-12T02:35:34.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.6s0 24/18 ECSubWriteReply(tid=30, last_complete=24'8, committed=1, applied=1))", 2020-06-12T02:35:34.966 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.129539+0000", 2020-06-12T02:35:34.966 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6101615979999999, 2020-06-12T02:35:34.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00044886900000000001, 2020-06-12T02:35:34.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.967 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.967 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129539+0000", 2020-06-12T02:35:34.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129539+0000", 2020-06-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1320000000000003e-05 2020-06-12T02:35:34.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129591+0000", 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9269999999999994e-06 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129599+0000", 2020-06-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4496e-05 2020-06-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129614+0000", 2020-06-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1209999999999996e-06 2020-06-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129623+0000", 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034282200000000001 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129966+0000", 2020-06-12T02:35:34.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2183000000000001e-05 2020-06-12T02:35:34.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129988+0000", 2020-06-12T02:35:34.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00044886900000000001 2020-06-12T02:35:34.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.6s0 24/18 ECSubWriteReply(tid=30, last_complete=24'8, committed=1, applied=1))", 2020-06-12T02:35:34.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.129768+0000", 2020-06-12T02:35:34.977 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.609932626, 2020-06-12T02:35:34.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047870999999999998, 2020-06-12T02:35:34.978 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129768+0000", 2020-06-12T02:35:34.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129768+0000", 2020-06-12T02:35:34.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3087999999999997e-05 2020-06-12T02:35:34.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129821+0000", 2020-06-12T02:35:34.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0510000000000002e-06 2020-06-12T02:35:34.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129830+0000", 2020-06-12T02:35:34.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8298e-05 2020-06-12T02:35:34.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129849+0000", 2020-06-12T02:35:34.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.908e-06 2020-06-12T02:35:34.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.129855+0000", 2020-06-12T02:35:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000157901 2020-06-12T02:35:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130012+0000", 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023446400000000001 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130247+0000", 2020-06-12T02:35:34.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047870999999999998 2020-06-12T02:35:34.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.988 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:34.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.6s0 24/18 ECSubWriteReply(tid=31, last_complete=24'9, committed=1, applied=1))", 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.130981+0000", 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.608719368, 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037635000000000001, 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:34.990 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:34.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:34.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130981+0000", 2020-06-12T02:35:34.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:34.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:34.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130981+0000", 2020-06-12T02:35:34.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3915999999999998e-05 2020-06-12T02:35:34.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:34.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131025+0000", 2020-06-12T02:35:34.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2156e-05 2020-06-12T02:35:34.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:34.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131038+0000", 2020-06-12T02:35:34.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8039000000000001e-05 2020-06-12T02:35:34.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:34.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131056+0000", 2020-06-12T02:35:34.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0334e-05 2020-06-12T02:35:34.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:34.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131066+0000", 2020-06-12T02:35:34.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1625999999999996e-05 2020-06-12T02:35:34.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:34.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131128+0000", 2020-06-12T02:35:34.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023027900000000001 2020-06-12T02:35:34.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:34.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:34.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:34.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131358+0000", 2020-06-12T02:35:35.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037635000000000001 2020-06-12T02:35:35.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.000 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:35.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.001 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.6s0 24/18 ECSubWriteReply(tid=32, last_complete=24'10, committed=1, applied=1))", 2020-06-12T02:35:35.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.136079+0000", 2020-06-12T02:35:35.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6036214690000001, 2020-06-12T02:35:35.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014793950000000001, 2020-06-12T02:35:35.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:35.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:35.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:35.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136079+0000", 2020-06-12T02:35:35.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:35.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:35.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136079+0000", 2020-06-12T02:35:35.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4326000000000005e-05 2020-06-12T02:35:35.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:35.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136164+0000", 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6141e-05 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136180+0000", 2020-06-12T02:35:35.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4209000000000001e-05 2020-06-12T02:35:35.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:35.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136204+0000", 2020-06-12T02:35:35.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.401e-05 2020-06-12T02:35:35.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136218+0000", 2020-06-12T02:35:35.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5446999999999999e-05 2020-06-12T02:35:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136283+0000", 2020-06-12T02:35:35.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012752620000000001 2020-06-12T02:35:35.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:35.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.137559+0000", 2020-06-12T02:35:35.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014793950000000001 2020-06-12T02:35:35.017 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.017 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:35.017 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.018 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(1.1s0 24/18 ECSubWriteReply(tid=34, last_complete=24'5, committed=1, applied=1))", 2020-06-12T02:35:35.018 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.156151+0000", 2020-06-12T02:35:35.018 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.5835496610000002, 2020-06-12T02:35:35.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088521800000000001, 2020-06-12T02:35:35.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156151+0000", 2020-06-12T02:35:35.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:35.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:35.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156151+0000", 2020-06-12T02:35:35.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7825999999999996e-05 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156239+0000", 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.331e-05 2020-06-12T02:35:35.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:35.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156252+0000", 2020-06-12T02:35:35.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0395999999999999e-05 2020-06-12T02:35:35.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:35.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156273+0000", 2020-06-12T02:35:35.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1470000000000001e-06 2020-06-12T02:35:35.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156281+0000", 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6886999999999999e-05 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:35.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156338+0000", 2020-06-12T02:35:35.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069865200000000002 2020-06-12T02:35:35.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:35.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157036+0000", 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088521800000000001 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:35.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:35.027 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:35.027 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:35.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:35.031+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:35.029 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:35.129 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:35.131+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:35.146 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:35.146 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:35.147 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:35.147 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:35.152 INFO:tasks.rados.rados.0.smithi142.stdout:81: done (2 left) 2020-06-12T02:35:35.153 INFO:tasks.rados.rados.0.smithi142.stdout:82: done (1 left) 2020-06-12T02:35:35.153 INFO:tasks.rados.rados.0.smithi142.stdout:83: done (0 left) 2020-06-12T02:35:35.153 INFO:tasks.rados.rados.0.smithi142.stdout:84: copy_from oid 31 from oid 15 current snap is 5 2020-06-12T02:35:35.153 INFO:tasks.rados.rados.0.smithi142.stdout:85: write (excl) oid 37 current snap is 5 2020-06-12T02:35:35.154 INFO:tasks.rados.rados.0.smithi142.stdout:85: seq_num 61 ranges {625227=721013,1952931=704669} 2020-06-12T02:35:35.157 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:35.164 INFO:tasks.rados.rados.0.smithi142.stdout:85: writing smithi14213939-37 from 625227 to 1346240 tid 1 2020-06-12T02:35:35.173 INFO:tasks.rados.rados.0.smithi142.stdout:85: writing smithi14213939-37 from 1952931 to 2657600 tid 2 2020-06-12T02:35:35.173 INFO:tasks.rados.rados.0.smithi142.stdout:86: read oid 44 snap 3 2020-06-12T02:35:35.173 INFO:tasks.rados.rados.0.smithi142.stdout:86: expect (ObjNum 43 snap 0 seq_num 43) 2020-06-12T02:35:35.173 INFO:tasks.rados.rados.0.smithi142.stdout:87: rollback oid 34 current snap is 5 2020-06-12T02:35:35.174 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 34 to 3 2020-06-12T02:35:35.174 INFO:tasks.rados.rados.0.smithi142.stdout:88: snap_remove snap 4 2020-06-12T02:35:35.247 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:35.247+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:35.306 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:35.307 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:35.324 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:35.371 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:35.367+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:35.432 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:35.432+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:35.486 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:197 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 423543~785319,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.698427379, 2020-06-12T02:35:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994, 2020-06-12T02:35:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 197 2020-06-12T02:35:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001251102 2020-06-12T02:35:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788888+0000", 2020-06-12T02:35:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2089999999999994e-06 2020-06-12T02:35:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788897+0000", 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6551000000000001e-05 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788914+0000", 2020-06-12T02:35:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:35:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788920+0000", 2020-06-12T02:35:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4307000000000002e-05 2020-06-12T02:35:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788955+0000", 2020-06-12T02:35:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017733199999999999 2020-06-12T02:35:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.789132+0000", 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018899590000000001 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.791022+0000", 2020-06-12T02:35:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025592739999999998 2020-06-12T02:35:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.793581+0000", 2020-06-12T02:35:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020861529999999999 2020-06-12T02:35:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795667+0000", 2020-06-12T02:35:35.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8508000000000001e-05 2020-06-12T02:35:35.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795746+0000", 2020-06-12T02:35:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994 2020-06-12T02:35:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:198 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 1767500~799008] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.6902651359999998, 2020-06-12T02:35:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782, 2020-06-12T02:35:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 198 2020-06-12T02:35:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099562999999999995 2020-06-12T02:35:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796795+0000", 2020-06-12T02:35:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1195e-05 2020-06-12T02:35:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796806+0000", 2020-06-12T02:35:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4831e-05 2020-06-12T02:35:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796831+0000", 2020-06-12T02:35:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3913e-05 2020-06-12T02:35:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796844+0000", 2020-06-12T02:35:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5038999999999999e-05 2020-06-12T02:35:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796909+0000", 2020-06-12T02:35:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000111087 2020-06-12T02:35:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797021+0000", 2020-06-12T02:35:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014743670000000001 2020-06-12T02:35:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.798495+0000", 2020-06-12T02:35:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029768920000000001 2020-06-12T02:35:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801472+0000", 2020-06-12T02:35:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037560470000000002 2020-06-12T02:35:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805228+0000", 2020-06-12T02:35:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0780999999999999e-05 2020-06-12T02:35:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805299+0000", 2020-06-12T02:35:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782 2020-06-12T02:35:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:199 1.3s0 1:cff5b50f:::smithi14213939-50:head [setxattr _header (56) in=7b,truncate 2823543] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.6891367529999997, 2020-06-12T02:35:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995, 2020-06-12T02:35:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 199 2020-06-12T02:35:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106302 2020-06-12T02:35:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797034+0000", 2020-06-12T02:35:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0084e-05 2020-06-12T02:35:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797044+0000", 2020-06-12T02:35:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7399999999999999e-05 2020-06-12T02:35:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797061+0000", 2020-06-12T02:35:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0890000000000002e-06 2020-06-12T02:35:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797068+0000", 2020-06-12T02:35:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027601829999999998 2020-06-12T02:35:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799828+0000", 2020-06-12T02:35:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121823 2020-06-12T02:35:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799950+0000", 2020-06-12T02:35:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074876700000000001 2020-06-12T02:35:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.800699+0000", 2020-06-12T02:35:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028159669999999999 2020-06-12T02:35:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.803515+0000", 2020-06-12T02:35:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019210270000000001 2020-06-12T02:35:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805436+0000", 2020-06-12T02:35:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9416000000000001e-05 2020-06-12T02:35:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805505+0000", 2020-06-12T02:35:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995 2020-06-12T02:35:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:200 1.3s0 1:cff5b50f:::smithi14213939-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:35.581 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:35.581 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.6889317080000001, 2020-06-12T02:35:35.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427, 2020-06-12T02:35:35.582 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.582 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:35.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 200 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:35.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:35.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1226e-05 2020-06-12T02:35:35.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797194+0000", 2020-06-12T02:35:35.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0248000000000001e-05 2020-06-12T02:35:35.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797204+0000", 2020-06-12T02:35:35.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7323e-05 2020-06-12T02:35:35.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797221+0000", 2020-06-12T02:35:35.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0959999999999997e-06 2020-06-12T02:35:35.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797227+0000", 2020-06-12T02:35:35.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004271403 2020-06-12T02:35:35.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801499+0000", 2020-06-12T02:35:35.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0492000000000001e-05 2020-06-12T02:35:35.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:35.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801579+0000", 2020-06-12T02:35:35.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004303973 2020-06-12T02:35:35.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805883+0000", 2020-06-12T02:35:35.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6344000000000001e-05 2020-06-12T02:35:35.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805939+0000", 2020-06-12T02:35:35.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016273220000000001 2020-06-12T02:35:35.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.807567+0000", 2020-06-12T02:35:35.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427 2020-06-12T02:35:35.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.596 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.597 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=25, reqid=client.4555.0:206, at_version=23'16, trim_to=0'0, roll_forward_to=21'12))", 2020-06-12T02:35:35.597 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:35.598 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3647765710000002, 2020-06-12T02:35:35.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431, 2020-06-12T02:35:35.598 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.599 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.599 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:35.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:35.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017964389999999999 2020-06-12T02:35:35.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123084+0000", 2020-06-12T02:35:35.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8554000000000002e-05 2020-06-12T02:35:35.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123142+0000", 2020-06-12T02:35:35.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4759999999999999e-05 2020-06-12T02:35:35.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123177+0000", 2020-06-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8295999999999999e-05 2020-06-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123196+0000", 2020-06-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3685999999999997e-05 2020-06-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123289+0000", 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6406000000000001e-05 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123316+0000", 2020-06-12T02:35:35.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083341979999999993 2020-06-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131650+0000", 2020-06-12T02:35:35.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015409199999999999 2020-06-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131804+0000", 2020-06-12T02:35:35.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.610 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:35.611 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:35.611 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3581283099999997, 2020-06-12T02:35:35.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574, 2020-06-12T02:35:35.611 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:35.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015987799999999999 2020-06-12T02:35:35.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128096+0000", 2020-06-12T02:35:35.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8012e-05 2020-06-12T02:35:35.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128154+0000", 2020-06-12T02:35:35.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1575000000000001e-05 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128195+0000", 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0976e-05 2020-06-12T02:35:35.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128216+0000", 2020-06-12T02:35:35.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138028 2020-06-12T02:35:35.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128354+0000", 2020-06-12T02:35:35.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1136999999999997e-05 2020-06-12T02:35:35.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128385+0000", 2020-06-12T02:35:35.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050820539999999999 2020-06-12T02:35:35.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133467+0000", 2020-06-12T02:35:35.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1913999999999998e-05 2020-06-12T02:35:35.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133519+0000", 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.627 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=7, reqid=client.4555.0:214, at_version=23'6, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:35.627 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:35.627 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3544471529999997, 2020-06-12T02:35:35.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845, 2020-06-12T02:35:35.627 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.628 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.628 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:35.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:35.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3839999999999997e-05 2020-06-12T02:35:35.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131701+0000", 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2039000000000003e-05 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131733+0000", 2020-06-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2753999999999999e-05 2020-06-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131756+0000", 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3559e-05 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131769+0000", 2020-06-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9615000000000003e-05 2020-06-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131849+0000", 2020-06-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6756e-05 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131865+0000", 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052282830000000002 2020-06-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137094+0000", 2020-06-12T02:35:35.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3998999999999995e-05 2020-06-12T02:35:35.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137158+0000", 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.637 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.638 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.638 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:35.638 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3539134339999999, 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004, 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:35.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104829 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132255+0000", 2020-06-12T02:35:35.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7648e-05 2020-06-12T02:35:35.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132283+0000", 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6242999999999999e-05 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132309+0000", 2020-06-12T02:35:35.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.927e-06 2020-06-12T02:35:35.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132319+0000", 2020-06-12T02:35:35.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095454700000000003 2020-06-12T02:35:35.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133274+0000", 2020-06-12T02:35:35.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2116999999999999e-05 2020-06-12T02:35:35.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133286+0000", 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046015589999999999 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137887+0000", 2020-06-12T02:35:35.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6152999999999998e-05 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137924+0000", 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004 2020-06-12T02:35:35.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.649 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.649 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.650 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=29, reqid=client.4555.0:206, at_version=0'0, trim_to=0'0, roll_forward_to=23'16))", 2020-06-12T02:35:35.650 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:35.650 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3529254809999998, 2020-06-12T02:35:35.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048139669999999997, 2020-06-12T02:35:35.650 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.651 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.651 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133139+0000", 2020-06-12T02:35:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001028658 2020-06-12T02:35:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134167+0000", 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5588999999999999e-05 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134183+0000", 2020-06-12T02:35:35.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7093000000000001e-05 2020-06-12T02:35:35.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134200+0000", 2020-06-12T02:35:35.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1079999999999993e-06 2020-06-12T02:35:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134208+0000", 2020-06-12T02:35:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8622000000000002e-05 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134267+0000", 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1372999999999999e-05 2020-06-12T02:35:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134278+0000", 2020-06-12T02:35:35.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036337880000000002 2020-06-12T02:35:35.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137912+0000", 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0735999999999998e-05 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137953+0000", 2020-06-12T02:35:35.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048139669999999997 2020-06-12T02:35:35.660 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.660 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.661 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.661 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.2s1 23/18 ECSubRead(tid=31, to_read={1:40342bec:::smithi14213939-47:head=1159168,4096,0}, subchunks={1:40342bec:::smithi14213939-47:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:35.661 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3454492150000004, 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044467580000000003, 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:35.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140615+0000", 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2441999999999999e-05 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140647+0000", 2020-06-12T02:35:35.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5429999999999996e-06 2020-06-12T02:35:35.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140655+0000", 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1555e-05 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140666+0000", 2020-06-12T02:35:35.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0039999999999999e-06 2020-06-12T02:35:35.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.140674+0000", 2020-06-12T02:35:35.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041044219999999999 2020-06-12T02:35:35.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.144779+0000", 2020-06-12T02:35:35.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00028279200000000003 2020-06-12T02:35:35.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.145062+0000", 2020-06-12T02:35:35.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044467580000000003 2020-06-12T02:35:35.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.670 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3532671089999999, 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:35:35.671 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.672 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.672 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:35.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:35.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:35:35.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:35:35.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:35:35.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:35:35.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:35.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:35:35.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:35:35.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:35:35.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:35:35.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:35:35.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:35:35.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:35:35.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:35:35.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:35:35.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:35:35.686 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.686 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.686 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3423757280000004, 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:35:35.687 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.688 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.688 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:35:35.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.689 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:35.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:35.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:35:35.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:35:35.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:35:35.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:35:35.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:35:35.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:35:35.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:35:35.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:35:35.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:35:35.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:35:35.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:35:35.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:35:35.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:35:35.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:35:35.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:35:35.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.702 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:35.702 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:35.702 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3412436840000002, 2020-06-12T02:35:35.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:35:35.702 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:35:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:35.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:35:35.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:35:35.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:35:35.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:35:35.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:35:35.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:35:35.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:35:35.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:35:35.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:35:35.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:35:35.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:35:35.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.715 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.715 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3409884989999998, 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:35:35.716 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.717 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:35.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:35.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:35:35.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:35:35.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:35:35.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:35:35.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:35:35.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:35:35.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:35:35.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.729 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.730 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:35:35.730 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:35.730 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3408293120000003, 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.731 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.732 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:35:35.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.732 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:35.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:35.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:35:35.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:35:35.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:35:35.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:35:35.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:35:35.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:35:35.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:35:35.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:35.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:35:35.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:35:35.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:35:35.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:35:35.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:35:35.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:35:35.742 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.bs0 24/18 ECSubRead(tid=59, to_read={1:d9ff502f:::smithi14213939-10:head=909312,4096,0}, subchunks={1:d9ff502f:::smithi14213939-10:head=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:35.743 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.149098+0000", 2020-06-12T02:35:35.744 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3369659570000003, 2020-06-12T02:35:35.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043199859999999996, 2020-06-12T02:35:35.744 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.744 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.744 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149098+0000", 2020-06-12T02:35:35.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149098+0000", 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149098+0000", 2020-06-12T02:35:35.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149098+0000", 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032190819999999998 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.152317+0000", 2020-06-12T02:35:35.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0543999999999999e-05 2020-06-12T02:35:35.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.152328+0000", 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7787000000000007e-05 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.152395+0000", 2020-06-12T02:35:35.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010225729999999999 2020-06-12T02:35:35.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153418+0000", 2020-06-12T02:35:35.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043199859999999996 2020-06-12T02:35:35.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.752 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.753 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.bs0 24/18 ECSubReadReply(tid=59, attrs_read=0))", 2020-06-12T02:35:35.753 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.153410+0000", 2020-06-12T02:35:35.753 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.3326544650000001, 2020-06-12T02:35:35.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004878584, 2020-06-12T02:35:35.754 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.754 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:35.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153410+0000", 2020-06-12T02:35:35.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153410+0000", 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153410+0000", 2020-06-12T02:35:35.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153410+0000", 2020-06-12T02:35:35.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3399000000000001e-05 2020-06-12T02:35:35.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153433+0000", 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1651000000000001e-05 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153445+0000", 2020-06-12T02:35:35.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3421999999999999e-05 2020-06-12T02:35:35.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.153488+0000", 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048001119999999996 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158288+0000", 2020-06-12T02:35:35.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004878584 2020-06-12T02:35:35.762 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.762 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.762 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:283 1.3s0 1:cc10fc1f:::smithi14213939-3:head [append 0~0] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.337481124, 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080712130000000007, 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.763 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.764 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 283 2020-06-12T02:35:35.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:35.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6777000000000001e-05 2020-06-12T02:35:35.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148650+0000", 2020-06-12T02:35:35.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3337e-05 2020-06-12T02:35:35.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148663+0000", 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6353999999999999e-05 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148689+0000", 2020-06-12T02:35:35.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5426000000000001e-05 2020-06-12T02:35:35.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148705+0000", 2020-06-12T02:35:35.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010453199999999999 2020-06-12T02:35:35.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148809+0000", 2020-06-12T02:35:35.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000185174 2020-06-12T02:35:35.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148995+0000", 2020-06-12T02:35:35.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001459751 2020-06-12T02:35:35.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.150454+0000", 2020-06-12T02:35:35.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004308376 2020-06-12T02:35:35.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154763+0000", 2020-06-12T02:35:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016698520000000001 2020-06-12T02:35:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.156432+0000", 2020-06-12T02:35:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022163400000000001 2020-06-12T02:35:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.156654+0000", 2020-06-12T02:35:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080712130000000007 2020-06-12T02:35:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:284 1.3s0 1:cc10fc1f:::smithi14213939-3:head [rollback 7] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.337291859, 2020-06-12T02:35:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007, 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 284 2020-06-12T02:35:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118615 2020-06-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148891+0000", 2020-06-12T02:35:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6863000000000001e-05 2020-06-12T02:35:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148908+0000", 2020-06-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5559999999999998e-05 2020-06-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148943+0000", 2020-06-12T02:35:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2563e-05 2020-06-12T02:35:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148956+0000", 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033915849999999999 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152347+0000", 2020-06-12T02:35:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000232606 2020-06-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152580+0000", 2020-06-12T02:35:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051544500000000001 2020-06-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153095+0000", 2020-06-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001814382 2020-06-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154910+0000", 2020-06-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025672569999999999 2020-06-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157477+0000", 2020-06-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2543000000000002e-05 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157530+0000", 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007 2020-06-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:285 1.3s0 1:cc10fc1f:::smithi14213939-3:head [append 0~0] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.3370113809999999, 2020-06-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003, 2020-06-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:35.799 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:35.799 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:35.799 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:35.799 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 285 2020-06-12T02:35:35.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5648999999999994e-05 2020-06-12T02:35:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149118+0000", 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0005e-05 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149128+0000", 2020-06-12T02:35:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9955000000000001e-05 2020-06-12T02:35:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149148+0000", 2020-06-12T02:35:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4200000000000001e-06 2020-06-12T02:35:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149156+0000", 2020-06-12T02:35:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045664709999999999 2020-06-12T02:35:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153722+0000", 2020-06-12T02:35:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013702000000000001 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153859+0000", 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00060901599999999998 2020-06-12T02:35:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154468+0000", 2020-06-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012189189999999999 2020-06-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.155687+0000", 2020-06-12T02:35:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019438859999999999 2020-06-12T02:35:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157631+0000", 2020-06-12T02:35:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7487000000000001e-05 2020-06-12T02:35:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157678+0000", 2020-06-12T02:35:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003 2020-06-12T02:35:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:35.813 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:35.814 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:35.815 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:35.815+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:35.915 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:35.915+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:35.970 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:35.971 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:35.980 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:36.017 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:36.016+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:36.118 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:36.120+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:36.130 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:36.131 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:36.139 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:36.161 INFO:tasks.rados.rados.0.smithi142.stdout:88: done (4 left) 2020-06-12T02:35:36.161 INFO:tasks.rados.rados.0.smithi142.stdout:89: copy_from oid 20 from oid 9 current snap is 5 2020-06-12T02:35:36.161 INFO:tasks.rados.rados.0.smithi142.stdout:85: finishing write tid 1 to smithi14213939-37 2020-06-12T02:35:36.161 INFO:tasks.rados.rados.0.smithi142.stdout:87: finishing rollback tid 0 to smithi14213939-34 2020-06-12T02:35:36.162 INFO:tasks.rados.rados.0.smithi142.stdout:87: finishing rollback tid 1 to smithi14213939-34 2020-06-12T02:35:36.162 INFO:tasks.rados.rados.0.smithi142.stdout:87: finishing rollback tid 2 to smithi14213939-34 2020-06-12T02:35:36.162 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 34 v 35 (ObjNum 33 snap 0 seq_num 33) dirty exists 2020-06-12T02:35:36.163 INFO:tasks.rados.rados.0.smithi142.stdout:84: finishing copy_from to smithi14213939-31 2020-06-12T02:35:36.163 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-06-12T02:35:36.163 INFO:tasks.rados.rados.0.smithi142.stdout:84: finishing copy_from racing read to smithi14213939-31 2020-06-12T02:35:36.163 INFO:tasks.rados.rados.0.smithi142.stdout:85: finishing write tid 2 to smithi14213939-37 2020-06-12T02:35:36.163 INFO:tasks.rados.rados.0.smithi142.stdout:85: finishing write tid 4 to smithi14213939-37 2020-06-12T02:35:36.164 INFO:tasks.rados.rados.0.smithi142.stdout:86: expect (ObjNum 43 snap 0 seq_num 43) 2020-06-12T02:35:36.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:36.219+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:36.250 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.1250300629999996, 2020-06-12T02:35:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999, 2020-06-12T02:35:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9608e-05 2020-06-12T02:35:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128233+0000", 2020-06-12T02:35:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0374999999999999e-05 2020-06-12T02:35:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128273+0000", 2020-06-12T02:35:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2021999999999999e-05 2020-06-12T02:35:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128305+0000", 2020-06-12T02:35:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2435999999999999e-05 2020-06-12T02:35:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128318+0000", 2020-06-12T02:35:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018382399999999999 2020-06-12T02:35:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128501+0000", 2020-06-12T02:35:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4272e-05 2020-06-12T02:35:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128536+0000", 2020-06-12T02:35:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031735639999999998 2020-06-12T02:35:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131709+0000", 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9300000000000003e-05 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131788+0000", 2020-06-12T02:35:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999 2020-06-12T02:35:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.264 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=7, reqid=client.4555.0:214, at_version=23'6, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:36.264 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131714+0000", 2020-06-12T02:35:36.264 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.1214589779999997, 2020-06-12T02:35:36.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023572710000000002, 2020-06-12T02:35:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131714+0000", 2020-06-12T02:35:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131714+0000", 2020-06-12T02:35:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9351000000000006e-05 2020-06-12T02:35:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131794+0000", 2020-06-12T02:35:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9428999999999999e-05 2020-06-12T02:35:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131823+0000", 2020-06-12T02:35:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1793999999999998e-05 2020-06-12T02:35:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131845+0000", 2020-06-12T02:35:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.022e-05 2020-06-12T02:35:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131855+0000", 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3476e-05 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131918+0000", 2020-06-12T02:35:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2065999999999999e-05 2020-06-12T02:35:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131931+0000", 2020-06-12T02:35:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002068439 2020-06-12T02:35:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133999+0000", 2020-06-12T02:35:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2496000000000005e-05 2020-06-12T02:35:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134071+0000", 2020-06-12T02:35:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023572710000000002 2020-06-12T02:35:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.1212335739999997, 2020-06-12T02:35:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002, 2020-06-12T02:35:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4559000000000001e-05 2020-06-12T02:35:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132024+0000", 2020-06-12T02:35:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5899999999999999e-05 2020-06-12T02:35:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132050+0000", 2020-06-12T02:35:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2875999999999999e-05 2020-06-12T02:35:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132073+0000", 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2930000000000006e-06 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132082+0000", 2020-06-12T02:35:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054950300000000001 2020-06-12T02:35:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132632+0000", 2020-06-12T02:35:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6909999999999999e-05 2020-06-12T02:35:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132649+0000", 2020-06-12T02:35:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046183320000000002 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137267+0000", 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6516000000000001e-05 2020-06-12T02:35:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137303+0000", 2020-06-12T02:35:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002 2020-06-12T02:35:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=9, reqid=client.4555.0:215, at_version=0'0, trim_to=0'0, roll_forward_to=23'7))", 2020-06-12T02:35:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.138586+0000", 2020-06-12T02:35:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.1145874090000003, 2020-06-12T02:35:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026365669999999998, 2020-06-12T02:35:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138586+0000", 2020-06-12T02:35:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138586+0000", 2020-06-12T02:35:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2592e-05 2020-06-12T02:35:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138648+0000", 2020-06-12T02:35:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4517e-05 2020-06-12T02:35:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138663+0000", 2020-06-12T02:35:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3971000000000001e-05 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138677+0000", 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5879999999999997e-06 2020-06-12T02:35:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138682+0000", 2020-06-12T02:35:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8581999999999997e-05 2020-06-12T02:35:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138731+0000", 2020-06-12T02:35:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0012000000000001e-05 2020-06-12T02:35:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138751+0000", 2020-06-12T02:35:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024273910000000001 2020-06-12T02:35:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.141178+0000", 2020-06-12T02:35:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3914e-05 2020-06-12T02:35:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.141222+0000", 2020-06-12T02:35:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026365669999999998 2020-06-12T02:35:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.1074333760000004, 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:35:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:35:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:35:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:35:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:35:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:35:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:35:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:35:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:35:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:35:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:35:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:35:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:35:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:35:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:35:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=35, reqid=client.4555.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=24'5))", 2020-06-12T02:35:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.156964+0000", 2020-06-12T02:35:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.0962090120000001, 2020-06-12T02:35:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001741696, 2020-06-12T02:35:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156964+0000", 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156964+0000", 2020-06-12T02:35:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3314999999999999e-05 2020-06-12T02:35:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157037+0000", 2020-06-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3938999999999999e-05 2020-06-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157061+0000", 2020-06-12T02:35:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5740000000000001e-05 2020-06-12T02:35:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:36.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157087+0000", 2020-06-12T02:35:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2693e-05 2020-06-12T02:35:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157100+0000", 2020-06-12T02:35:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015033900000000001 2020-06-12T02:35:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157250+0000", 2020-06-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4831000000000001e-05 2020-06-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157265+0000", 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001386663 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158652+0000", 2020-06-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4175999999999998e-05 2020-06-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158706+0000", 2020-06-12T02:35:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001741696 2020-06-12T02:35:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:36.328 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:36.328 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:36.330 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:35:36.335 INFO:tasks.rados.rados.0.smithi142.stdout:85: finishing write tid 5 to smithi14213939-37 2020-06-12T02:35:36.335 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 37 v 27 (ObjNum 61 snap 5 seq_num 61) dirty exists 2020-06-12T02:35:36.336 INFO:tasks.rados.rados.0.smithi142.stdout:85: left oid 37 (ObjNum 61 snap 5 seq_num 61) 2020-06-12T02:35:36.336 INFO:tasks.rados.rados.0.smithi142.stdout:89: finishing copy_from to smithi14213939-20 2020-06-12T02:35:36.336 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 20 v 12 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-06-12T02:35:36.337 INFO:tasks.rados.rados.0.smithi142.stdout:84: done (4 left) 2020-06-12T02:35:36.337 INFO:tasks.rados.rados.0.smithi142.stdout:85: done (3 left) 2020-06-12T02:35:36.338 INFO:tasks.rados.rados.0.smithi142.stdout:86: done (2 left) 2020-06-12T02:35:36.338 INFO:tasks.rados.rados.0.smithi142.stdout:87: done (1 left) 2020-06-12T02:35:36.338 INFO:tasks.rados.rados.0.smithi142.stdout:90: delete oid 23 current snap is 5 2020-06-12T02:35:36.339 INFO:tasks.rados.rados.0.smithi142.stdout:89: finishing copy_from racing read to smithi14213939-20 2020-06-12T02:35:36.339 INFO:tasks.rados.rados.0.smithi142.stdout:89: done (1 left) 2020-06-12T02:35:36.340 INFO:tasks.rados.rados.0.smithi142.stdout:90: done (0 left) 2020-06-12T02:35:36.340 INFO:tasks.rados.rados.0.smithi142.stdout:91: copy_from oid 19 from oid 41 current snap is 5 2020-06-12T02:35:36.340 INFO:tasks.rados.rados.0.smithi142.stdout:92: rollback oid 36 current snap is 5 2020-06-12T02:35:36.341 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 36 to 3 2020-06-12T02:35:36.341 INFO:tasks.rados.rados.0.smithi142.stdout:93: copy_from oid 4 from oid 7 current snap is 5 2020-06-12T02:35:36.341 INFO:tasks.rados.rados.0.smithi142.stdout:94: read oid 48 snap 2 2020-06-12T02:35:36.342 INFO:tasks.rados.rados.0.smithi142.stdout:94: expect (ObjNum 47 snap 0 seq_num 47) 2020-06-12T02:35:36.342 INFO:tasks.rados.rados.0.smithi142.stdout:95: write oid 15 current snap is 5 2020-06-12T02:35:36.342 INFO:tasks.rados.rados.0.smithi142.stdout:95: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2020-06-12T02:35:36.343 INFO:tasks.rados.rados.0.smithi142.stdout:95: writing smithi14213939-15 from 658841 to 1130352 tid 1 2020-06-12T02:35:36.343 INFO:tasks.rados.rados.0.smithi142.stdout:95: writing smithi14213939-15 from 1553542 to 2261880 tid 2 2020-06-12T02:35:36.343 INFO:tasks.rados.rados.0.smithi142.stdout:95: writing smithi14213939-15 from 2964119 to 3058841 tid 3 2020-06-12T02:35:36.344 INFO:tasks.rados.rados.0.smithi142.stdout:96: read oid 8 snap -1 2020-06-12T02:35:36.344 INFO:tasks.rados.rados.0.smithi142.stdout:96: expect (ObjNum 7 snap 0 seq_num 7) 2020-06-12T02:35:36.344 INFO:tasks.rados.rados.0.smithi142.stdout:97: read oid 49 snap -1 2020-06-12T02:35:36.344 INFO:tasks.rados.rados.0.smithi142.stdout:97: expect deleted 2020-06-12T02:35:36.345 INFO:tasks.rados.rados.0.smithi142.stdout:98: read oid 16 snap -1 2020-06-12T02:35:36.345 INFO:tasks.rados.rados.0.smithi142.stdout:98: expect (ObjNum 15 snap 0 seq_num 15) 2020-06-12T02:35:36.345 INFO:tasks.rados.rados.0.smithi142.stdout:99: snap_create 2020-06-12T02:35:36.346 INFO:tasks.rados.rados.0.smithi142.stdout:92: finishing rollback tid 0 to smithi14213939-36 2020-06-12T02:35:36.346 INFO:tasks.rados.rados.0.smithi142.stdout:92: finishing rollback tid 1 to smithi14213939-36 2020-06-12T02:35:36.346 INFO:tasks.rados.rados.0.smithi142.stdout:92: finishing rollback tid 2 to smithi14213939-36 2020-06-12T02:35:36.347 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 20 (ObjNum 35 snap 0 seq_num 35) dirty exists 2020-06-12T02:35:36.347 INFO:tasks.rados.rados.0.smithi142.stdout:94: expect (ObjNum 47 snap 0 seq_num 47) 2020-06-12T02:35:36.348 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:36.349 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:36.331+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:36.375 INFO:tasks.rados.rados.0.smithi142.stdout:95: finishing write tid 1 to smithi14213939-15 2020-06-12T02:35:36.375 INFO:tasks.rados.rados.0.smithi142.stdout:91: finishing copy_from to smithi14213939-19 2020-06-12T02:35:36.376 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2020-06-12T02:35:36.376 INFO:tasks.rados.rados.0.smithi142.stdout:91: finishing copy_from racing read to smithi14213939-19 2020-06-12T02:35:36.376 INFO:tasks.rados.rados.0.smithi142.stdout:96: expect (ObjNum 7 snap 0 seq_num 7) 2020-06-12T02:35:36.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:36.435+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:36.447 INFO:tasks.rados.rados.0.smithi142.stdout:93: finishing copy_from to smithi14213939-4 2020-06-12T02:35:36.448 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 4 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:35:36.448 INFO:tasks.rados.rados.0.smithi142.stdout:93: finishing copy_from racing read to smithi14213939-4 2020-06-12T02:35:36.448 INFO:tasks.rados.rados.0.smithi142.stdout:95: finishing write tid 2 to smithi14213939-15 2020-06-12T02:35:36.448 INFO:tasks.rados.rados.0.smithi142.stdout:95: finishing write tid 3 to smithi14213939-15 2020-06-12T02:35:36.449 INFO:tasks.rados.rados.0.smithi142.stdout:95: finishing write tid 5 to smithi14213939-15 2020-06-12T02:35:36.449 INFO:tasks.rados.rados.0.smithi142.stdout:95: finishing write tid 6 to smithi14213939-15 2020-06-12T02:35:36.449 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 15 v 19 (ObjNum 63 snap 5 seq_num 63) dirty exists 2020-06-12T02:35:36.449 INFO:tasks.rados.rados.0.smithi142.stdout:95: left oid 15 (ObjNum 63 snap 5 seq_num 63) 2020-06-12T02:35:36.449 INFO:tasks.rados.rados.0.smithi142.stdout:98: expect (ObjNum 15 snap 0 seq_num 15) 2020-06-12T02:35:36.450 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:36.440+0000 7f8483e4a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:36.450 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:36.448+0000 7f8482be8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:36.450 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:36.444+0000 7fa54d2a8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:36.464 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:36.460+0000 7fa547fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:36.488 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:36.489 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:36.489 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:36.489 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:36.490 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:36.498 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:36.513 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:36.532 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:36.541 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:36.543+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:36.558 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:36.578 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:36.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:36.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:36.639+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:36.642 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:36.652 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:36.653 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:36.663 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:36.666 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:36.738 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:36.736+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:36.822 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:36.822 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:36.832 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:36.877 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:36.879+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:36.940 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:36.940+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:36.943 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:36.943 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:36.953 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:37.041 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:37.043+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:37.157 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:37.159+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:37.168 INFO:tasks.rados.rados.0.smithi142.stdout:91: done (8 left) 2020-06-12T02:35:37.168 INFO:tasks.rados.rados.0.smithi142.stdout:92: done (7 left) 2020-06-12T02:35:37.169 INFO:tasks.rados.rados.0.smithi142.stdout:93: done (6 left) 2020-06-12T02:35:37.169 INFO:tasks.rados.rados.0.smithi142.stdout:94: done (5 left) 2020-06-12T02:35:37.169 INFO:tasks.rados.rados.0.smithi142.stdout:95: done (4 left) 2020-06-12T02:35:37.170 INFO:tasks.rados.rados.0.smithi142.stdout:96: done (3 left) 2020-06-12T02:35:37.170 INFO:tasks.rados.rados.0.smithi142.stdout:97: done (2 left) 2020-06-12T02:35:37.170 INFO:tasks.rados.rados.0.smithi142.stdout:98: done (1 left) 2020-06-12T02:35:37.170 INFO:tasks.rados.rados.0.smithi142.stdout:99: done (0 left) 2020-06-12T02:35:37.171 INFO:tasks.rados.rados.0.smithi142.stdout:100: delete oid 8 current snap is 6 2020-06-12T02:35:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:35:37.179 INFO:tasks.rados.rados.0.smithi142.stdout:100: done (0 left) 2020-06-12T02:35:37.180 INFO:tasks.rados.rados.0.smithi142.stdout:101: snap_create 2020-06-12T02:35:37.243 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:37.243+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:37.264 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.265 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.273 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:37.343 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:37.340+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:37.394 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.394 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.399 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:37.484 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:37.484+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:37.545 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:37.544+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:37.551 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.551 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.561 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:37.648 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:37.648+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:37.720 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.720 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.724 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:37.754 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:37.751+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:37.850 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:37.848+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:37.879 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:37.879 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:37.888 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:37.957 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:37.959+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:38.046 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:38.047 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:38.054 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:38.060 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:38.056+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:38.143 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:38.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:38.144 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-06-12T02:35:38.168 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:38.168 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:38.169 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:38.168+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:38.178 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:38.183 INFO:tasks.rados.rados.0.smithi142.stdout:101: done (0 left) 2020-06-12T02:35:38.183 INFO:tasks.rados.rados.0.smithi142.stdout:102: copy_from oid 14 from oid 7 current snap is 7 2020-06-12T02:35:38.184 INFO:tasks.rados.rados.0.smithi142.stdout:103: snap_create 2020-06-12T02:35:38.202 INFO:tasks.rados.rados.0.smithi142.stdout:102: finishing copy_from to smithi14213939-14 2020-06-12T02:35:38.203 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 14 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:35:38.206 INFO:tasks.rados.rados.0.smithi142.stdout:102: finishing copy_from racing read to smithi14213939-14 2020-06-12T02:35:38.262 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.252+0000 7fd581cbe700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:38.259+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:38.266 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.260+0000 7fd580a5c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.292 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:38.293 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:38.305 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:38.394 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:38.392+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:38.423 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 31, 2020-06-12T02:35:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "c120ba75-2438-45f0-aa6e-10a350976a3c", 2020-06-12T02:35:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2020-06-12T02:35:00.134323+0000", 2020-06-12T02:35:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2020-06-12T02:35:38.172946+0000", 2020-06-12T02:35:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:35:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:35:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-06-12T02:35:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5806080, 2020-06-12T02:35:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2020-06-12T02:35:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "nodeep-scrub", 2020-06-12T02:35:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "noscrub", 2020-06-12T02:35:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2020-06-12T02:35:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2020-06-12T02:35:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2020-06-12T02:35:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2020-06-12T02:35:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 6, 2020-06-12T02:35:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.94999998807907104, 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.85000002384185791, 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 1, 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2020-06-12T02:35:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "jewel", 2020-06-12T02:35:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2020-06-12T02:35:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "octopus", 2020-06-12T02:35:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2020-06-12T02:35:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:35:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "unique_pool_0", 2020-06-12T02:35:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2020-06-12T02:35:23.053307+0000", 2020-06-12T02:35:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 8197, 2020-06-12T02:35:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,ec_overwrites,selfmanaged_snaps", 2020-06-12T02:35:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 3, 2020-06-12T02:35:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 3, 2020-06-12T02:35:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 2, 2020-06-12T02:35:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 1, 2020-06-12T02:35:38.431 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2020-06-12T02:35:38.431 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2020-06-12T02:35:38.431 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 16, 2020-06-12T02:35:38.431 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 16, 2020-06-12T02:35:38.432 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 16, 2020-06-12T02:35:38.432 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 16, 2020-06-12T02:35:38.432 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 16, 2020-06-12T02:35:38.432 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2020-06-12T02:35:38.432 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2020-06-12T02:35:38.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.434 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "31", 2020-06-12T02:35:38.434 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2020-06-12T02:35:38.434 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T02:35:38.434 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T02:35:38.434 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 11, 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 31, 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2020-06-12T02:35:38.435 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2020-06-12T02:35:38.436 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2020-06-12T02:35:38.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2020-06-12T02:35:38.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2020-06-12T02:35:38.436 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2020-06-12T02:35:38.436 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2020-06-12T02:35:38.437 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2020-06-12T02:35:38.437 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2020-06-12T02:35:38.437 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2020-06-12T02:35:38.438 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "teuthologyprofile", 2020-06-12T02:35:38.439 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2020-06-12T02:35:38.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2020-06-12T02:35:38.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.439 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2020-06-12T02:35:38.439 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2020-06-12T02:35:38.440 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2020-06-12T02:35:38.441 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 8192, 2020-06-12T02:35:38.441 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2020-06-12T02:35:38.441 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2020-06-12T02:35:38.441 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2020-06-12T02:35:38.441 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2020-06-12T02:35:38.442 INFO:teuthology.orchestra.run.smithi142.stdout: "rados": {} 2020-06-12T02:35:38.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.442 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:38.442 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c", 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.443 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.444 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.444 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.444 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.444 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:38.444 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.446 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2020-06-12T02:35:38.446 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.447 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2020-06-12T02:35:38.447 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.448 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.448 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.448 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.448 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.450 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2020-06-12T02:35:38.450 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.451 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.451 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2020-06-12T02:35:38.451 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.452 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.453 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2020-06-12T02:35:38.453 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.454 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2020-06-12T02:35:38.454 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.455 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.455 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.455 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.456 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.456 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2020-06-12T02:35:38.456 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.457 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.457 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2020-06-12T02:35:38.457 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:35:38.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.458 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6811/12037", 2020-06-12T02:35:38.458 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6813/12037", 2020-06-12T02:35:38.458 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6817/12037", 2020-06-12T02:35:38.459 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/12037", 2020-06-12T02:35:38.459 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.459 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.459 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "74343e4c-0406-4803-8619-520cbc1c60db", 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.460 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.461 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.461 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.461 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.461 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.461 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:38.462 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.462 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.462 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.462 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.462 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.464 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.464 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2020-06-12T02:35:38.464 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.464 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2020-06-12T02:35:38.466 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.466 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.466 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2020-06-12T02:35:38.467 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.467 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.468 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.468 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.468 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2020-06-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.469 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.470 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.471 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.471 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2020-06-12T02:35:38.471 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.472 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2020-06-12T02:35:38.472 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:35:38.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6803/12047", 2020-06-12T02:35:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6805/12047", 2020-06-12T02:35:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6809/12047", 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6807/12047", 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.475 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:35:38.475 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "18348953-2ab3-44d7-9812-308a4e504ffd", 2020-06-12T02:35:38.475 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.475 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.476 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.476 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.476 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.476 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.476 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2020-06-12T02:35:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2020-06-12T02:35:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2020-06-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2020-06-12T02:35:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2020-06-12T02:35:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2020-06-12T02:35:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2020-06-12T02:35:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:35:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6819/12038", 2020-06-12T02:35:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6821/12038", 2020-06-12T02:35:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6825/12038", 2020-06-12T02:35:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6823/12038", 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:35:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "318d0252-36b6-489c-8cc7-eb5245346db4", 2020-06-12T02:35:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2020-06-12T02:35:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2020-06-12T02:35:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2020-06-12T02:35:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6832", 2020-06-12T02:35:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6833", 2020-06-12T02:35:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2020-06-12T02:35:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2020-06-12T02:35:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:35:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6827/12048", 2020-06-12T02:35:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6829/12048", 2020-06-12T02:35:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6833/12048", 2020-06-12T02:35:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6831/12048", 2020-06-12T02:35:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:35:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "e622cde1-ff3b-4df8-9e70-640bb7ce27fd", 2020-06-12T02:35:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6800", 2020-06-12T02:35:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6801", 2020-06-12T02:35:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6802", 2020-06-12T02:35:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6803", 2020-06-12T02:35:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6806", 2020-06-12T02:35:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6807", 2020-06-12T02:35:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6804", 2020-06-12T02:35:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6805", 2020-06-12T02:35:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:35:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6801/12021", 2020-06-12T02:35:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6803/12021", 2020-06-12T02:35:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6807/12021", 2020-06-12T02:35:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6805/12021", 2020-06-12T02:35:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:35:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "f7d22a59-77a8-4264-888e-3e486a4c0d82", 2020-06-12T02:35:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:35:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 0, 2020-06-12T02:35:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6808", 2020-06-12T02:35:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6811", 2020-06-12T02:35:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6814", 2020-06-12T02:35:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6817", 2020-06-12T02:35:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6823", 2020-06-12T02:35:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6828", 2020-06-12T02:35:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6820", 2020-06-12T02:35:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6822", 2020-06-12T02:35:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:35:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6811/12020", 2020-06-12T02:35:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6817/12020", 2020-06-12T02:35:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6828/12020", 2020-06-12T02:35:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6822/12020", 2020-06-12T02:35:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.559 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:35:38.559 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "60e271cc-4c4c-4397-87be-8c52ffab68d4", 2020-06-12T02:35:38.559 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.559 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:38.560 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.561 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.561 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.561 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.561 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6809", 2020-06-12T02:35:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6812", 2020-06-12T02:35:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6815", 2020-06-12T02:35:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6818", 2020-06-12T02:35:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6830", 2020-06-12T02:35:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6831", 2020-06-12T02:35:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6825", 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6826", 2020-06-12T02:35:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:35:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6812/12022", 2020-06-12T02:35:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6818/12022", 2020-06-12T02:35:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6831/12022", 2020-06-12T02:35:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6826/12022", 2020-06-12T02:35:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:35:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "0f243681-edad-4e3d-9980-cfc55c5f93ab", 2020-06-12T02:35:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:35:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:35:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:35:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:35:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:35:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:35:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:35:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:35:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:35:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:35:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:35:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6810", 2020-06-12T02:35:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6813", 2020-06-12T02:35:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:35:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6816", 2020-06-12T02:35:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6819", 2020-06-12T02:35:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6827", 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6829", 2020-06-12T02:35:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.590 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:35:38.590 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:35:38.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:35:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6821", 2020-06-12T02:35:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6824", 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.593 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6813/12023", 2020-06-12T02:35:38.593 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6819/12023", 2020-06-12T02:35:38.593 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6829/12023", 2020-06-12T02:35:38.593 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6824/12023", 2020-06-12T02:35:38.593 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:35:38.594 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:35:38.594 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:35:38.594 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.595 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:38.595 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2020-06-12T02:35:38.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.596 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:35:38.596 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.596 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.597 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.597 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.597 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.597 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.062298+0000", 2020-06-12T02:35:38.597 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.598 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:35:38.598 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.598 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.599 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.599 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.599 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.600 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.896452+0000", 2020-06-12T02:35:38.600 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.600 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.601 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.113001+0000", 2020-06-12T02:35:38.602 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.602 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:35:38.602 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.603 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.603 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.603 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.603 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.603 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.092632+0000", 2020-06-12T02:35:38.604 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.605 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:35:38.605 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.605 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.605 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.606 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.606 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.606 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.886001+0000", 2020-06-12T02:35:38.606 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.607 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:35:38.607 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.607 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.608 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.608 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.608 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.608 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:06.878867+0000", 2020-06-12T02:35:38.608 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:35:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.609 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.610 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.610 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.610 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.610 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.116299+0000", 2020-06-12T02:35:38.610 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.611 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:35:38.611 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:35:38.612 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:35:07.109814+0000", 2020-06-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.613 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2020-06-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2020-06-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2020-06-12T02:35:38.614 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2020-06-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi142.stdout: "blacklist": {}, 2020-06-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2020-06-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2020-06-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:35:38.615 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2020-06-12T02:35:38.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.617 INFO:teuthology.orchestra.run.smithi142.stdout: "teuthologyprofile": { 2020-06-12T02:35:38.617 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-device-class": "", 2020-06-12T02:35:38.617 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:35:38.617 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-root": "default", 2020-06-12T02:35:38.618 INFO:teuthology.orchestra.run.smithi142.stdout: "jerasure-per-chunk-alignment": "false", 2020-06-12T02:35:38.618 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:35:38.618 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van", 2020-06-12T02:35:38.619 INFO:teuthology.orchestra.run.smithi142.stdout: "w": "8" 2020-06-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [ 2020-06-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.620 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi142.stdout: "snaps": [ 2020-06-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 2, 2020-06-12T02:35:38.621 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 2 2020-06-12T02:35:38.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:38.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:38.622 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 8, 2020-06-12T02:35:38.623 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:35:38.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:38.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:38.624 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:35:38.624 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [], 2020-06-12T02:35:38.624 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2020-06-12T02:35:38.624 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2020-06-12T02:35:38.625 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {} 2020-06-12T02:35:38.625 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:38.627 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:38.627 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:38.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:38.627+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:38.629 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': 'c120ba75-2438-45f0-aa6e-10a350976a3c', 'created': '2020-06-12T02:35:00.134323+0000', 'modified': '2020-06-12T02:35:38.172946+0000', 'last_up_change': '2020-06-12T02:35:08.937742+0000', 'last_in_change': '2020-06-12T02:35:08.937742+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 1, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'unique_pool_0', 'create_time': '2020-06-12T02:35:23.053307+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 3, 'min_size': 2, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 11, 'snap_epoch': 31, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'teuthologyprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6810', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6811', 'nonce': 12037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6812', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6813', 'nonce': 12037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6816', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6817', 'nonce': 12037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6814', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6815', 'nonce': 12037}]}, 'public_addr': '172.21.15.142:6811/12037', 'cluster_addr': '172.21.15.142:6813/12037', 'heartbeat_back_addr': '172.21.15.142:6817/12037', 'heartbeat_front_addr': '172.21.15.142:6815/12037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '74343e4c-0406-4803-8619-520cbc1c60db', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 12047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 12047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6808', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6809', 'nonce': 12047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 12047}]}, 'public_addr': '172.21.15.142:6803/12047', 'cluster_addr': '172.21.15.142:6805/12047', 'heartbeat_back_addr': '172.21.15.142:6809/12047', 'heartbeat_front_addr': '172.21.15.142:6807/12047', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18348953-2ab3-44d7-9812-308a4e504ffd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6818', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6819', 'nonce': 12038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6820', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6821', 'nonce': 12038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6824', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6825', 'nonce': 12038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6822', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6823', 'nonce': 12038}]}, 'public_addr': '172.21.15.142:6819/12038', 'cluster_addr': '172.21.15.142:6821/12038', 'heartbeat_back_addr': '172.21.15.142:6825/12038', 'heartbeat_front_addr': '172.21.15.142:6823/12038', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '318d0252-36b6-489c-8cc7-eb5245346db4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6826', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6827', 'nonce': 12048}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6828', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6829', 'nonce': 12048}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 12048}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6830', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6831', 'nonce': 12048}]}, 'public_addr': '172.21.15.142:6827/12048', 'cluster_addr': '172.21.15.142:6829/12048', 'heartbeat_back_addr': '172.21.15.142:6833/12048', 'heartbeat_front_addr': '172.21.15.142:6831/12048', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'e622cde1-ff3b-4df8-9e70-640bb7ce27fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6800', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 12021}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6802', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 12021}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6806', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 12021}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6804', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 12021}]}, 'public_addr': '172.21.15.117:6801/12021', 'cluster_addr': '172.21.15.117:6803/12021', 'heartbeat_back_addr': '172.21.15.117:6807/12021', 'heartbeat_front_addr': '172.21.15.117:6805/12021', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f7d22a59-77a8-4264-888e-3e486a4c0d82', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6808', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 12020}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6814', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6817', 'nonce': 12020}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6823', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6828', 'nonce': 12020}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6820', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6822', 'nonce': 12020}]}, 'public_addr': '172.21.15.117:6811/12020', 'cluster_addr': '172.21.15.117:6817/12020', 'heartbeat_back_addr': '172.21.15.117:6828/12020', 'heartbeat_front_addr': '172.21.15.117:6822/12020', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '60e271cc-4c4c-4397-87be-8c52ffab68d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6809', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 12022}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6815', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6818', 'nonce': 12022}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6830', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6831', 'nonce': 12022}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6825', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6826', 'nonce': 12022}]}, 'public_addr': '172.21.15.117:6812/12022', 'cluster_addr': '172.21.15.117:6818/12022', 'heartbeat_back_addr': '172.21.15.117:6831/12022', 'heartbeat_front_addr': '172.21.15.117:6826/12022', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0f243681-edad-4e3d-9980-cfc55c5f93ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6810', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 12023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6816', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6819', 'nonce': 12023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6827', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6829', 'nonce': 12023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6821', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6824', 'nonce': 12023}]}, 'public_addr': '172.21.15.117:6813/12023', 'cluster_addr': '172.21.15.117:6819/12023', 'heartbeat_back_addr': '172.21.15.117:6829/12023', 'heartbeat_front_addr': '172.21.15.117:6824/12023', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.062298+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.896452+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.113001+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.092632+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.886001+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:06.878867+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.116299+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:35:07.109814+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}, 'teuthologyprofile': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van', 'w': '8'}}, 'removed_snaps_queue': [{'pool': 1, 'snaps': [{'begin': 2, 'length': 2}, {'begin': 8, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-06-12T02:35:38.629 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:38.631 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:38.691 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:38.762 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:38.756+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:38.784 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.776+0000 7f74475c5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.788 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.784+0000 7f74475c5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.823 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:38.824 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:38.843 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:38.843+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:38.844 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:38.861 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.844+0000 7f5424c4d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.862 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:38.848+0000 7f541f59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:38.883 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:38.904 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:38.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:38.942 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:38.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:38.945 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:38.944+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:38.955 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2020-06-12T02:35:38.182166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143650913,"num_objects":72,"num_object_clones":22,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":5,"num_read":143,"num_read_kb":42174,"num_write":264,"num_write_kb":77794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8600140,"kb_used_data":211468,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746374580,"statfs":{"total":773094113280,"available":764287569920,"internally_reserved":8589934592,"allocated":216543232,"data_stored":253834606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19695083,"num_objects":20,"num_object_clones":20,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":41,"num_read_kb":42122,"num_write":55,"num_write_kb":20552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039396"},"pg_stats":[{"pgid":"1.f","version":"21'6","reported_seq":"32","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.155095+0000","last_change":"2020-06-12T02:35:33.155598+0000","last_active":"2020-06-12T02:35:33.155095+0000","last_peered":"2020-06-12T02:35:33.155095+0000","last_clean":"2020-06-12T02:35:33.155095+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:35:33.155095+0000","last_undegraded":"2020-06-12T02:35:33.155095+0000","last_fullsized":"2020-06-12T02:35:33.155095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5092455,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":8,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.e","version":"26'18","reported_seq":"57","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.173933+0000","last_change":"2020-06-12T02:35:36.173933+0000","last_active":"2020-06-12T02:35:36.173933+0000","last_peered":"2020-06-12T02:35:36.173933+0000","last_clean":"2020-06-12T02:35:36.173933+0000","last_became_active":"2020-06-12T02:35:25.071798+0000","last_became_peered":"2020-06-12T02:35:25.071798+0000","last_unstale":"2020-06-12T02:35:36.173933+0000","last_undegraded":"2020-06-12T02:35:36.173933+0000","last_fullsized":"2020-06-12T02:35:36.173933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9510630,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":13301,"num_write":19,"num_write_kb":4767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.d","version":"26'23","reported_seq":"59","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.194537+0000","last_change":"2020-06-12T02:35:33.147229+0000","last_active":"2020-06-12T02:35:33.194537+0000","last_peered":"2020-06-12T02:35:33.194537+0000","last_clean":"2020-06-12T02:35:33.194537+0000","last_became_active":"2020-06-12T02:35:25.081562+0000","last_became_peered":"2020-06-12T02:35:25.081562+0000","last_unstale":"2020-06-12T02:35:33.194537+0000","last_undegraded":"2020-06-12T02:35:33.194537+0000","last_fullsized":"2020-06-12T02:35:33.194537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17075681,"num_objects":8,"num_object_clones":1,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":19,"num_read_kb":8084,"num_write":29,"num_write_kb":8143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.c","version":"26'11","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.150116+0000","last_change":"2020-06-12T02:35:33.150116+0000","last_active":"2020-06-12T02:35:33.150116+0000","last_peered":"2020-06-12T02:35:33.150116+0000","last_clean":"2020-06-12T02:35:33.150116+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:35:33.150116+0000","last_undegraded":"2020-06-12T02:35:33.150116+0000","last_fullsized":"2020-06-12T02:35:33.150116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2016807,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":6,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.b","version":"26'25","reported_seq":"59","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.165924+0000","last_change":"2020-06-12T02:35:36.165924+0000","last_active":"2020-06-12T02:35:36.165924+0000","last_peered":"2020-06-12T02:35:36.165924+0000","last_clean":"2020-06-12T02:35:36.165924+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:35:36.165924+0000","last_undegraded":"2020-06-12T02:35:36.165924+0000","last_fullsized":"2020-06-12T02:35:36.165924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10739716,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":9,"num_read_kb":5,"num_write":23,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.a","version":"26'5","reported_seq":"37","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.172535+0000","last_change":"2020-06-12T02:35:36.172535+0000","last_active":"2020-06-12T02:35:36.172535+0000","last_peered":"2020-06-12T02:35:36.172535+0000","last_clean":"2020-06-12T02:35:36.172535+0000","last_became_active":"2020-06-12T02:35:25.072055+0000","last_became_peered":"2020-06-12T02:35:25.072055+0000","last_unstale":"2020-06-12T02:35:36.172535+0000","last_undegraded":"2020-06-12T02:35:36.172535+0000","last_fullsized":"2020-06-12T02:35:36.172535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5042034,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.9","version":"29'19","reported_seq":"55","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.308704+0000","last_change":"2020-06-12T02:35:36.172187+0000","last_active":"2020-06-12T02:35:36.308704+0000","last_peered":"2020-06-12T02:35:36.308704+0000","last_clean":"2020-06-12T02:35:36.308704+0000","last_became_active":"2020-06-12T02:35:25.070746+0000","last_became_peered":"2020-06-12T02:35:25.070746+0000","last_unstale":"2020-06-12T02:35:36.308704+0000","last_undegraded":"2020-06-12T02:35:36.308704+0000","last_fullsized":"2020-06-12T02:35:36.308704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10620691,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":5508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.8","version":"29'13","reported_seq":"46","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.304366+0000","last_change":"2020-06-12T02:35:36.171725+0000","last_active":"2020-06-12T02:35:36.304366+0000","last_peered":"2020-06-12T02:35:36.304366+0000","last_clean":"2020-06-12T02:35:36.304366+0000","last_became_active":"2020-06-12T02:35:25.073650+0000","last_became_peered":"2020-06-12T02:35:25.073650+0000","last_unstale":"2020-06-12T02:35:36.304366+0000","last_undegraded":"2020-06-12T02:35:36.304366+0000","last_fullsized":"2020-06-12T02:35:36.304366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10084068,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":6175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.7","version":"29'24","reported_seq":"62","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.295258+0000","last_change":"2020-06-12T02:35:36.173232+0000","last_active":"2020-06-12T02:35:36.295258+0000","last_peered":"2020-06-12T02:35:36.295258+0000","last_clean":"2020-06-12T02:35:36.295258+0000","last_became_active":"2020-06-12T02:35:25.075901+0000","last_became_peered":"2020-06-12T02:35:25.075901+0000","last_unstale":"2020-06-12T02:35:36.295258+0000","last_undegraded":"2020-06-12T02:35:36.295258+0000","last_fullsized":"2020-06-12T02:35:36.295258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14151296,"num_objects":7,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":16,"num_read_kb":6853,"num_write":25,"num_write_kb":7344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.6","version":"26'18","reported_seq":"42","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.258464+0000","last_change":"2020-06-12T02:35:33.155022+0000","last_active":"2020-06-12T02:35:33.258464+0000","last_peered":"2020-06-12T02:35:33.258464+0000","last_clean":"2020-06-12T02:35:33.258464+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:35:33.258464+0000","last_undegraded":"2020-06-12T02:35:33.258464+0000","last_fullsized":"2020-06-12T02:35:33.258464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4521017,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":1927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.1","version":"26'9","reported_seq":"34","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.156957+0000","last_change":"2020-06-12T02:35:33.157598+0000","last_active":"2020-06-12T02:35:33.156957+0000","last_peered":"2020-06-12T02:35:33.156957+0000","last_clean":"2020-06-12T02:35:33.156957+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:35:33.156957+0000","last_undegraded":"2020-06-12T02:35:33.156957+0000","last_fullsized":"2020-06-12T02:35:33.156957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5479016,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":5,"num_write_kb":3970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.0","version":"0'0","reported_seq":"31","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.173240+0000","last_change":"2020-06-12T02:35:36.173240+0000","last_active":"2020-06-12T02:35:36.173240+0000","last_peered":"2020-06-12T02:35:36.173240+0000","last_clean":"2020-06-12T02:35:36.173240+0000","last_became_active":"2020-06-12T02:35:25.069671+0000","last_became_peered":"2020-06-12T02:35:25.069671+0000","last_unstale":"2020-06-12T02:35:36.173240+0000","last_undegraded":"2020-06-12T02:35:36.173240+0000","last_fullsized":"2020-06-12T02:35:36.173240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.2","version":"26'31","reported_seq":"57","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.257774+0000","last_change":"2020-06-12T02:35:33.181256+0000","last_active":"2020-06-12T02:35:33.257774+0000","last_peered":"2020-06-12T02:35:33.257774+0000","last_clean":"2020-06-12T02:35:33.257774+0000","last_became_active":"2020-06-12T02:35:25.074852+0000","last_became_peered":"2020-06-12T02:35:25.074852+0000","last_unstale":"2020-06-12T02:35:33.257774+0000","last_undegraded":"2020-06-12T02:35:33.257774+0000","last_fullsized":"2020-06-12T02:35:33.257774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9983226,"num_objects":5,"num_object_clones":1,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":24,"num_write_kb":7822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.3","version":"27'28","reported_seq":"68","reported_epoch":"29","state":"active+clean","last_fresh":"2020-06-12T02:35:36.302806+0000","last_change":"2020-06-12T02:35:36.166019+0000","last_active":"2020-06-12T02:35:36.302806+0000","last_peered":"2020-06-12T02:35:36.302806+0000","last_clean":"2020-06-12T02:35:36.302806+0000","last_became_active":"2020-06-12T02:35:25.070276+0000","last_became_peered":"2020-06-12T02:35:25.070276+0000","last_unstale":"2020-06-12T02:35:36.302806+0000","last_undegraded":"2020-06-12T02:35:36.302806+0000","last_fullsized":"2020-06-12T02:35:36.302806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15406325,"num_objects":8,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":6609,"num_write":30,"num_write_kb":7719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"2"},{"start":"8","length":"1"}]},{"pgid":"1.4","version":"26'16","reported_seq":"47","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.233546+0000","last_change":"2020-06-12T02:35:33.152968+0000","last_active":"2020-06-12T02:35:33.233546+0000","last_peered":"2020-06-12T02:35:33.233546+0000","last_clean":"2020-06-12T02:35:33.233546+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:35:33.233546+0000","last_undegraded":"2020-06-12T02:35:33.233546+0000","last_fullsized":"2020-06-12T02:35:33.233546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11793462,"num_objects":5,"num_object_clones":1,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":7297,"num_write":20,"num_write_kb":5907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"1.5","version":"26'23","reported_seq":"51","reported_epoch":"26","state":"active+clean","last_fresh":"2020-06-12T02:35:33.227514+0000","last_change":"2020-06-12T02:35:33.152654+0000","last_active":"2020-06-12T02:35:33.227514+0000","last_peered":"2020-06-12T02:35:33.227514+0000","last_clean":"2020-06-12T02:35:33.227514+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:35:33.227514+0000","last_undegraded":"2020-06-12T02:35:33.227514+0000","last_fullsized":"2020-06-12T02:35:33.227514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12134489,"num_objects":7,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":11,"num_read_kb":5,"num_write":22,"num_write_kb":5702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"2"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":143650913,"num_objects":72,"num_object_clones":22,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":5,"num_read":143,"num_read_kb":42174,"num_write":264,"num_write_kb":77794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":214188032,"data_stored":252944384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1065188,"kb_used_data":16604,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306652,"statfs":{"total":96636764160,"available":95546011648,"internally_reserved":1073741824,"allocated":17002496,"data_stored":19729831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7770000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2869999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8610000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1076512,"kb_used_data":27928,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93295328,"statfs":{"total":96636764160,"available":95534415872,"internally_reserved":1073741824,"allocated":28598272,"data_stored":33090983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5230000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3969999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.589}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088136,"kb_used_data":39552,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283704,"statfs":{"total":96636764160,"available":95522512896,"internally_reserved":1073741824,"allocated":40501248,"data_stored":50997463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094724,"kb_used_data":46140,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277116,"statfs":{"total":96636764160,"available":95515766784,"internally_reserved":1073741824,"allocated":47247360,"data_stored":56119825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.895}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.246}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.786}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062700,"kb_used_data":14116,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93309140,"statfs":{"total":96636764160,"available":95548559360,"internally_reserved":1073741824,"allocated":14454784,"data_stored":15358167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.827}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.508}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0990000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2440000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1066664,"kb_used_data":18080,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93305176,"statfs":{"total":96636764160,"available":95544500224,"internally_reserved":1073741824,"allocated":18513920,"data_stored":22385757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.823}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.423}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1760000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084044,"kb_used_data":35460,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93287796,"statfs":{"total":96636764160,"available":95526703104,"internally_reserved":1073741824,"allocated":36311040,"data_stored":40146013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.946}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0059999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3980000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062172,"kb_used_data":13588,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93309668,"statfs":{"total":96636764160,"available":95549100032,"internally_reserved":1073741824,"allocated":13914112,"data_stored":16006567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4590000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5619999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9049999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3370000000000002}]}]}]}} 2020-06-12T02:35:38.960 INFO:tasks.thrashosds.thrasher:Setting 1.5 to [2, 6, 1, 7, 3, 4] 2020-06-12T02:35:38.960 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '1.5', '2', '6', '1', '7', '3', '4'] 2020-06-12T02:35:38.961 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 1.5 2 6 1 7 3 4 2020-06-12T02:35:38.979 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:38.981 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:38.981 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:38.983 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:38.983 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:38.992 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:39.005 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:39.031 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:39.047 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:39.047+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:39.056 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:39.058 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.058 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.058 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:39.098 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:39.080+0000 7f573cee1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:39.100 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:39.100+0000 7f573759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:39.119 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:39.119 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:39.119 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:39.120 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:39.120 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:39.129 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:39.172 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:39.172+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:39.186 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:35:39.195 INFO:tasks.rados.rados.0.smithi142.stdout:102: done (1 left) 2020-06-12T02:35:39.195 INFO:tasks.rados.rados.0.smithi142.stdout:103: done (0 left) 2020-06-12T02:35:39.195 INFO:tasks.rados.rados.0.smithi142.stdout:104: delete oid 1 current snap is 8 2020-06-12T02:35:39.202 INFO:tasks.rados.rados.0.smithi142.stdout:104: done (0 left) 2020-06-12T02:35:39.202 INFO:tasks.rados.rados.0.smithi142.stdout:105: snap_remove snap 3 2020-06-12T02:35:39.270 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:39.263+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:39.273 INFO:teuthology.orchestra.run.smithi142.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-06-12T02:35:39.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:35:39.277 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-06-12T02:35:39.278 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:39.278 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:39.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:39.279 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:39.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.279 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:189 1.1s0 1:82c302db:::smithi14213939-48:head [write 789929~634821,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:39.279 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:39.280 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.519559576000001, 2020-06-12T02:35:39.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002, 2020-06-12T02:35:39.280 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.280 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2020-06-12T02:35:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.282 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:39.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759357+0000", 2020-06-12T02:35:39.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023093300000000001 2020-06-12T02:35:39.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759588+0000", 2020-06-12T02:35:39.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4509999999999997e-06 2020-06-12T02:35:39.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759595+0000", 2020-06-12T02:35:39.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7010000000000008e-06 2020-06-12T02:35:39.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759604+0000", 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1289999999999998e-06 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759611+0000", 2020-06-12T02:35:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3968999999999997e-05 2020-06-12T02:35:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759675+0000", 2020-06-12T02:35:39.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021891900000000001 2020-06-12T02:35:39.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.759894+0000", 2020-06-12T02:35:39.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001270703 2020-06-12T02:35:39.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.761165+0000", 2020-06-12T02:35:39.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00150369 2020-06-12T02:35:39.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.762669+0000", 2020-06-12T02:35:39.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043003470000000004 2020-06-12T02:35:39.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.766969+0000", 2020-06-12T02:35:39.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5901999999999993e-05 2020-06-12T02:35:39.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767035+0000", 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076777440000000002 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:190 1.1s0 1:82c302db:::smithi14213939-48:head [write 2050536~739393] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:39.296 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:39.297 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.511670852, 2020-06-12T02:35:39.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429, 2020-06-12T02:35:39.297 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.298 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 190 2020-06-12T02:35:39.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.298 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:39.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767246+0000", 2020-06-12T02:35:39.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029680499999999997 2020-06-12T02:35:39.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767543+0000", 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5650000000000007e-06 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767552+0000", 2020-06-12T02:35:39.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3889000000000001e-05 2020-06-12T02:35:39.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767576+0000", 2020-06-12T02:35:39.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9229999999999997e-06 2020-06-12T02:35:39.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767586+0000", 2020-06-12T02:35:39.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2401999999999997e-05 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767639+0000", 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015624000000000001 2020-06-12T02:35:39.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767795+0000", 2020-06-12T02:35:39.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001732513 2020-06-12T02:35:39.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.769527+0000", 2020-06-12T02:35:39.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033399290000000002 2020-06-12T02:35:39.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772867+0000", 2020-06-12T02:35:39.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022057689999999998 2020-06-12T02:35:39.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775073+0000", 2020-06-12T02:35:39.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6394000000000001e-05 2020-06-12T02:35:39.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775149+0000", 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007903429 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.316 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:191 1.1s0 1:82c302db:::smithi14213939-48:head [setxattr _header (56) in=7b,truncate 2789929] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:39.316 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:39.316 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.511283325000001, 2020-06-12T02:35:39.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997, 2020-06-12T02:35:39.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.318 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.318 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.318 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 191 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:39.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767633+0000", 2020-06-12T02:35:39.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0799999999999998e-05 2020-06-12T02:35:39.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767724+0000", 2020-06-12T02:35:39.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8809999999999996e-06 2020-06-12T02:35:39.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767732+0000", 2020-06-12T02:35:39.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2539e-05 2020-06-12T02:35:39.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767745+0000", 2020-06-12T02:35:39.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3629999999999996e-06 2020-06-12T02:35:39.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767752+0000", 2020-06-12T02:35:39.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036784539999999998 2020-06-12T02:35:39.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771431+0000", 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109088 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.771540+0000", 2020-06-12T02:35:39.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075071299999999997 2020-06-12T02:35:39.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772290+0000", 2020-06-12T02:35:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00092961699999999999 2020-06-12T02:35:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773220+0000", 2020-06-12T02:35:39.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025830850000000002 2020-06-12T02:35:39.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775803+0000", 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170428 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.775973+0000", 2020-06-12T02:35:39.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083399679999999997 2020-06-12T02:35:39.332 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.332 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.333 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.333 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:192 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:39.333 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:39.334 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.511129021, 2020-06-12T02:35:39.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999, 2020-06-12T02:35:39.334 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.334 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.335 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.335 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.335 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 192 2020-06-12T02:35:39.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.335 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:35:39.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:35:39.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767818+0000", 2020-06-12T02:35:39.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6110000000000004e-06 2020-06-12T02:35:39.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767822+0000", 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8060000000000006e-06 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767832+0000", 2020-06-12T02:35:39.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3510000000000004e-06 2020-06-12T02:35:39.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767836+0000", 2020-06-12T02:35:39.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050647340000000004 2020-06-12T02:35:39.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772901+0000", 2020-06-12T02:35:39.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109873 2020-06-12T02:35:39.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:39.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773011+0000", 2020-06-12T02:35:39.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035580400000000002 2020-06-12T02:35:39.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776569+0000", 2020-06-12T02:35:39.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6688999999999996e-05 2020-06-12T02:35:39.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776656+0000", 2020-06-12T02:35:39.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001371709 2020-06-12T02:35:39.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778027+0000", 2020-06-12T02:35:39.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999 2020-06-12T02:35:39.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.350 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.351 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 24/18 ECSubWrite(tid=72, reqid=client.4555.0:217, at_version=0'0, trim_to=0'0, roll_forward_to=24'17))", 2020-06-12T02:35:39.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:39.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1568875270000003, 2020-06-12T02:35:39.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058427949999999996, 2020-06-12T02:35:39.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:39.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122029+0000", 2020-06-12T02:35:39.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4416e-05 2020-06-12T02:35:39.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122104+0000", 2020-06-12T02:35:39.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7728e-05 2020-06-12T02:35:39.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122121+0000", 2020-06-12T02:35:39.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9908999999999999e-05 2020-06-12T02:35:39.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122141+0000", 2020-06-12T02:35:39.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0030999999999999e-05 2020-06-12T02:35:39.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122151+0000", 2020-06-12T02:35:39.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012700999999999999 2020-06-12T02:35:39.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122278+0000", 2020-06-12T02:35:39.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7526e-05 2020-06-12T02:35:39.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122306+0000", 2020-06-12T02:35:39.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005508191 2020-06-12T02:35:39.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127814+0000", 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7983999999999999e-05 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127872+0000", 2020-06-12T02:35:39.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058427949999999996 2020-06-12T02:35:39.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.367 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:39.367 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:39.367 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1567921349999999, 2020-06-12T02:35:39.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:35:39.368 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.368 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.368 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.368 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.369 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:35:39.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.369 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:35:39.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:35:39.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:35:39.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:35:39.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:35:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:35:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:35:39.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:35:39.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:35:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:35:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:35:39.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:35:39.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:35:39.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:35:39.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:35:39.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:35:39.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:35:39.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:35:39.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:35:39.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:35:39.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:35:39.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:35:39.383 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.383 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.383 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.384 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:35:39.384 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:39.384 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1565686930000005, 2020-06-12T02:35:39.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:35:39.385 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.385 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.385 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.385 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.385 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:39.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:35:39.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:35:39.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:35:39.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:35:39.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:35:39.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:35:39.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:35:39.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:35:39.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:35:39.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:35:39.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:35:39.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:35:39.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:35:39.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:35:39.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:35:39.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:39.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:35:39.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:35:39.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:35:39.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:35:39.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:35:39.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:35:39.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:35:39.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:35:39.400 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.400 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.401 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:223 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:39.401 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:39.402 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1564245060000005, 2020-06-12T02:35:39.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077260039999999999, 2020-06-12T02:35:39.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.402 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.402 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.404 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 223 2020-06-12T02:35:39.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.404 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122492+0000", 2020-06-12T02:35:39.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7363e-05 2020-06-12T02:35:39.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122540+0000", 2020-06-12T02:35:39.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2260000000000002e-06 2020-06-12T02:35:39.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122546+0000", 2020-06-12T02:35:39.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1892999999999999e-05 2020-06-12T02:35:39.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122558+0000", 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5790000000000003e-06 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122563+0000", 2020-06-12T02:35:39.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010094279999999999 2020-06-12T02:35:39.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123573+0000", 2020-06-12T02:35:39.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024867200000000002 2020-06-12T02:35:39.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123821+0000", 2020-06-12T02:35:39.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096276900000000004 2020-06-12T02:35:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.124784+0000", 2020-06-12T02:35:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036262550000000001 2020-06-12T02:35:39.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128411+0000", 2020-06-12T02:35:39.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017171459999999999 2020-06-12T02:35:39.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130128+0000", 2020-06-12T02:35:39.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0673000000000004e-05 2020-06-12T02:35:39.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130218+0000", 2020-06-12T02:35:39.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077260039999999999 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:224 1.6s0 1:6f0b6341:::smithi14213939-20:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:39.418 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:39.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1563023589999997, 2020-06-12T02:35:39.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087256139999999996, 2020-06-12T02:35:39.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.418 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 224 2020-06-12T02:35:39.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.420 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:39.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122614+0000", 2020-06-12T02:35:39.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9580999999999998e-05 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122664+0000", 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1419999999999998e-06 2020-06-12T02:35:39.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122670+0000", 2020-06-12T02:35:39.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2041e-05 2020-06-12T02:35:39.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122682+0000", 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1010000000000002e-06 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122686+0000", 2020-06-12T02:35:39.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029059950000000002 2020-06-12T02:35:39.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.125592+0000", 2020-06-12T02:35:39.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013933000000000001 2020-06-12T02:35:39.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.125732+0000", 2020-06-12T02:35:39.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047521800000000002 2020-06-12T02:35:39.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.126207+0000", 2020-06-12T02:35:39.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002206338 2020-06-12T02:35:39.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128413+0000", 2020-06-12T02:35:39.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002836636 2020-06-12T02:35:39.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131250+0000", 2020-06-12T02:35:39.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0231999999999999e-05 2020-06-12T02:35:39.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.131340+0000", 2020-06-12T02:35:39.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087256139999999996 2020-06-12T02:35:39.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.434 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:225 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1561860670000002, 2020-06-12T02:35:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001, 2020-06-12T02:35:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.435 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 225 2020-06-12T02:35:39.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:35:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9922000000000001e-05 2020-06-12T02:35:39.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122781+0000", 2020-06-12T02:35:39.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0399999999999998e-06 2020-06-12T02:35:39.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122787+0000", 2020-06-12T02:35:39.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1926999999999999e-05 2020-06-12T02:35:39.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122799+0000", 2020-06-12T02:35:39.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7280000000000001e-06 2020-06-12T02:35:39.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122802+0000", 2020-06-12T02:35:39.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004465063 2020-06-12T02:35:39.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127267+0000", 2020-06-12T02:35:39.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014145999999999999 2020-06-12T02:35:39.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127409+0000", 2020-06-12T02:35:39.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069305699999999996 2020-06-12T02:35:39.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128102+0000", 2020-06-12T02:35:39.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026151099999999999 2020-06-12T02:35:39.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130717+0000", 2020-06-12T02:35:39.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057126850000000003 2020-06-12T02:35:39.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136430+0000", 2020-06-12T02:35:39.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8999999999999995e-05 2020-06-12T02:35:39.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136519+0000", 2020-06-12T02:35:39.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001 2020-06-12T02:35:39.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.456 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 28/18 ECSubWrite(tid=87, reqid=client.4555.0:287, at_version=28'25, trim_to=0'0, roll_forward_to=26'23))", 2020-06-12T02:35:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.182780+0000", 2020-06-12T02:35:39.457 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.0961371519999998, 2020-06-12T02:35:39.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077935260000000003, 2020-06-12T02:35:39.458 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.459 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:39.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182780+0000", 2020-06-12T02:35:39.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182780+0000", 2020-06-12T02:35:39.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064730699999999996 2020-06-12T02:35:39.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183427+0000", 2020-06-12T02:35:39.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3872000000000002e-05 2020-06-12T02:35:39.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183481+0000", 2020-06-12T02:35:39.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0035e-05 2020-06-12T02:35:39.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183511+0000", 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6688999999999999e-05 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183528+0000", 2020-06-12T02:35:39.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8199000000000001e-05 2020-06-12T02:35:39.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183606+0000", 2020-06-12T02:35:39.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4836e-05 2020-06-12T02:35:39.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183621+0000", 2020-06-12T02:35:39.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006894575 2020-06-12T02:35:39.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.190515+0000", 2020-06-12T02:35:39.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8013000000000002e-05 2020-06-12T02:35:39.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.190573+0000", 2020-06-12T02:35:39.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077935260000000003 2020-06-12T02:35:39.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.470 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.470 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:39.471 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:35:39.471 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.1140895839999998, 2020-06-12T02:35:39.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:35:39.471 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.471 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.472 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:35:39.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:35:39.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:35:39.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:35:39.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:35:39.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:35:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:35:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:35:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:35:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:35:39.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:35:39.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:35:39.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:35:39.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:39.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:35:39.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:35:39.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:39.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:35:39.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:35:39.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:35:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:35:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:35:39.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:35:39.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:35:39.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.1137546899999999, 2020-06-12T02:35:39.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:35:39.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:35:39.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:35:39.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:35:39.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:35:39.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:35:39.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:35:39.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:39.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:35:39.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:35:39.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:35:39.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:35:39.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:35:39.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:35:39.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:35:39.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:35:39.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:35:39.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:35:39.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:35:39.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:35:39.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:35:39.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.503 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.504 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.505 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:310 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:39.505 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:35:39.505 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0133772859999999, 2020-06-12T02:35:39.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098877180000000002, 2020-06-12T02:35:39.505 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.506 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 310 2020-06-12T02:35:39.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.507 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:35:39.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4818e-05 2020-06-12T02:35:39.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265624+0000", 2020-06-12T02:35:39.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2554999999999999e-05 2020-06-12T02:35:39.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265637+0000", 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7989e-05 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265655+0000", 2020-06-12T02:35:39.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1130000000000007e-06 2020-06-12T02:35:39.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:39.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9839999999999994e-05 2020-06-12T02:35:39.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265754+0000", 2020-06-12T02:35:39.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023071300000000001 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265985+0000", 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094426900000000001 2020-06-12T02:35:39.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.275427+0000", 2020-06-12T02:35:39.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098877180000000002 2020-06-12T02:35:39.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.516 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:311 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0131586239999999, 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347, 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.517 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.518 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.518 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.518 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 311 2020-06-12T02:35:39.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.518 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:35:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2830999999999993e-05 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265841+0000", 2020-06-12T02:35:39.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5279999999999998e-06 2020-06-12T02:35:39.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265849+0000", 2020-06-12T02:35:39.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9006999999999999e-05 2020-06-12T02:35:39.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265868+0000", 2020-06-12T02:35:39.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.772e-06 2020-06-12T02:35:39.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265873+0000", 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072750600000000005 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266601+0000", 2020-06-12T02:35:39.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011586699999999999 2020-06-12T02:35:39.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266717+0000", 2020-06-12T02:35:39.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016014836000000001 2020-06-12T02:35:39.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.282732+0000", 2020-06-12T02:35:39.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347 2020-06-12T02:35:39.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.527 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.528 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:312 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:39.528 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:35:39.528 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0129847920000001, 2020-06-12T02:35:39.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001, 2020-06-12T02:35:39.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.529 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 312 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:35:39.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:35:39.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0629000000000003e-05 2020-06-12T02:35:39.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266013+0000", 2020-06-12T02:35:39.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9190000000000002e-06 2020-06-12T02:35:39.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266020+0000", 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2887e-05 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266032+0000", 2020-06-12T02:35:39.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5258e-05 2020-06-12T02:35:39.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266048+0000", 2020-06-12T02:35:39.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091540999999999997 2020-06-12T02:35:39.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266963+0000", 2020-06-12T02:35:39.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101524 2020-06-12T02:35:39.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.267065+0000", 2020-06-12T02:35:39.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019677448 2020-06-12T02:35:39.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286742+0000", 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.541 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(osd.1.13:2 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [assert-version v6,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:39.541 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:35:39.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0103256580000002, 2020-06-12T02:35:39.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094306830000000005, 2020-06-12T02:35:39.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:39.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:35:39.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:35:39.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019565399999999999 2020-06-12T02:35:39.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268787+0000", 2020-06-12T02:35:39.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1355e-05 2020-06-12T02:35:39.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268828+0000", 2020-06-12T02:35:39.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5587999999999999e-05 2020-06-12T02:35:39.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268864+0000", 2020-06-12T02:35:39.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5806000000000001e-05 2020-06-12T02:35:39.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268880+0000", 2020-06-12T02:35:39.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010734900000000001 2020-06-12T02:35:39.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268987+0000", 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000216317 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:39.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.269203+0000", 2020-06-12T02:35:39.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088186140000000007 2020-06-12T02:35:39.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.278022+0000", 2020-06-12T02:35:39.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094306830000000005 2020-06-12T02:35:39.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpReadReply(1.1s0 29/18 ECSubReadReply(tid=50, attrs_read=0))", 2020-06-12T02:35:39.556 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.270254+0000", 2020-06-12T02:35:39.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0086624500000001, 2020-06-12T02:35:39.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052464640000000002, 2020-06-12T02:35:39.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:39.557 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.270254+0000", 2020-06-12T02:35:39.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.270254+0000", 2020-06-12T02:35:39.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003985143 2020-06-12T02:35:39.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274240+0000", 2020-06-12T02:35:39.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0865e-05 2020-06-12T02:35:39.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274250+0000", 2020-06-12T02:35:39.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1592e-05 2020-06-12T02:35:39.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274262+0000", 2020-06-12T02:35:39.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6689999999999997e-06 2020-06-12T02:35:39.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274267+0000", 2020-06-12T02:35:39.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8677000000000002e-05 2020-06-12T02:35:39.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274315+0000", 2020-06-12T02:35:39.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001185518 2020-06-12T02:35:39.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.275501+0000", 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052464640000000002 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.568 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpReadReply(1.1s0 29/18 ECSubReadReply(tid=51, attrs_read=0))", 2020-06-12T02:35:39.568 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.274307+0000", 2020-06-12T02:35:39.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0046094449999998, 2020-06-12T02:35:39.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084977179999999996, 2020-06-12T02:35:39.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:39.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274307+0000", 2020-06-12T02:35:39.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.274307+0000", 2020-06-12T02:35:39.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070661120000000003 2020-06-12T02:35:39.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281373+0000", 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8090000000000001e-05 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281392+0000", 2020-06-12T02:35:39.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0305999999999998e-05 2020-06-12T02:35:39.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281412+0000", 2020-06-12T02:35:39.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1085e-05 2020-06-12T02:35:39.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281423+0000", 2020-06-12T02:35:39.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0012999999999995e-05 2020-06-12T02:35:39.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281493+0000", 2020-06-12T02:35:39.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001312112 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.282805+0000", 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084977179999999996 2020-06-12T02:35:39.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.577 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpReadReply(1.1s0 29/18 ECSubReadReply(tid=52, attrs_read=0))", 2020-06-12T02:35:39.578 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.281507+0000", 2020-06-12T02:35:39.578 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.997409889, 2020-06-12T02:35:39.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052821869999999998, 2020-06-12T02:35:39.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:39.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281507+0000", 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:39.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:39.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.281507+0000", 2020-06-12T02:35:39.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041483589999999999 2020-06-12T02:35:39.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:39.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.285655+0000", 2020-06-12T02:35:39.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6699000000000001e-05 2020-06-12T02:35:39.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.285672+0000", 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0035e-05 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:39.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.285692+0000", 2020-06-12T02:35:39.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2061e-05 2020-06-12T02:35:39.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:39.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.285704+0000", 2020-06-12T02:35:39.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1624000000000003e-05 2020-06-12T02:35:39.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.285786+0000", 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001003409 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:39.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:39.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286789+0000", 2020-06-12T02:35:39.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052821869999999998 2020-06-12T02:35:39.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:39.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:39.587 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:39.284+0000 7fc6d85dc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:39.589 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:39.296+0000 7fc6d85dc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:39.589 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:39.588+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:39.590 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:39.690 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:39.692+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:39.707 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:39.711 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:39.716 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:39.790 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:39.791+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:39.827 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:39.828 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:39.828 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:39.828 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:39.828 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:39.836 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:39.918 INFO:tasks.rados.rados.0.smithi142.stdout:105: done (0 left) 2020-06-12T02:35:39.918 INFO:tasks.rados.rados.0.smithi142.stdout:106: snap_remove snap 2 2020-06-12T02:35:39.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:39.927+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:39.925 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:35:40.000 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:40.000+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:40.005 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:197 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 423543~785319,stat] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.218325767, 2020-06-12T02:35:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994, 2020-06-12T02:35:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 197 2020-06-12T02:35:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.787637+0000", 2020-06-12T02:35:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001251102 2020-06-12T02:35:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788888+0000", 2020-06-12T02:35:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2089999999999994e-06 2020-06-12T02:35:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788897+0000", 2020-06-12T02:35:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6551000000000001e-05 2020-06-12T02:35:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788914+0000", 2020-06-12T02:35:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:35:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788920+0000", 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4307000000000002e-05 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.788955+0000", 2020-06-12T02:35:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017733199999999999 2020-06-12T02:35:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.789132+0000", 2020-06-12T02:35:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018899590000000001 2020-06-12T02:35:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.791022+0000", 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025592739999999998 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.793581+0000", 2020-06-12T02:35:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020861529999999999 2020-06-12T02:35:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795667+0000", 2020-06-12T02:35:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8508000000000001e-05 2020-06-12T02:35:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795746+0000", 2020-06-12T02:35:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081092809999999994 2020-06-12T02:35:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:198 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 1767500~799008] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.210163524, 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782, 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 198 2020-06-12T02:35:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099562999999999995 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796795+0000", 2020-06-12T02:35:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1195e-05 2020-06-12T02:35:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796806+0000", 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4831e-05 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796831+0000", 2020-06-12T02:35:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3913e-05 2020-06-12T02:35:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796844+0000", 2020-06-12T02:35:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5038999999999999e-05 2020-06-12T02:35:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796909+0000", 2020-06-12T02:35:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000111087 2020-06-12T02:35:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797021+0000", 2020-06-12T02:35:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014743670000000001 2020-06-12T02:35:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.798495+0000", 2020-06-12T02:35:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029768920000000001 2020-06-12T02:35:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801472+0000", 2020-06-12T02:35:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037560470000000002 2020-06-12T02:35:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805228+0000", 2020-06-12T02:35:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0780999999999999e-05 2020-06-12T02:35:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805299+0000", 2020-06-12T02:35:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782 2020-06-12T02:35:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:199 1.3s0 1:cff5b50f:::smithi14213939-50:head [setxattr _header (56) in=7b,truncate 2823543] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.209035140999999, 2020-06-12T02:35:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995, 2020-06-12T02:35:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 199 2020-06-12T02:35:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106302 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797034+0000", 2020-06-12T02:35:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0084e-05 2020-06-12T02:35:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797044+0000", 2020-06-12T02:35:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7399999999999999e-05 2020-06-12T02:35:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797061+0000", 2020-06-12T02:35:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0890000000000002e-06 2020-06-12T02:35:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797068+0000", 2020-06-12T02:35:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027601829999999998 2020-06-12T02:35:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799828+0000", 2020-06-12T02:35:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121823 2020-06-12T02:35:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799950+0000", 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074876700000000001 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.800699+0000", 2020-06-12T02:35:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028159669999999999 2020-06-12T02:35:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.803515+0000", 2020-06-12T02:35:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019210270000000001 2020-06-12T02:35:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805436+0000", 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9416000000000001e-05 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805505+0000", 2020-06-12T02:35:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995 2020-06-12T02:35:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:200 1.3s0 1:cff5b50f:::smithi14213939-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.208830096, 2020-06-12T02:35:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427, 2020-06-12T02:35:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 200 2020-06-12T02:35:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1226e-05 2020-06-12T02:35:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797194+0000", 2020-06-12T02:35:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0248000000000001e-05 2020-06-12T02:35:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797204+0000", 2020-06-12T02:35:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7323e-05 2020-06-12T02:35:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797221+0000", 2020-06-12T02:35:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0959999999999997e-06 2020-06-12T02:35:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797227+0000", 2020-06-12T02:35:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004271403 2020-06-12T02:35:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801499+0000", 2020-06-12T02:35:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0492000000000001e-05 2020-06-12T02:35:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801579+0000", 2020-06-12T02:35:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004303973 2020-06-12T02:35:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805883+0000", 2020-06-12T02:35:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6344000000000001e-05 2020-06-12T02:35:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805939+0000", 2020-06-12T02:35:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016273220000000001 2020-06-12T02:35:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.807567+0000", 2020-06-12T02:35:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427 2020-06-12T02:35:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=25, reqid=client.4555.0:206, at_version=23'16, trim_to=0'0, roll_forward_to=21'12))", 2020-06-12T02:35:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8846749589999998, 2020-06-12T02:35:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431, 2020-06-12T02:35:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017964389999999999 2020-06-12T02:35:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123084+0000", 2020-06-12T02:35:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8554000000000002e-05 2020-06-12T02:35:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123142+0000", 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4759999999999999e-05 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123177+0000", 2020-06-12T02:35:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8295999999999999e-05 2020-06-12T02:35:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123196+0000", 2020-06-12T02:35:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3685999999999997e-05 2020-06-12T02:35:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123289+0000", 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6406000000000001e-05 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123316+0000", 2020-06-12T02:35:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083341979999999993 2020-06-12T02:35:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131650+0000", 2020-06-12T02:35:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015409199999999999 2020-06-12T02:35:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131804+0000", 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8780266979999993, 2020-06-12T02:35:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574, 2020-06-12T02:35:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127936+0000", 2020-06-12T02:35:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015987799999999999 2020-06-12T02:35:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128096+0000", 2020-06-12T02:35:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8012e-05 2020-06-12T02:35:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128154+0000", 2020-06-12T02:35:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1575000000000001e-05 2020-06-12T02:35:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128195+0000", 2020-06-12T02:35:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0976e-05 2020-06-12T02:35:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128216+0000", 2020-06-12T02:35:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138028 2020-06-12T02:35:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128354+0000", 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1136999999999997e-05 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128385+0000", 2020-06-12T02:35:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050820539999999999 2020-06-12T02:35:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133467+0000", 2020-06-12T02:35:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1913999999999998e-05 2020-06-12T02:35:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133519+0000", 2020-06-12T02:35:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005583574 2020-06-12T02:35:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=7, reqid=client.4555.0:214, at_version=23'6, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8743455410000003, 2020-06-12T02:35:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845, 2020-06-12T02:35:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131617+0000", 2020-06-12T02:35:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3839999999999997e-05 2020-06-12T02:35:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131701+0000", 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2039000000000003e-05 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131733+0000", 2020-06-12T02:35:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2753999999999999e-05 2020-06-12T02:35:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131756+0000", 2020-06-12T02:35:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3559e-05 2020-06-12T02:35:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131769+0000", 2020-06-12T02:35:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9615000000000003e-05 2020-06-12T02:35:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131849+0000", 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6756e-05 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131865+0000", 2020-06-12T02:35:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052282830000000002 2020-06-12T02:35:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137094+0000", 2020-06-12T02:35:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3998999999999995e-05 2020-06-12T02:35:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137158+0000", 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005540845 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs2 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8738118220000004, 2020-06-12T02:35:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004, 2020-06-12T02:35:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132151+0000", 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000104829 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132255+0000", 2020-06-12T02:35:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7648e-05 2020-06-12T02:35:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132283+0000", 2020-06-12T02:35:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6242999999999999e-05 2020-06-12T02:35:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132309+0000", 2020-06-12T02:35:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.927e-06 2020-06-12T02:35:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132319+0000", 2020-06-12T02:35:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095454700000000003 2020-06-12T02:35:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133274+0000", 2020-06-12T02:35:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2116999999999999e-05 2020-06-12T02:35:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133286+0000", 2020-06-12T02:35:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046015589999999999 2020-06-12T02:35:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137887+0000", 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6152999999999998e-05 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137924+0000", 2020-06-12T02:35:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057730230000000004 2020-06-12T02:35:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8731654970000005, 2020-06-12T02:35:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:35:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:35:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:35:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:35:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:35:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:35:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:35:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:35:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:35:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:35:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:35:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:35:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:35:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:35:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:35:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:35:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:35:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:35:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:35:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:35:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:35:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:35:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:35:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:35:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:35:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.862274116, 2020-06-12T02:35:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:35:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:35:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:35:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:35:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:35:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:35:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:35:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:35:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:35:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:35:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:35:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:35:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:35:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:35:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:35:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:35:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:35:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:35:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:35:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:35:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:35:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:35:40.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:35:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.175 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:40.176 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8611420719999998, 2020-06-12T02:35:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:35:40.177 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.178 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:35:40.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:35:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:35:40.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:35:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:35:40.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:35:40.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:35:40.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:35:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:35:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:35:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:35:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:35:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:35:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:35:40.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:35:40.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:35:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:35:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:35:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:35:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:35:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:35:40.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:35:40.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.198 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.199 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:40.200 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:40.200 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8608868869999995, 2020-06-12T02:35:40.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:35:40.200 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.201 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:35:40.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.203 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:40.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:35:40.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:35:40.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:35:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:35:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:35:40.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:35:40.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:35:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:35:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:35:40.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:35:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:35:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:35:40.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:35:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:35:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:35:40.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:35:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:35:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:35:40.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:35:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:35:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:35:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:40.224 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8607277, 2020-06-12T02:35:40.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:35:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:40.227 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:35:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.228 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:35:40.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:35:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:35:40.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:35:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:35:40.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:35:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:35:40.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:35:40.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:35:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:35:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:35:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:35:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:35:40.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:35:40.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:35:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:35:40.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:35:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:35:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:35:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:283 1.3s0 1:cc10fc1f:::smithi14213939-3:head [append 0~0] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:40.244 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.8573795119999996, 2020-06-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080712130000000007, 2020-06-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 283 2020-06-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.246 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148583+0000", 2020-06-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6777000000000001e-05 2020-06-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148650+0000", 2020-06-12T02:35:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3337e-05 2020-06-12T02:35:40.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148663+0000", 2020-06-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6353999999999999e-05 2020-06-12T02:35:40.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148689+0000", 2020-06-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5426000000000001e-05 2020-06-12T02:35:40.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148705+0000", 2020-06-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010453199999999999 2020-06-12T02:35:40.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148809+0000", 2020-06-12T02:35:40.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000185174 2020-06-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148995+0000", 2020-06-12T02:35:40.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001459751 2020-06-12T02:35:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.150454+0000", 2020-06-12T02:35:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004308376 2020-06-12T02:35:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154763+0000", 2020-06-12T02:35:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016698520000000001 2020-06-12T02:35:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.156432+0000", 2020-06-12T02:35:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022163400000000001 2020-06-12T02:35:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.156654+0000", 2020-06-12T02:35:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080712130000000007 2020-06-12T02:35:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:284 1.3s0 1:cc10fc1f:::smithi14213939-3:head [rollback 7] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.8571902470000001, 2020-06-12T02:35:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007, 2020-06-12T02:35:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 284 2020-06-12T02:35:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118615 2020-06-12T02:35:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148891+0000", 2020-06-12T02:35:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6863000000000001e-05 2020-06-12T02:35:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148908+0000", 2020-06-12T02:35:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5559999999999998e-05 2020-06-12T02:35:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148943+0000", 2020-06-12T02:35:40.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2563e-05 2020-06-12T02:35:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148956+0000", 2020-06-12T02:35:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033915849999999999 2020-06-12T02:35:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152347+0000", 2020-06-12T02:35:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000232606 2020-06-12T02:35:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152580+0000", 2020-06-12T02:35:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051544500000000001 2020-06-12T02:35:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153095+0000", 2020-06-12T02:35:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001814382 2020-06-12T02:35:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154910+0000", 2020-06-12T02:35:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025672569999999999 2020-06-12T02:35:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157477+0000", 2020-06-12T02:35:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2543000000000002e-05 2020-06-12T02:35:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157530+0000", 2020-06-12T02:35:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007 2020-06-12T02:35:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:285 1.3s0 1:cc10fc1f:::smithi14213939-3:head [append 0~0] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.8569097689999996, 2020-06-12T02:35:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003, 2020-06-12T02:35:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 285 2020-06-12T02:35:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5648999999999994e-05 2020-06-12T02:35:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149118+0000", 2020-06-12T02:35:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0005e-05 2020-06-12T02:35:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149128+0000", 2020-06-12T02:35:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9955000000000001e-05 2020-06-12T02:35:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149148+0000", 2020-06-12T02:35:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4200000000000001e-06 2020-06-12T02:35:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149156+0000", 2020-06-12T02:35:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045664709999999999 2020-06-12T02:35:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153722+0000", 2020-06-12T02:35:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013702000000000001 2020-06-12T02:35:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153859+0000", 2020-06-12T02:35:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00060901599999999998 2020-06-12T02:35:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154468+0000", 2020-06-12T02:35:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012189189999999999 2020-06-12T02:35:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.155687+0000", 2020-06-12T02:35:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019438859999999999 2020-06-12T02:35:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157631+0000", 2020-06-12T02:35:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7487000000000001e-05 2020-06-12T02:35:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157678+0000", 2020-06-12T02:35:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003 2020-06-12T02:35:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:324 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.716804695, 2020-06-12T02:35:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097874550000000005, 2020-06-12T02:35:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 324 2020-06-12T02:35:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5239000000000003e-05 2020-06-12T02:35:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289223+0000", 2020-06-12T02:35:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5743000000000002e-05 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289239+0000", 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7966999999999999e-05 2020-06-12T02:35:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289257+0000", 2020-06-12T02:35:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.893e-06 2020-06-12T02:35:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289267+0000", 2020-06-12T02:35:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0618000000000001e-05 2020-06-12T02:35:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289327+0000", 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000176854 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289504+0000", 2020-06-12T02:35:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094411410000000001 2020-06-12T02:35:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298945+0000", 2020-06-12T02:35:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097874550000000005 2020-06-12T02:35:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:325 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.716620952, 2020-06-12T02:35:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011654777999999999, 2020-06-12T02:35:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 325 2020-06-12T02:35:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0389999999999993e-05 2020-06-12T02:35:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289432+0000", 2020-06-12T02:35:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.199e-05 2020-06-12T02:35:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289444+0000", 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0911999999999999e-05 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289465+0000", 2020-06-12T02:35:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2275e-05 2020-06-12T02:35:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289477+0000", 2020-06-12T02:35:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063618300000000002 2020-06-12T02:35:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290113+0000", 2020-06-12T02:35:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001383 2020-06-12T02:35:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290252+0000", 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010744728 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300996+0000", 2020-06-12T02:35:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011654777999999999 2020-06-12T02:35:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.7164051219999998, 2020-06-12T02:35:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:35:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:35:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:35:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:35:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:35:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:35:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:35:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:35:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:35:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:35:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:35:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:35:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:35:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:35:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s1 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:35:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.7145956710000001, 2020-06-12T02:35:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096248359999999995, 2020-06-12T02:35:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018540119999999999 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293221+0000", 2020-06-12T02:35:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1129e-05 2020-06-12T02:35:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293252+0000", 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7934000000000001e-05 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293270+0000", 2020-06-12T02:35:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5599999999999996e-06 2020-06-12T02:35:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293277+0000", 2020-06-12T02:35:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8360999999999999e-05 2020-06-12T02:35:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293336+0000", 2020-06-12T02:35:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1467e-05 2020-06-12T02:35:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293347+0000", 2020-06-12T02:35:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075754630000000002 2020-06-12T02:35:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300923+0000", 2020-06-12T02:35:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8910000000000003e-05 2020-06-12T02:35:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300992+0000", 2020-06-12T02:35:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096248359999999995 2020-06-12T02:35:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.350 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:40.352 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:40.352 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:40.352+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:40.452 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:40.452+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:40.509 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:40.509 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:40.509 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:40.510 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:40.519 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:40.557 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:40.552+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:40.624 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:40.626 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:40.634 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:40.681 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:40.683+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:40.748 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.621392755, 2020-06-12T02:35:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999, 2020-06-12T02:35:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9608e-05 2020-06-12T02:35:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128233+0000", 2020-06-12T02:35:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0374999999999999e-05 2020-06-12T02:35:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128273+0000", 2020-06-12T02:35:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2021999999999999e-05 2020-06-12T02:35:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128305+0000", 2020-06-12T02:35:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2435999999999999e-05 2020-06-12T02:35:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128318+0000", 2020-06-12T02:35:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018382399999999999 2020-06-12T02:35:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128501+0000", 2020-06-12T02:35:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4272e-05 2020-06-12T02:35:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128536+0000", 2020-06-12T02:35:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031735639999999998 2020-06-12T02:35:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131709+0000", 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9300000000000003e-05 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131788+0000", 2020-06-12T02:35:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999 2020-06-12T02:35:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.617596266, 2020-06-12T02:35:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002, 2020-06-12T02:35:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4559000000000001e-05 2020-06-12T02:35:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132024+0000", 2020-06-12T02:35:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5899999999999999e-05 2020-06-12T02:35:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132050+0000", 2020-06-12T02:35:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2875999999999999e-05 2020-06-12T02:35:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132073+0000", 2020-06-12T02:35:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2930000000000006e-06 2020-06-12T02:35:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132082+0000", 2020-06-12T02:35:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054950300000000001 2020-06-12T02:35:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132632+0000", 2020-06-12T02:35:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6909999999999999e-05 2020-06-12T02:35:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132649+0000", 2020-06-12T02:35:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046183320000000002 2020-06-12T02:35:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137267+0000", 2020-06-12T02:35:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6516000000000001e-05 2020-06-12T02:35:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137303+0000", 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.6037960679999994, 2020-06-12T02:35:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:35:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:35:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:35:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:35:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:35:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:35:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:35:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:35:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:35:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:35:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=132, reqid=client.4555.0:302, at_version=29'11, trim_to=0'0, roll_forward_to=21'9))", 2020-06-12T02:35:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.259935+0000", 2020-06-12T02:35:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4896008009999999, 2020-06-12T02:35:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029782319999999999, 2020-06-12T02:35:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.259935+0000", 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.259935+0000", 2020-06-12T02:35:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2254000000000002e-05 2020-06-12T02:35:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260017+0000", 2020-06-12T02:35:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8970000000000001e-05 2020-06-12T02:35:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260056+0000", 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0032999999999999e-05 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260086+0000", 2020-06-12T02:35:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4214e-05 2020-06-12T02:35:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260101+0000", 2020-06-12T02:35:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012955 2020-06-12T02:35:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260230+0000", 2020-06-12T02:35:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1347000000000003e-05 2020-06-12T02:35:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.260261+0000", 2020-06-12T02:35:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026092680000000001 2020-06-12T02:35:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.262871+0000", 2020-06-12T02:35:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2595999999999997e-05 2020-06-12T02:35:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.262913+0000", 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029782319999999999 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.1s1 29/18 ECSubRead(tid=50, to_read={1:82c302db:::smithi14213939-48:4=0,1396736,0}, subchunks={1:82c302db:::smithi14213939-48:4=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.267214+0000", 2020-06-12T02:35:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4823220609999996, 2020-06-12T02:35:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027646379999999998, 2020-06-12T02:35:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267214+0000", 2020-06-12T02:35:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267214+0000", 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015578900000000001 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267370+0000", 2020-06-12T02:35:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6032000000000001e-05 2020-06-12T02:35:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267396+0000", 2020-06-12T02:35:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6267999999999999e-05 2020-06-12T02:35:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267432+0000", 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0389000000000001e-05 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267452+0000", 2020-06-12T02:35:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013977099999999999 2020-06-12T02:35:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267592+0000", 2020-06-12T02:35:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002386389 2020-06-12T02:35:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269978+0000", 2020-06-12T02:35:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027646379999999998 2020-06-12T02:35:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.1s1 29/18 ECSubRead(tid=51, to_read={1:82c302db:::smithi14213939-48:4=0,1396736,0}, subchunks={1:82c302db:::smithi14213939-48:4=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.267846+0000", 2020-06-12T02:35:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.481689984, 2020-06-12T02:35:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030182220000000001, 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267846+0000", 2020-06-12T02:35:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267846+0000", 2020-06-12T02:35:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0383999999999999e-05 2020-06-12T02:35:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267876+0000", 2020-06-12T02:35:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.824e-06 2020-06-12T02:35:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267884+0000", 2020-06-12T02:35:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.048e-05 2020-06-12T02:35:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267895+0000", 2020-06-12T02:35:40.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2190000000000003e-06 2020-06-12T02:35:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267900+0000", 2020-06-12T02:35:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021931799999999999 2020-06-12T02:35:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270093+0000", 2020-06-12T02:35:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00077113500000000005 2020-06-12T02:35:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270864+0000", 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030182220000000001 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.1s1 29/18 ECSubRead(tid=52, to_read={1:82c302db:::smithi14213939-48:4=0,1396736,0}, subchunks={1:82c302db:::smithi14213939-48:4=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4815907240000001, 2020-06-12T02:35:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035457660000000001, 2020-06-12T02:35:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9910999999999999e-05 2020-06-12T02:35:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267975+0000", 2020-06-12T02:35:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4700000000000001e-06 2020-06-12T02:35:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267981+0000", 2020-06-12T02:35:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1090000000000004e-06 2020-06-12T02:35:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267990+0000", 2020-06-12T02:35:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5949999999999999e-06 2020-06-12T02:35:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267993+0000", 2020-06-12T02:35:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029544860000000001 2020-06-12T02:35:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270948+0000", 2020-06-12T02:35:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054319500000000001 2020-06-12T02:35:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.271491+0000", 2020-06-12T02:35:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035457660000000001 2020-06-12T02:35:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=135, reqid=client.4555.0:313, at_version=29'16, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4674714189999998, 2020-06-12T02:35:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996, 2020-06-12T02:35:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00068568199999999996 2020-06-12T02:35:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282750+0000", 2020-06-12T02:35:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9499000000000001e-05 2020-06-12T02:35:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282810+0000", 2020-06-12T02:35:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9295e-05 2020-06-12T02:35:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282839+0000", 2020-06-12T02:35:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:35:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282850+0000", 2020-06-12T02:35:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4931999999999994e-05 2020-06-12T02:35:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282915+0000", 2020-06-12T02:35:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3213999999999999e-05 2020-06-12T02:35:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282928+0000", 2020-06-12T02:35:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043331150000000002 2020-06-12T02:35:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287261+0000", 2020-06-12T02:35:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3059999999999994e-05 2020-06-12T02:35:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287344+0000", 2020-06-12T02:35:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996 2020-06-12T02:35:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:35:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4572825570000001, 2020-06-12T02:35:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:35:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:35:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:35:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:35:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:35:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:35:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:35:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:35:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:35:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:35:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:35:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:35:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:35:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:35:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:35:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:35:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=138, reqid=client.4555.0:314, at_version=29'17, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.451297941, 2020-06-12T02:35:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512, 2020-06-12T02:35:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050880100000000002 2020-06-12T02:35:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298747+0000", 2020-06-12T02:35:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7461999999999999e-05 2020-06-12T02:35:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298774+0000", 2020-06-12T02:35:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3760999999999999e-05 2020-06-12T02:35:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298788+0000", 2020-06-12T02:35:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9280000000000004e-06 2020-06-12T02:35:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298795+0000", 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0432999999999994e-05 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298875+0000", 2020-06-12T02:35:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2087e-05 2020-06-12T02:35:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298897+0000", 2020-06-12T02:35:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069111329999999999 2020-06-12T02:35:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305809+0000", 2020-06-12T02:35:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3906999999999996e-05 2020-06-12T02:35:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305882+0000", 2020-06-12T02:35:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512 2020-06-12T02:35:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=141, reqid=client.4555.0:315, at_version=29'18, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4500450699999998, 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003, 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092376299999999997 2020-06-12T02:35:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300415+0000", 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0585999999999999e-05 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300435+0000", 2020-06-12T02:35:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2507000000000001e-05 2020-06-12T02:35:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300448+0000", 2020-06-12T02:35:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3489999999999997e-06 2020-06-12T02:35:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300454+0000", 2020-06-12T02:35:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4029000000000001e-05 2020-06-12T02:35:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300508+0000", 2020-06-12T02:35:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4767000000000001e-05 2020-06-12T02:35:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300543+0000", 2020-06-12T02:35:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053731100000000004 2020-06-12T02:35:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305916+0000", 2020-06-12T02:35:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3744999999999994e-05 2020-06-12T02:35:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305980+0000", 2020-06-12T02:35:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003 2020-06-12T02:35:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=142, reqid=client.4555.0:316, at_version=29'19, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4479149319999998, 2020-06-12T02:35:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998, 2020-06-12T02:35:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.168e-05 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301673+0000", 2020-06-12T02:35:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8664e-05 2020-06-12T02:35:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301691+0000", 2020-06-12T02:35:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9213000000000001e-05 2020-06-12T02:35:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301710+0000", 2020-06-12T02:35:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3760000000000008e-06 2020-06-12T02:35:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301719+0000", 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042316700000000001 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302142+0000", 2020-06-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5987999999999999e-05 2020-06-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302168+0000", 2020-06-12T02:35:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0038407580000000001 2020-06-12T02:35:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306009+0000", 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1911999999999999e-05 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306071+0000", 2020-06-12T02:35:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998 2020-06-12T02:35:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=146, reqid=client.4555.0:316, at_version=0'0, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4418651120000003, 2020-06-12T02:35:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718, 2020-06-12T02:35:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9865e-05 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307701+0000", 2020-06-12T02:35:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0020000000000001e-05 2020-06-12T02:35:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307711+0000", 2020-06-12T02:35:40.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1705999999999999e-05 2020-06-12T02:35:40.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307722+0000", 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307727+0000", 2020-06-12T02:35:40.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3153999999999999e-05 2020-06-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307790+0000", 2020-06-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2943e-05 2020-06-12T02:35:40.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307803+0000", 2020-06-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036252849999999998 2020-06-12T02:35:40.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311429+0000", 2020-06-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0825999999999998e-05 2020-06-12T02:35:40.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311469+0000", 2020-06-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718 2020-06-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.924 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 32/18 ECSubWrite(tid=14, reqid=client.4555.0:333, at_version=32'13, trim_to=0'0, roll_forward_to=26'11))", 2020-06-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.202611+0000", 2020-06-12T02:35:40.925 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.546924864, 2020-06-12T02:35:40.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358500000000002, 2020-06-12T02:35:40.926 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.926 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.926 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202611+0000", 2020-06-12T02:35:40.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202611+0000", 2020-06-12T02:35:40.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000181755 2020-06-12T02:35:40.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202793+0000", 2020-06-12T02:35:40.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9917000000000002e-05 2020-06-12T02:35:40.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202853+0000", 2020-06-12T02:35:40.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1909000000000001e-05 2020-06-12T02:35:40.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202895+0000", 2020-06-12T02:35:40.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.982e-05 2020-06-12T02:35:40.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202914+0000", 2020-06-12T02:35:40.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0573000000000003e-05 2020-06-12T02:35:40.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202995+0000", 2020-06-12T02:35:40.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3502e-05 2020-06-12T02:35:40.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.203008+0000", 2020-06-12T02:35:40.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022679010000000001 2020-06-12T02:35:40.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.205276+0000", 2020-06-12T02:35:40.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0473000000000001e-05 2020-06-12T02:35:40.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.205347+0000", 2020-06-12T02:35:40.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358500000000002 2020-06-12T02:35:40.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.940 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.940 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.940 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=151, reqid=osd.1.0:151, at_version=33'15, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:40.941 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:40.941 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.82134655700000003, 2020-06-12T02:35:40.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001, 2020-06-12T02:35:40.941 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.941 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.942 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:40.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:40.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8978000000000003e-05 2020-06-12T02:35:40.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928258+0000", 2020-06-12T02:35:40.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6777000000000001e-05 2020-06-12T02:35:40.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928285+0000", 2020-06-12T02:35:40.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928303+0000", 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0790000000000007e-06 2020-06-12T02:35:40.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928312+0000", 2020-06-12T02:35:40.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00047842700000000002 2020-06-12T02:35:40.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928790+0000", 2020-06-12T02:35:40.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4056000000000001e-05 2020-06-12T02:35:40.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928804+0000", 2020-06-12T02:35:40.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003089488 2020-06-12T02:35:40.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931894+0000", 2020-06-12T02:35:40.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7665999999999999e-05 2020-06-12T02:35:40.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931962+0000", 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.953 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.953 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=152, reqid=osd.1.0:152, at_version=33'17, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:40.953 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:40.954 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.82115725399999995, 2020-06-12T02:35:40.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996, 2020-06-12T02:35:40.954 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.954 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.954 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:40.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0865999999999995e-05 2020-06-12T02:35:40.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928449+0000", 2020-06-12T02:35:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4501000000000001e-05 2020-06-12T02:35:40.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928474+0000", 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6772000000000001e-05 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928491+0000", 2020-06-12T02:35:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1799999999999999e-06 2020-06-12T02:35:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928498+0000", 2020-06-12T02:35:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072590399999999998 2020-06-12T02:35:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929224+0000", 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3964e-05 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929238+0000", 2020-06-12T02:35:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051932339999999997 2020-06-12T02:35:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934431+0000", 2020-06-12T02:35:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7349999999999995e-05 2020-06-12T02:35:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934518+0000", 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=153, reqid=osd.1.0:153, at_version=33'21, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.81717810099999999, 2020-06-12T02:35:40.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211, 2020-06-12T02:35:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8218000000000002e-05 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932436+0000", 2020-06-12T02:35:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0248999999999999e-05 2020-06-12T02:35:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932456+0000", 2020-06-12T02:35:40.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4163e-05 2020-06-12T02:35:40.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932470+0000", 2020-06-12T02:35:40.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7780000000000004e-06 2020-06-12T02:35:40.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932476+0000", 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1088999999999997e-05 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932537+0000", 2020-06-12T02:35:40.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6789000000000001e-05 2020-06-12T02:35:40.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932554+0000", 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046876670000000004 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937242+0000", 2020-06-12T02:35:40.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0258000000000004e-05 2020-06-12T02:35:40.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937312+0000", 2020-06-12T02:35:40.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211 2020-06-12T02:35:40.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.977 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=154, reqid=osd.1.0:152, at_version=0'0, trim_to=0'0, roll_forward_to=33'17))", 2020-06-12T02:35:40.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:40.977 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.81156383300000001, 2020-06-12T02:35:40.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998, 2020-06-12T02:35:40.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.978 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.978 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010771400000000001 2020-06-12T02:35:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938080+0000", 2020-06-12T02:35:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7977000000000001e-05 2020-06-12T02:35:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938098+0000", 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5340000000000001e-05 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938123+0000", 2020-06-12T02:35:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2699999999999993e-06 2020-06-12T02:35:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938132+0000", 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-05 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938198+0000", 2020-06-12T02:35:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3832000000000002e-05 2020-06-12T02:35:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938222+0000", 2020-06-12T02:35:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043491199999999997 2020-06-12T02:35:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942571+0000", 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4549000000000002e-05 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942625+0000", 2020-06-12T02:35:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998 2020-06-12T02:35:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=156, reqid=osd.1.0:153, at_version=0'0, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.80740725400000002, 2020-06-12T02:35:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001, 2020-06-12T02:35:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3413999999999998e-05 2020-06-12T02:35:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942212+0000", 2020-06-12T02:35:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6614999999999999e-05 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942229+0000", 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0424e-05 2020-06-12T02:35:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942249+0000", 2020-06-12T02:35:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2020-06-12T02:35:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942257+0000", 2020-06-12T02:35:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064044099999999995 2020-06-12T02:35:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942898+0000", 2020-06-12T02:35:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5028000000000001e-05 2020-06-12T02:35:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942913+0000", 2020-06-12T02:35:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00476955 2020-06-12T02:35:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947682+0000", 2020-06-12T02:35:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6485999999999999e-05 2020-06-12T02:35:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947759+0000", 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 33/18 ECSubWrite(tid=16, reqid=osd.6.0:16, at_version=33'15, trim_to=0'0, roll_forward_to=32'13))", 2020-06-12T02:35:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.804048129, 2020-06-12T02:35:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998, 2020-06-12T02:35:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0977999999999995e-05 2020-06-12T02:35:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945579+0000", 2020-06-12T02:35:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0941000000000002e-05 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945600+0000", 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2208999999999999e-05 2020-06-12T02:35:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945612+0000", 2020-06-12T02:35:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1380000000000004e-06 2020-06-12T02:35:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945618+0000", 2020-06-12T02:35:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036558199999999998 2020-06-12T02:35:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945984+0000", 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1464e-05 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.946005+0000", 2020-06-12T02:35:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044700829999999997 2020-06-12T02:35:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950475+0000", 2020-06-12T02:35:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3517000000000003e-05 2020-06-12T02:35:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950529+0000", 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:41.012 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:41.014 INFO:tasks.rados.rados.0.smithi142.stdout:106: done (0 left) 2020-06-12T02:35:41.014 INFO:tasks.rados.rados.0.smithi142.stdout:107: read oid 44 snap -1 2020-06-12T02:35:41.014 INFO:tasks.rados.rados.0.smithi142.stdout:107: expect (ObjNum 43 snap 0 seq_num 43) 2020-06-12T02:35:41.015 INFO:tasks.rados.rados.0.smithi142.stdout:108: snap_create 2020-06-12T02:35:41.015 INFO:tasks.rados.rados.0.smithi142.stdout:107: expect (ObjNum 43 snap 0 seq_num 43) 2020-06-12T02:35:41.015 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:40.932+0000 7fcd47e10700 -1 osd.1 pg_epoch: 34 pg[1.8s0( v 34'19 (0'0,34'19] local-lis/les=18/19 n=4 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [1,4,5]p1(0) r=0 lpr=18 luod=33'17 crt=33'17 lcod 33'15 mlcod 33'15 active+clean+snaptrim trimq=[4~1] ps=[3~1,7~2]] removing snap head 2020-06-12T02:35:41.015 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:40.940+0000 7fb62b0a3700 -1 osd.2 pg_epoch: 34 pg[1.ds0( v 33'31 (0'0,33'31] local-lis/les=18/19 n=9 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [2,1,7]p2(0) r=0 lpr=18 crt=33'31 lcod 29'29 mlcod 29'29 active+clean+snaptrim trimq=[4~1] ps=[3~1,7~2]] removing snap head 2020-06-12T02:35:41.016 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:40.944+0000 7fb62f0ab700 -1 osd.2 pg_epoch: 34 pg[1.5s0( v 33'29 (0'0,33'29] local-lis/les=18/19 n=8 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [2,6,3]p2(0) r=0 lpr=18 crt=33'29 lcod 29'27 mlcod 29'27 active+clean+snaptrim trimq=[4~1] ps=[3~1,7~2]] removing snap head 2020-06-12T02:35:41.016 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:40.956+0000 7fb62f0ab700 -1 osd.2 pg_epoch: 34 pg[1.5s0( v 34'33 (0'0,34'33] local-lis/les=18/19 n=5 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [2,6,3]p2(0) r=0 lpr=18 crt=34'33 lcod 34'31 mlcod 34'31 active+clean+snaptrim trimq=[4~1] ps=[3~1,7~2]] removing snap head 2020-06-12T02:35:41.016 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:41.012+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:41.016 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:40.951+0000 7fbc9522f700 -1 osd.4 pg_epoch: 34 pg[1.bs0( v 34'29 (0'0,34'29] local-lis/les=18/19 n=4 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [4,6,2]p4(0) r=0 lpr=18 crt=34'29 lcod 34'27 mlcod 34'27 active+clean+snaptrim trimq=[4~1] ps=[3~1,7~2]] removing snap head 2020-06-12T02:35:41.017 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:41.069 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:41.114 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:41.115+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:41.166 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:41.166 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:41.166 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:41.166 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:41.170 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:41.164+0000 7fdfc55e1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:41.175 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:41.176 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:41.176+0000 7fdfc55e1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:41.213 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:41.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:41.219+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:41.235 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:41.258 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:41.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:41.308 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:41.317 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:41.316+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:41.344 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:41.345 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:41.345 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:41.345 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:41.345 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:41.347 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:41.358 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:41.384 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.386 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.387 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.388 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:41.418 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:41.419+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:41.462 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:41.462 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:41.471 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:41.562 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:41.563+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:41.620 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:41.619+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:41.623 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:41.623 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:41.633 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:41.722 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:41.724+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:41.784 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:41.785 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:41.795 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:41.822 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:41.820+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:41.904 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:41.905 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:41.914 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:41.924 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:41.923+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:41.935 INFO:tasks.rados.rados.0.smithi142.stdout:107: done (1 left) 2020-06-12T02:35:41.935 INFO:tasks.rados.rados.0.smithi142.stdout:108: done (0 left) 2020-06-12T02:35:41.935 INFO:tasks.rados.rados.0.smithi142.stdout:109: read oid 14 snap -1 2020-06-12T02:35:41.936 INFO:tasks.rados.rados.0.smithi142.stdout:109: expect (ObjNum 55 snap 3 seq_num 55) 2020-06-12T02:35:41.936 INFO:tasks.rados.rados.0.smithi142.stdout:110: copy_from oid 33 from oid 4 current snap is 9 2020-06-12T02:35:41.936 INFO:tasks.rados.rados.0.smithi142.stdout:111: read oid 45 snap -1 2020-06-12T02:35:41.936 INFO:tasks.rados.rados.0.smithi142.stdout:111: expect (ObjNum 44 snap 0 seq_num 44) 2020-06-12T02:35:41.936 INFO:tasks.rados.rados.0.smithi142.stdout:112: write (excl) oid 19 current snap is 9 2020-06-12T02:35:41.937 INFO:tasks.rados.rados.0.smithi142.stdout:112: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2020-06-12T02:35:41.941 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:35:41.947 INFO:tasks.rados.rados.0.smithi142.stdout:112: writing smithi14213939-19 from 709262 to 1406520 tid 1 2020-06-12T02:35:41.956 INFO:tasks.rados.rados.0.smithi142.stdout:112: writing smithi14213939-19 from 2012635 to 2584653 tid 2 2020-06-12T02:35:41.960 INFO:tasks.rados.rados.0.smithi142.stdout:112: writing smithi14213939-19 from 3046388 to 3109262 tid 3 2020-06-12T02:35:41.960 INFO:tasks.rados.rados.0.smithi142.stdout:113: write oid 18 current snap is 9 2020-06-12T02:35:41.960 INFO:tasks.rados.rados.0.smithi142.stdout:113: seq_num 67 ranges {726069=772507,2071117=715676} 2020-06-12T02:35:41.971 INFO:tasks.rados.rados.0.smithi142.stdout:113: writing smithi14213939-18 from 726069 to 1498576 tid 1 2020-06-12T02:35:41.980 INFO:tasks.rados.rados.0.smithi142.stdout:113: writing smithi14213939-18 from 2071117 to 2786793 tid 2 2020-06-12T02:35:41.981 INFO:tasks.rados.rados.0.smithi142.stdout:114: read oid 21 snap -1 2020-06-12T02:35:41.981 INFO:tasks.rados.rados.0.smithi142.stdout:114: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:35:41.981 INFO:tasks.rados.rados.0.smithi142.stdout:115: write (excl) oid 47 current snap is 9 2020-06-12T02:35:41.981 INFO:tasks.rados.rados.0.smithi142.stdout:115: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2020-06-12T02:35:41.990 INFO:tasks.rados.rados.0.smithi142.stdout:115: writing smithi14213939-47 from 742876 to 1190632 tid 1 2020-06-12T02:35:41.998 INFO:tasks.rados.rados.0.smithi142.stdout:115: writing smithi14213939-47 from 1729599 to 2305286 tid 2 2020-06-12T02:35:42.005 INFO:tasks.rados.rados.0.smithi142.stdout:115: writing smithi14213939-47 from 3101234 to 3142876 tid 3 2020-06-12T02:35:42.005 INFO:tasks.rados.rados.0.smithi142.stdout:111: expect (ObjNum 44 snap 0 seq_num 44) 2020-06-12T02:35:42.025 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:42.027+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:42.054 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.055 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.064 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:42.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:42.056+0000 7fac94058700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:42.069 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:42.068+0000 7fac92df6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:42.098 INFO:tasks.rados.rados.0.smithi142.stdout:109: expect (ObjNum 55 snap 3 seq_num 55) 2020-06-12T02:35:42.127 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:42.124+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:42.168 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.169 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.177 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:42.225 INFO:tasks.rados.rados.0.smithi142.stdout:112: finishing write tid 1 to smithi14213939-19 2020-06-12T02:35:42.226 INFO:tasks.rados.rados.0.smithi142.stdout:110: finishing copy_from to smithi14213939-33 2020-06-12T02:35:42.226 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 33 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:35:42.226 INFO:tasks.rados.rados.0.smithi142.stdout:110: finishing copy_from racing read to smithi14213939-33 2020-06-12T02:35:42.226 INFO:tasks.rados.rados.0.smithi142.stdout:113: finishing write tid 1 to smithi14213939-18 2020-06-12T02:35:42.226 INFO:tasks.rados.rados.0.smithi142.stdout:114: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:35:42.229 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:42.228+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:42.319 INFO:tasks.rados.rados.0.smithi142.stdout:113: finishing write tid 2 to smithi14213939-18 2020-06-12T02:35:42.319 INFO:tasks.rados.rados.0.smithi142.stdout:113: finishing write tid 4 to smithi14213939-18 2020-06-12T02:35:42.319 INFO:tasks.rados.rados.0.smithi142.stdout:115: finishing write tid 1 to smithi14213939-47 2020-06-12T02:35:42.320 INFO:tasks.rados.rados.0.smithi142.stdout:113: finishing write tid 5 to smithi14213939-18 2020-06-12T02:35:42.320 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 18 v 39 (ObjNum 67 snap 9 seq_num 67) dirty exists 2020-06-12T02:35:42.320 INFO:tasks.rados.rados.0.smithi142.stdout:113: left oid 18 (ObjNum 67 snap 9 seq_num 67) 2020-06-12T02:35:42.320 INFO:tasks.rados.rados.0.smithi142.stdout:112: finishing write tid 2 to smithi14213939-19 2020-06-12T02:35:42.320 INFO:tasks.rados.rados.0.smithi142.stdout:112: finishing write tid 3 to smithi14213939-19 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:112: finishing write tid 5 to smithi14213939-19 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:112: finishing write tid 6 to smithi14213939-19 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 43 (ObjNum 66 snap 9 seq_num 66) dirty exists 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:112: left oid 19 (ObjNum 66 snap 9 seq_num 66) 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:115: finishing write tid 2 to smithi14213939-47 2020-06-12T02:35:42.321 INFO:tasks.rados.rados.0.smithi142.stdout:115: finishing write tid 3 to smithi14213939-47 2020-06-12T02:35:42.322 INFO:tasks.rados.rados.0.smithi142.stdout:115: finishing write tid 5 to smithi14213939-47 2020-06-12T02:35:42.322 INFO:tasks.rados.rados.0.smithi142.stdout:115: finishing write tid 6 to smithi14213939-47 2020-06-12T02:35:42.322 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 54 (ObjNum 68 snap 9 seq_num 68) dirty exists 2020-06-12T02:35:42.322 INFO:tasks.rados.rados.0.smithi142.stdout:115: left oid 47 (ObjNum 68 snap 9 seq_num 68) 2020-06-12T02:35:42.322 INFO:tasks.rados.rados.0.smithi142.stdout:109: done (6 left) 2020-06-12T02:35:42.324 INFO:tasks.rados.rados.0.smithi142.stdout:110: done (5 left) 2020-06-12T02:35:42.324 INFO:tasks.rados.rados.0.smithi142.stdout:111: done (4 left) 2020-06-12T02:35:42.324 INFO:tasks.rados.rados.0.smithi142.stdout:112: done (3 left) 2020-06-12T02:35:42.324 INFO:tasks.rados.rados.0.smithi142.stdout:113: done (2 left) 2020-06-12T02:35:42.325 INFO:tasks.rados.rados.0.smithi142.stdout:114: done (1 left) 2020-06-12T02:35:42.325 INFO:tasks.rados.rados.0.smithi142.stdout:115: done (0 left) 2020-06-12T02:35:42.325 INFO:tasks.rados.rados.0.smithi142.stdout:116: copy_from oid 11 from oid 9 current snap is 9 2020-06-12T02:35:42.325 INFO:tasks.rados.rados.0.smithi142.stdout:117: rollback oid 47 current snap is 9 2020-06-12T02:35:42.325 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 47 to 7 2020-06-12T02:35:42.326 INFO:tasks.rados.rados.0.smithi142.stdout:118: write oid 6 current snap is 9 2020-06-12T02:35:42.326 INFO:tasks.rados.rados.0.smithi142.stdout:118: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2020-06-12T02:35:42.326 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.327 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.330 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:42.328+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:42.334 INFO:tasks.rados.rados.0.smithi142.stdout:118: writing smithi14213939-6 from 759683 to 1399041 tid 1 2020-06-12T02:35:42.339 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:42.341 INFO:tasks.rados.rados.0.smithi142.stdout:118: writing smithi14213939-6 from 1904434 to 2623779 tid 2 2020-06-12T02:35:42.344 INFO:tasks.rados.rados.0.smithi142.stdout:118: writing smithi14213939-6 from 3128657 to 3159683 tid 3 2020-06-12T02:35:42.345 INFO:tasks.rados.rados.0.smithi142.stdout:119: write (excl) oid 5 current snap is 9 2020-06-12T02:35:42.345 INFO:tasks.rados.rados.0.smithi142.stdout:119: seq_num 70 ranges {776490=714607,2246563=579356} 2020-06-12T02:35:42.358 INFO:tasks.rados.rados.0.smithi142.stdout:119: writing smithi14213939-5 from 776490 to 1491097 tid 1 2020-06-12T02:35:42.362 INFO:tasks.rados.rados.0.smithi142.stdout:119: writing smithi14213939-5 from 2246563 to 2825919 tid 2 2020-06-12T02:35:42.363 INFO:tasks.rados.rados.0.smithi142.stdout:117: finishing rollback tid 0 to smithi14213939-47 2020-06-12T02:35:42.363 INFO:tasks.rados.rados.0.smithi142.stdout:117: finishing rollback tid 1 to smithi14213939-47 2020-06-12T02:35:42.363 INFO:tasks.rados.rados.0.smithi142.stdout:117: finishing rollback tid 2 to smithi14213939-47 2020-06-12T02:35:42.363 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 57 (ObjNum 50 snap 2 seq_num 50) dirty exists 2020-06-12T02:35:42.363 INFO:tasks.rados.rados.0.smithi142.stdout:116: finishing copy_from to smithi14213939-11 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 11 v 12 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:116: finishing copy_from racing read to smithi14213939-11 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:118: finishing write tid 1 to smithi14213939-6 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:118: finishing write tid 2 to smithi14213939-6 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:118: finishing write tid 3 to smithi14213939-6 2020-06-12T02:35:42.364 INFO:tasks.rados.rados.0.smithi142.stdout:118: finishing write tid 5 to smithi14213939-6 2020-06-12T02:35:42.365 INFO:tasks.rados.rados.0.smithi142.stdout:118: finishing write tid 6 to smithi14213939-6 2020-06-12T02:35:42.365 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 48 (ObjNum 69 snap 9 seq_num 69) dirty exists 2020-06-12T02:35:42.365 INFO:tasks.rados.rados.0.smithi142.stdout:118: left oid 6 (ObjNum 69 snap 9 seq_num 69) 2020-06-12T02:35:42.365 INFO:tasks.rados.rados.0.smithi142.stdout:120: read oid 22 snap 7 2020-06-12T02:35:42.365 INFO:tasks.rados.rados.0.smithi142.stdout:120: expect (ObjNum 60 snap 3 seq_num 60) 2020-06-12T02:35:42.366 INFO:tasks.rados.rados.0.smithi142.stdout:116: done (4 left) 2020-06-12T02:35:42.366 INFO:tasks.rados.rados.0.smithi142.stdout:117: done (3 left) 2020-06-12T02:35:42.366 INFO:tasks.rados.rados.0.smithi142.stdout:118: done (2 left) 2020-06-12T02:35:42.366 INFO:tasks.rados.rados.0.smithi142.stdout:121: read oid 30 snap -1 2020-06-12T02:35:42.366 INFO:tasks.rados.rados.0.smithi142.stdout:121: expect (ObjNum 29 snap 0 seq_num 29) 2020-06-12T02:35:42.367 INFO:tasks.rados.rados.0.smithi142.stdout:122: read oid 31 snap -1 2020-06-12T02:35:42.367 INFO:tasks.rados.rados.0.smithi142.stdout:122: expect (ObjNum 14 snap 0 seq_num 14) 2020-06-12T02:35:42.367 INFO:tasks.rados.rados.0.smithi142.stdout:123: read oid 8 snap -1 2020-06-12T02:35:42.367 INFO:tasks.rados.rados.0.smithi142.stdout:123: expect deleted 2020-06-12T02:35:42.367 INFO:tasks.rados.rados.0.smithi142.stdout:124: read oid 29 snap -1 2020-06-12T02:35:42.368 INFO:tasks.rados.rados.0.smithi142.stdout:124: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:35:42.368 INFO:tasks.rados.rados.0.smithi142.stdout:125: read oid 2 snap -1 2020-06-12T02:35:42.368 INFO:tasks.rados.rados.0.smithi142.stdout:125: expect (ObjNum 53 snap 3 seq_num 53) 2020-06-12T02:35:42.368 INFO:tasks.rados.rados.0.smithi142.stdout:126: write oid 9 current snap is 9 2020-06-12T02:35:42.368 INFO:tasks.rados.rados.0.smithi142.stdout:126: seq_num 71 ranges {793297=789856,2305045=723014} 2020-06-12T02:35:42.373 INFO:tasks.rados.rados.0.smithi142.stdout:126: writing smithi14213939-9 from 793297 to 1583153 tid 1 2020-06-12T02:35:42.387 INFO:tasks.rados.rados.0.smithi142.stdout:126: writing smithi14213939-9 from 2305045 to 3028059 tid 2 2020-06-12T02:35:42.387 INFO:tasks.rados.rados.0.smithi142.stdout:127: snap_remove snap 8 2020-06-12T02:35:42.431 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:42.428+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:42.455 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.456 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.464 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:42.552 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:42.552+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.620 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.629 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:42.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:42.635+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:42.735 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:42.735+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:42.783 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.783 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.792 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:42.849 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:42.848+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:42.906 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:42.906 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:42.915 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:42.956 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:42.956+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:43.038 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:43.039+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:43.068 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:43.078 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:43.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:43.139+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:43.181 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:43.182 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:43.191 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:43.207 INFO:tasks.rados.rados.0.smithi142.stdout:127: done (8 left) 2020-06-12T02:35:43.208 INFO:tasks.rados.rados.0.smithi142.stdout:128: read oid 43 snap 6 2020-06-12T02:35:43.208 INFO:tasks.rados.rados.0.smithi142.stdout:128: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:43.208 INFO:tasks.rados.rados.0.smithi142.stdout:129: delete oid 35 current snap is 9 2020-06-12T02:35:43.209 INFO:tasks.rados.rados.0.smithi142.stdout:119: finishing write tid 1 to smithi14213939-5 2020-06-12T02:35:43.209 INFO:tasks.rados.rados.0.smithi142.stdout:119: finishing write tid 2 to smithi14213939-5 2020-06-12T02:35:43.210 INFO:tasks.rados.rados.0.smithi142.stdout:119: finishing write tid 4 to smithi14213939-5 2020-06-12T02:35:43.211 INFO:tasks.rados.rados.0.smithi142.stdout:122: expect (ObjNum 14 snap 0 seq_num 14) 2020-06-12T02:35:43.213 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:35:43.268 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:43.268+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:43.293 INFO:tasks.rados.rados.0.smithi142.stdout:124: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:35:43.309 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:43.309 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:43.330 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:43.342 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:43.343+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:43.373 INFO:tasks.rados.rados.0.smithi142.stdout:119: finishing write tid 5 to smithi14213939-5 2020-06-12T02:35:43.373 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 5 v 41 (ObjNum 70 snap 9 seq_num 70) dirty exists 2020-06-12T02:35:43.373 INFO:tasks.rados.rados.0.smithi142.stdout:119: left oid 5 (ObjNum 70 snap 9 seq_num 70) 2020-06-12T02:35:43.374 INFO:tasks.rados.rados.0.smithi142.stdout:120: expect (ObjNum 60 snap 3 seq_num 60) 2020-06-12T02:35:43.405 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:43.460 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:43.460+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:43.474 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:43.474 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:43.483 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:43.506 INFO:tasks.rados.rados.0.smithi142.stdout:126: finishing write tid 1 to smithi14213939-9 2020-06-12T02:35:43.507 INFO:tasks.rados.rados.0.smithi142.stdout:121: expect (ObjNum 29 snap 0 seq_num 29) 2020-06-12T02:35:43.515 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:43.512+0000 7f23fe1fb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:43.520 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:43.520+0000 7f23fcf99700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:43.544 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:43.540+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:43.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:43.581 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:43.603 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:43.604 INFO:tasks.rados.rados.0.smithi142.stdout:125: expect (ObjNum 53 snap 3 seq_num 53) 2020-06-12T02:35:43.606 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:43.607 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:43.615 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:43.622 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:43.644 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:43.644+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:43.648 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:43.672 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:43.689 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:43.713 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:43.715 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.716 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.718 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.719 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.719 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.719 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.719 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.720 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:43.731 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:43.732 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:43.733 INFO:tasks.rados.rados.0.smithi142.stdout:126: finishing write tid 2 to smithi14213939-9 2020-06-12T02:35:43.733 INFO:tasks.rados.rados.0.smithi142.stdout:126: finishing write tid 4 to smithi14213939-9 2020-06-12T02:35:43.733 INFO:tasks.rados.rados.0.smithi142.stdout:126: finishing write tid 5 to smithi14213939-9 2020-06-12T02:35:43.733 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 9 v 61 (ObjNum 71 snap 9 seq_num 71) dirty exists 2020-06-12T02:35:43.734 INFO:tasks.rados.rados.0.smithi142.stdout:126: left oid 9 (ObjNum 71 snap 9 seq_num 71) 2020-06-12T02:35:43.734 INFO:tasks.rados.rados.0.smithi142.stdout:128: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:43.742 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:43.745 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:43.747+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:43.845 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:43.847+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:43.847 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:43.848 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:43.858 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:43.867 INFO:tasks.rados.rados.0.smithi142.stdout:119: done (9 left) 2020-06-12T02:35:43.868 INFO:tasks.rados.rados.0.smithi142.stdout:120: done (8 left) 2020-06-12T02:35:43.868 INFO:tasks.rados.rados.0.smithi142.stdout:121: done (7 left) 2020-06-12T02:35:43.868 INFO:tasks.rados.rados.0.smithi142.stdout:122: done (6 left) 2020-06-12T02:35:43.869 INFO:tasks.rados.rados.0.smithi142.stdout:123: done (5 left) 2020-06-12T02:35:43.869 INFO:tasks.rados.rados.0.smithi142.stdout:124: done (4 left) 2020-06-12T02:35:43.869 INFO:tasks.rados.rados.0.smithi142.stdout:125: done (3 left) 2020-06-12T02:35:43.869 INFO:tasks.rados.rados.0.smithi142.stdout:126: done (2 left) 2020-06-12T02:35:43.869 INFO:tasks.rados.rados.0.smithi142.stdout:128: done (1 left) 2020-06-12T02:35:43.870 INFO:tasks.rados.rados.0.smithi142.stdout:129: done (0 left) 2020-06-12T02:35:43.870 INFO:tasks.rados.rados.0.smithi142.stdout:130: delete oid 46 current snap is 9 2020-06-12T02:35:43.876 INFO:tasks.rados.rados.0.smithi142.stdout:130: done (0 left) 2020-06-12T02:35:43.877 INFO:tasks.rados.rados.0.smithi142.stdout:131: write (excl) oid 31 current snap is 9 2020-06-12T02:35:43.878 INFO:tasks.rados.rados.0.smithi142.stdout:131: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2020-06-12T02:35:43.892 INFO:tasks.rados.rados.0.smithi142.stdout:131: writing smithi14213939-31 from 443718 to 1059321 tid 1 2020-06-12T02:35:43.898 INFO:tasks.rados.rados.0.smithi142.stdout:131: writing smithi14213939-31 from 1564138 to 2034479 tid 2 2020-06-12T02:35:43.905 INFO:tasks.rados.rados.0.smithi142.stdout:131: writing smithi14213939-31 from 2633066 to 3243718 tid 3 2020-06-12T02:35:43.906 INFO:tasks.rados.rados.0.smithi142.stdout:132: snap_create 2020-06-12T02:35:43.906 INFO:tasks.rados.rados.0.smithi142.stdout:131: finishing write tid 1 to smithi14213939-31 2020-06-12T02:35:43.914 INFO:tasks.rados.rados.0.smithi142.stdout:131: finishing write tid 2 to smithi14213939-31 2020-06-12T02:35:43.915 INFO:tasks.rados.rados.0.smithi142.stdout:131: finishing write tid 3 to smithi14213939-31 2020-06-12T02:35:43.917 INFO:tasks.rados.rados.0.smithi142.stdout:131: finishing write tid 5 to smithi14213939-31 2020-06-12T02:35:43.920 INFO:tasks.rados.rados.0.smithi142.stdout:131: finishing write tid 6 to smithi14213939-31 2020-06-12T02:35:43.920 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 46 (ObjNum 74 snap 9 seq_num 74) dirty exists 2020-06-12T02:35:43.920 INFO:tasks.rados.rados.0.smithi142.stdout:131: left oid 31 (ObjNum 74 snap 9 seq_num 74) 2020-06-12T02:35:43.947 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:43.944+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:44.009 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:198 1.3s0 1:cff5b50f:::smithi14213939-50:head [write 1767500~799008] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.212921515, 2020-06-12T02:35:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782, 2020-06-12T02:35:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.023 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 198 2020-06-12T02:35:44.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.023 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.795799+0000", 2020-06-12T02:35:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099562999999999995 2020-06-12T02:35:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796795+0000", 2020-06-12T02:35:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1195e-05 2020-06-12T02:35:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796806+0000", 2020-06-12T02:35:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4831e-05 2020-06-12T02:35:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796831+0000", 2020-06-12T02:35:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3913e-05 2020-06-12T02:35:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796844+0000", 2020-06-12T02:35:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5038999999999999e-05 2020-06-12T02:35:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796909+0000", 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000111087 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797021+0000", 2020-06-12T02:35:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014743670000000001 2020-06-12T02:35:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.798495+0000", 2020-06-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029768920000000001 2020-06-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801472+0000", 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037560470000000002 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805228+0000", 2020-06-12T02:35:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0780999999999999e-05 2020-06-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805299+0000", 2020-06-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.009499782 2020-06-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:199 1.3s0 1:cff5b50f:::smithi14213939-50:head [setxattr _header (56) in=7b,truncate 2823543] snapc 0=[] ondisk+write+known_if_redirected e21)", 2020-06-12T02:35:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.211793132, 2020-06-12T02:35:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995, 2020-06-12T02:35:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 199 2020-06-12T02:35:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.796927+0000", 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106302 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797034+0000", 2020-06-12T02:35:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0084e-05 2020-06-12T02:35:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797044+0000", 2020-06-12T02:35:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7399999999999999e-05 2020-06-12T02:35:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797061+0000", 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0890000000000002e-06 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797068+0000", 2020-06-12T02:35:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027601829999999998 2020-06-12T02:35:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799828+0000", 2020-06-12T02:35:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121823 2020-06-12T02:35:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.799950+0000", 2020-06-12T02:35:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00074876700000000001 2020-06-12T02:35:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.800699+0000", 2020-06-12T02:35:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028159669999999999 2020-06-12T02:35:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.803515+0000", 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019210270000000001 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805436+0000", 2020-06-12T02:35:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9416000000000001e-05 2020-06-12T02:35:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805505+0000", 2020-06-12T02:35:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085780579999999995 2020-06-12T02:35:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:200 1.3s0 1:cff5b50f:::smithi14213939-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:35:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.211588087000001, 2020-06-12T02:35:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427, 2020-06-12T02:35:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.081 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 200 2020-06-12T02:35:44.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.081 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797132+0000", 2020-06-12T02:35:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1226e-05 2020-06-12T02:35:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797194+0000", 2020-06-12T02:35:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0248000000000001e-05 2020-06-12T02:35:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797204+0000", 2020-06-12T02:35:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7323e-05 2020-06-12T02:35:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797221+0000", 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0959999999999997e-06 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.797227+0000", 2020-06-12T02:35:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004271403 2020-06-12T02:35:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801499+0000", 2020-06-12T02:35:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0492000000000001e-05 2020-06-12T02:35:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.801579+0000", 2020-06-12T02:35:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004303973 2020-06-12T02:35:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805883+0000", 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6344000000000001e-05 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.805939+0000", 2020-06-12T02:35:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016273220000000001 2020-06-12T02:35:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:28.807567+0000", 2020-06-12T02:35:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010434427 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 23/18 ECSubWrite(tid=25, reqid=client.4555.0:206, at_version=23'16, trim_to=0'0, roll_forward_to=21'12))", 2020-06-12T02:35:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 13.887432950000001, 2020-06-12T02:35:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431, 2020-06-12T02:35:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:44.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121287+0000", 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0017964389999999999 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123084+0000", 2020-06-12T02:35:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8554000000000002e-05 2020-06-12T02:35:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123142+0000", 2020-06-12T02:35:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4759999999999999e-05 2020-06-12T02:35:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123177+0000", 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8295999999999999e-05 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123196+0000", 2020-06-12T02:35:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3685999999999997e-05 2020-06-12T02:35:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123289+0000", 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6406000000000001e-05 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.123316+0000", 2020-06-12T02:35:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083341979999999993 2020-06-12T02:35:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131650+0000", 2020-06-12T02:35:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015409199999999999 2020-06-12T02:35:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131804+0000", 2020-06-12T02:35:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010516431 2020-06-12T02:35:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.875923488, 2020-06-12T02:35:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:35:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:35:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:35:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:35:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:35:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:35:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:35:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:35:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:35:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:35:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:35:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:35:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:35:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:35:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:35:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:35:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:35:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:35:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:35:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:35:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.865032106999999, 2020-06-12T02:35:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:35:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:35:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:35:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:35:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:35:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:35:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:35:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:35:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:35:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:35:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:35:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:35:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:35:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:35:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:35:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:35:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:35:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.863900063000001, 2020-06-12T02:35:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:35:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:35:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:35:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:35:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:35:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:35:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:35:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:35:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:35:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:35:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:35:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:35:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:35:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:35:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:35:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:35:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:35:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:35:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:35:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:35:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:35:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:35:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.863644878000001, 2020-06-12T02:35:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:35:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:35:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:35:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:35:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:35:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:35:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:35:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:35:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:35:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:35:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:35:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:35:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:35:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:35:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:35:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:35:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:35:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:35:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:35:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.863485690999999, 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:35:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:35:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:35:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:35:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:35:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:35:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:35:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:35:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:35:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:35:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:35:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:35:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:35:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:35:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:35:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:35:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:35:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:35:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:35:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:35:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:284 1.3s0 1:cc10fc1f:::smithi14213939-3:head [rollback 7] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8599482379999994, 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007, 2020-06-12T02:35:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 284 2020-06-12T02:35:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148772+0000", 2020-06-12T02:35:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000118615 2020-06-12T02:35:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148891+0000", 2020-06-12T02:35:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6863000000000001e-05 2020-06-12T02:35:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148908+0000", 2020-06-12T02:35:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5559999999999998e-05 2020-06-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148943+0000", 2020-06-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2563e-05 2020-06-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.148956+0000", 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033915849999999999 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152347+0000", 2020-06-12T02:35:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000232606 2020-06-12T02:35:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.152580+0000", 2020-06-12T02:35:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051544500000000001 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153095+0000", 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001814382 2020-06-12T02:35:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154910+0000", 2020-06-12T02:35:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025672569999999999 2020-06-12T02:35:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157477+0000", 2020-06-12T02:35:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2543000000000002e-05 2020-06-12T02:35:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157530+0000", 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0087574190000000007 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:285 1.3s0 1:cc10fc1f:::smithi14213939-3:head [append 0~0] snapc 7=[7,4] ondisk+write+known_if_redirected e27)", 2020-06-12T02:35:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8596677600000007, 2020-06-12T02:35:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003, 2020-06-12T02:35:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 285 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:44.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149053+0000", 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5648999999999994e-05 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149118+0000", 2020-06-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0005e-05 2020-06-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149128+0000", 2020-06-12T02:35:44.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9955000000000001e-05 2020-06-12T02:35:44.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149148+0000", 2020-06-12T02:35:44.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4200000000000001e-06 2020-06-12T02:35:44.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.149156+0000", 2020-06-12T02:35:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045664709999999999 2020-06-12T02:35:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153722+0000", 2020-06-12T02:35:44.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013702000000000001 2020-06-12T02:35:44.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.153859+0000", 2020-06-12T02:35:44.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00060901599999999998 2020-06-12T02:35:44.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.154468+0000", 2020-06-12T02:35:44.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012189189999999999 2020-06-12T02:35:44.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.155687+0000", 2020-06-12T02:35:44.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019438859999999999 2020-06-12T02:35:44.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157631+0000", 2020-06-12T02:35:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7487000000000001e-05 2020-06-12T02:35:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:34.157678+0000", 2020-06-12T02:35:44.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086258280000000003 2020-06-12T02:35:44.213 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.213 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.214 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.214 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:324 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:44.214 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:44.215 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.7195626859999997, 2020-06-12T02:35:44.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097874550000000005, 2020-06-12T02:35:44.216 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.216 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:44.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 324 2020-06-12T02:35:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289158+0000", 2020-06-12T02:35:44.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5239000000000003e-05 2020-06-12T02:35:44.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289223+0000", 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5743000000000002e-05 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289239+0000", 2020-06-12T02:35:44.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7966999999999999e-05 2020-06-12T02:35:44.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289257+0000", 2020-06-12T02:35:44.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.893e-06 2020-06-12T02:35:44.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289267+0000", 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0618000000000001e-05 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289327+0000", 2020-06-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000176854 2020-06-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289504+0000", 2020-06-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094411410000000001 2020-06-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298945+0000", 2020-06-12T02:35:44.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097874550000000005 2020-06-12T02:35:44.227 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.227 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.227 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.228 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:325 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:44.228 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:44.228 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.7193789429999997, 2020-06-12T02:35:44.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011654777999999999, 2020-06-12T02:35:44.229 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.229 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:44.229 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.229 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.229 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.230 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 325 2020-06-12T02:35:44.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.230 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:44.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289341+0000", 2020-06-12T02:35:44.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0389999999999993e-05 2020-06-12T02:35:44.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289432+0000", 2020-06-12T02:35:44.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.199e-05 2020-06-12T02:35:44.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289444+0000", 2020-06-12T02:35:44.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0911999999999999e-05 2020-06-12T02:35:44.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289465+0000", 2020-06-12T02:35:44.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2275e-05 2020-06-12T02:35:44.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289477+0000", 2020-06-12T02:35:44.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063618300000000002 2020-06-12T02:35:44.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290113+0000", 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001383 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290252+0000", 2020-06-12T02:35:44.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010744728 2020-06-12T02:35:44.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300996+0000", 2020-06-12T02:35:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011654777999999999 2020-06-12T02:35:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.7191631129999996, 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:35:44.240 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:35:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:35:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:35:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:35:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:35:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:35:44.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:35:44.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:35:44.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:35:44.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:35:44.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:35:44.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:44.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:35:44.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:35:44.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:35:44.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.251 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s1 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:35:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.7173536619999998, 2020-06-12T02:35:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096248359999999995, 2020-06-12T02:35:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.252 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.291367+0000", 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018540119999999999 2020-06-12T02:35:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293221+0000", 2020-06-12T02:35:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1129e-05 2020-06-12T02:35:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293252+0000", 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7934000000000001e-05 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293270+0000", 2020-06-12T02:35:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5599999999999996e-06 2020-06-12T02:35:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293277+0000", 2020-06-12T02:35:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8360999999999999e-05 2020-06-12T02:35:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293336+0000", 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1467e-05 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.293347+0000", 2020-06-12T02:35:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075754630000000002 2020-06-12T02:35:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300923+0000", 2020-06-12T02:35:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8910000000000003e-05 2020-06-12T02:35:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300992+0000", 2020-06-12T02:35:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096248359999999995 2020-06-12T02:35:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s1 33/18 ECSubWrite(tid=152, reqid=osd.1.0:152, at_version=33'17, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928242+0000", 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.0804784700000001, 2020-06-12T02:35:44.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0088670039999999995, 2020-06-12T02:35:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928242+0000", 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928242+0000", 2020-06-12T02:35:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3002000000000004e-05 2020-06-12T02:35:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928305+0000", 2020-06-12T02:35:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0897e-05 2020-06-12T02:35:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928326+0000", 2020-06-12T02:35:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6336000000000001e-05 2020-06-12T02:35:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928342+0000", 2020-06-12T02:35:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1739999999999997e-06 2020-06-12T02:35:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928348+0000", 2020-06-12T02:35:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00085529099999999999 2020-06-12T02:35:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929204+0000", 2020-06-12T02:35:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.172e-05 2020-06-12T02:35:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929215+0000", 2020-06-12T02:35:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0078078829999999998 2020-06-12T02:35:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937023+0000", 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5700999999999998e-05 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937109+0000", 2020-06-12T02:35:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0088670039999999995 2020-06-12T02:35:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s1 33/18 ECSubWrite(tid=156, reqid=osd.1.0:153, at_version=0'0, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.942041+0000", 2020-06-12T02:35:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.0666796869999997, 2020-06-12T02:35:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008755288, 2020-06-12T02:35:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942041+0000", 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942041+0000", 2020-06-12T02:35:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0229999999999996e-05 2020-06-12T02:35:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942121+0000", 2020-06-12T02:35:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6382999999999999e-05 2020-06-12T02:35:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942137+0000", 2020-06-12T02:35:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0570000000000001e-05 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942158+0000", 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1617000000000001e-05 2020-06-12T02:35:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942170+0000", 2020-06-12T02:35:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1749999999999997e-05 2020-06-12T02:35:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942231+0000", 2020-06-12T02:35:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5412000000000001e-05 2020-06-12T02:35:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942247+0000", 2020-06-12T02:35:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084923399999999993 2020-06-12T02:35:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950739+0000", 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6986e-05 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950796+0000", 2020-06-12T02:35:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008755288 2020-06-12T02:35:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.es2 34/18 ECSubWrite(tid=161, reqid=osd.1.0:161, at_version=34'22, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.938448+0000", 2020-06-12T02:35:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.0702725960000001, 2020-06-12T02:35:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083824339999999994, 2020-06-12T02:35:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938448+0000", 2020-06-12T02:35:44.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938448+0000", 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017452 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938622+0000", 2020-06-12T02:35:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2457000000000003e-05 2020-06-12T02:35:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938675+0000", 2020-06-12T02:35:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1826999999999998e-05 2020-06-12T02:35:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938717+0000", 2020-06-12T02:35:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4076e-05 2020-06-12T02:35:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.938731+0000", 2020-06-12T02:35:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016661340000000001 2020-06-12T02:35:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.940397+0000", 2020-06-12T02:35:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9415999999999998e-05 2020-06-12T02:35:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.940416+0000", 2020-06-12T02:35:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063583759999999998 2020-06-12T02:35:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946775+0000", 2020-06-12T02:35:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5627999999999997e-05 2020-06-12T02:35:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946830+0000", 2020-06-12T02:35:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083824339999999994 2020-06-12T02:35:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 34/18 ECSubWrite(tid=60, reqid=osd.0.0:60, at_version=34'47, trim_to=0'0, roll_forward_to=33'43))", 2020-06-12T02:35:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.946027+0000", 2020-06-12T02:35:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.0626933319999998, 2020-06-12T02:35:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085534979999999997, 2020-06-12T02:35:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946027+0000", 2020-06-12T02:35:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946027+0000", 2020-06-12T02:35:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0123e-05 2020-06-12T02:35:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946087+0000", 2020-06-12T02:35:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5048000000000001e-05 2020-06-12T02:35:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946112+0000", 2020-06-12T02:35:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0562999999999999e-05 2020-06-12T02:35:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946133+0000", 2020-06-12T02:35:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2989999999999999e-06 2020-06-12T02:35:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946140+0000", 2020-06-12T02:35:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5073000000000004e-05 2020-06-12T02:35:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946215+0000", 2020-06-12T02:35:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5699999999999999e-05 2020-06-12T02:35:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.946231+0000", 2020-06-12T02:35:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082944549999999992 2020-06-12T02:35:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954525+0000", 2020-06-12T02:35:44.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5237e-05 2020-06-12T02:35:44.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954581+0000", 2020-06-12T02:35:44.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085534979999999997 2020-06-12T02:35:44.325 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.325 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.es2 34/18 ECSubWrite(tid=167, reqid=osd.1.0:161, at_version=0'0, trim_to=0'0, roll_forward_to=34'22))", 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.948732+0000", 2020-06-12T02:35:44.326 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.0599883980000002, 2020-06-12T02:35:44.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086690090000000001, 2020-06-12T02:35:44.327 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.327 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.328 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948732+0000", 2020-06-12T02:35:44.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948732+0000", 2020-06-12T02:35:44.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2239e-05 2020-06-12T02:35:44.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948774+0000", 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7580000000000004e-06 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948784+0000", 2020-06-12T02:35:44.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8109999999999997e-06 2020-06-12T02:35:44.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948794+0000", 2020-06-12T02:35:44.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0529999999999997e-06 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948799+0000", 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9218000000000002e-05 2020-06-12T02:35:44.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948848+0000", 2020-06-12T02:35:44.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1839e-05 2020-06-12T02:35:44.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.948860+0000", 2020-06-12T02:35:44.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008475827 2020-06-12T02:35:44.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957336+0000", 2020-06-12T02:35:44.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5264000000000004e-05 2020-06-12T02:35:44.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957401+0000", 2020-06-12T02:35:44.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086690090000000001 2020-06-12T02:35:44.338 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.338 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.339 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.339 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:44.340 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:44.341 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:44.341 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2020-06-12T02:35:44.341 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-06-12T02:35:44.341 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-06-12T02:35:44.342 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2020-06-12T02:35:44.345 INFO:tasks.rados.rados.0.smithi142.stdout:131: done (1 left) 2020-06-12T02:35:44.345 INFO:tasks.rados.rados.0.smithi142.stdout:132: done (0 left) 2020-06-12T02:35:44.346 INFO:tasks.rados.rados.0.smithi142.stdout:133: write (excl) oid 35 current snap is 10 2020-06-12T02:35:44.346 INFO:tasks.rados.rados.0.smithi142.stdout:133: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2020-06-12T02:35:44.346 INFO:tasks.rados.rados.0.smithi142.stdout:133: writing smithi14213939-35 from 460525 to 1151377 tid 1 2020-06-12T02:35:44.346 INFO:tasks.rados.rados.0.smithi142.stdout:133: writing smithi14213939-35 from 1622620 to 2352972 tid 2 2020-06-12T02:35:44.346 INFO:tasks.rados.rados.0.smithi142.stdout:133: writing smithi14213939-35 from 3060489 to 3260525 tid 3 2020-06-12T02:35:44.347 INFO:tasks.rados.rados.0.smithi142.stdout:134: read oid 28 snap -1 2020-06-12T02:35:44.347 INFO:tasks.rados.rados.0.smithi142.stdout:134: expect (ObjNum 27 snap 0 seq_num 27) 2020-06-12T02:35:44.347 INFO:tasks.rados.rados.0.smithi142.stdout:135: write (excl) oid 24 current snap is 10 2020-06-12T02:35:44.347 INFO:tasks.rados.rados.0.smithi142.stdout:135: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2020-06-12T02:35:44.348 INFO:tasks.rados.rados.0.smithi142.stdout:135: writing smithi14213939-24 from 477332 to 1243433 tid 1 2020-06-12T02:35:44.348 INFO:tasks.rados.rados.0.smithi142.stdout:135: writing smithi14213939-24 from 1681102 to 2155112 tid 2 2020-06-12T02:35:44.348 INFO:tasks.rados.rados.0.smithi142.stdout:135: writing smithi14213939-24 from 2687912 to 3277332 tid 3 2020-06-12T02:35:44.348 INFO:tasks.rados.rados.0.smithi142.stdout:136: delete oid 14 current snap is 10 2020-06-12T02:35:44.348 INFO:tasks.rados.rados.0.smithi142.stdout:133: finishing write tid 1 to smithi14213939-35 2020-06-12T02:35:44.349 INFO:tasks.rados.rados.0.smithi142.stdout:133: finishing write tid 2 to smithi14213939-35 2020-06-12T02:35:44.349 INFO:tasks.rados.rados.0.smithi142.stdout:133: finishing write tid 3 to smithi14213939-35 2020-06-12T02:35:44.349 INFO:tasks.rados.rados.0.smithi142.stdout:133: finishing write tid 5 to smithi14213939-35 2020-06-12T02:35:44.349 INFO:tasks.rados.rados.0.smithi142.stdout:133: finishing write tid 6 to smithi14213939-35 2020-06-12T02:35:44.349 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 32 (ObjNum 75 snap 10 seq_num 75) dirty exists 2020-06-12T02:35:44.350 INFO:tasks.rados.rados.0.smithi142.stdout:133: left oid 35 (ObjNum 75 snap 10 seq_num 75) 2020-06-12T02:35:44.350 INFO:tasks.rados.rados.0.smithi142.stdout:135: finishing write tid 1 to smithi14213939-24 2020-06-12T02:35:44.350 INFO:tasks.rados.rados.0.smithi142.stdout:133: done (3 left) 2020-06-12T02:35:44.350 INFO:tasks.rados.rados.0.smithi142.stdout:136: done (2 left) 2020-06-12T02:35:44.350 INFO:tasks.rados.rados.0.smithi142.stdout:137: read oid 48 snap -1 2020-06-12T02:35:44.351 INFO:tasks.rados.rados.0.smithi142.stdout:137: expect (ObjNum 41 snap 0 seq_num 41) 2020-06-12T02:35:44.351 INFO:tasks.rados.rados.0.smithi142.stdout:138: read oid 12 snap -1 2020-06-12T02:35:44.351 INFO:tasks.rados.rados.0.smithi142.stdout:138: expect (ObjNum 11 snap 0 seq_num 11) 2020-06-12T02:35:44.351 INFO:tasks.rados.rados.0.smithi142.stdout:139: write oid 47 current snap is 10 2020-06-12T02:35:44.351 INFO:tasks.rados.rados.0.smithi142.stdout:139: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2020-06-12T02:35:44.352 INFO:tasks.rados.rados.0.smithi142.stdout:139: writing smithi14213939-47 from 510946 to 1143898 tid 1 2020-06-12T02:35:44.352 INFO:tasks.rados.rados.0.smithi142.stdout:139: writing smithi14213939-47 from 1798066 to 2275745 tid 2 2020-06-12T02:35:44.352 INFO:tasks.rados.rados.0.smithi142.stdout:139: writing smithi14213939-47 from 2742758 to 3199975 tid 3 2020-06-12T02:35:44.352 INFO:tasks.rados.rados.0.smithi142.stdout:140: write (excl) oid 42 current snap is 10 2020-06-12T02:35:44.353 INFO:tasks.rados.rados.0.smithi142.stdout:140: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2020-06-12T02:35:44.353 INFO:tasks.rados.rados.0.smithi142.stdout:140: writing smithi14213939-42 from 527753 to 1235954 tid 1 2020-06-12T02:35:44.353 INFO:tasks.rados.rados.0.smithi142.stdout:140: writing smithi14213939-42 from 1856548 to 2594238 tid 2 2020-06-12T02:35:44.353 INFO:tasks.rados.rados.0.smithi142.stdout:140: writing smithi14213939-42 from 3286534 to 3327753 tid 3 2020-06-12T02:35:44.353 INFO:tasks.rados.rados.0.smithi142.stdout:141: snap_remove snap 6 2020-06-12T02:35:44.354 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:44.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:44.343+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:44.442 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:44.444+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:44.502 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:44.502 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:44.503 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:44.503 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-06-12T02:35:44.503 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:44.512 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:44.561 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:44.563+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:44.644 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:44.644+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:44.670 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:44.670 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:44.670 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:44.671 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:44.671 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:44.686 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:44.745 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:44.748+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:44.794 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:44.795 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:44.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:44.795 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:44.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.796 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=6, reqid=client.4555.0:213, at_version=23'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:44.796 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:44.796 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.665116401000001, 2020-06-12T02:35:44.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999, 2020-06-12T02:35:44.797 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.797 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.797 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:44.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128143+0000", 2020-06-12T02:35:44.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9608e-05 2020-06-12T02:35:44.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128233+0000", 2020-06-12T02:35:44.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0374999999999999e-05 2020-06-12T02:35:44.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128273+0000", 2020-06-12T02:35:44.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2021999999999999e-05 2020-06-12T02:35:44.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128305+0000", 2020-06-12T02:35:44.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2435999999999999e-05 2020-06-12T02:35:44.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128318+0000", 2020-06-12T02:35:44.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018382399999999999 2020-06-12T02:35:44.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128501+0000", 2020-06-12T02:35:44.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4272e-05 2020-06-12T02:35:44.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128536+0000", 2020-06-12T02:35:44.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031735639999999998 2020-06-12T02:35:44.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131709+0000", 2020-06-12T02:35:44.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9300000000000003e-05 2020-06-12T02:35:44.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131788+0000", 2020-06-12T02:35:44.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036454009999999999 2020-06-12T02:35:44.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.815 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.815 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.817 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:44.818 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:44.818 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.661319912, 2020-06-12T02:35:44.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002, 2020-06-12T02:35:44.818 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.819 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.819 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:44.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:44.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4559000000000001e-05 2020-06-12T02:35:44.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132024+0000", 2020-06-12T02:35:44.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5899999999999999e-05 2020-06-12T02:35:44.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132050+0000", 2020-06-12T02:35:44.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2875999999999999e-05 2020-06-12T02:35:44.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132073+0000", 2020-06-12T02:35:44.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2930000000000006e-06 2020-06-12T02:35:44.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132082+0000", 2020-06-12T02:35:44.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054950300000000001 2020-06-12T02:35:44.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132632+0000", 2020-06-12T02:35:44.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6909999999999999e-05 2020-06-12T02:35:44.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132649+0000", 2020-06-12T02:35:44.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046183320000000002 2020-06-12T02:35:44.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137267+0000", 2020-06-12T02:35:44.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6516000000000001e-05 2020-06-12T02:35:44.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137303+0000", 2020-06-12T02:35:44.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002 2020-06-12T02:35:44.834 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.838 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.839 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.839 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:44.840 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:44.840 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 13.647519714, 2020-06-12T02:35:44.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:35:44.840 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.841 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.841 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:44.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:44.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:35:44.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:35:44.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:35:44.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:35:44.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:35:44.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:35:44.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:35:44.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:35:44.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:35:44.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:35:44.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:35:44.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:35:44.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:35:44.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:35:44.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:35:44.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:35:44.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:35:44.854 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.857 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpRead(1.1s1 29/18 ECSubRead(tid=52, to_read={1:82c302db:::smithi14213939-48:4=0,1396736,0}, subchunks={1:82c302db:::smithi14213939-48:4=[0,1]}, attrs_to_read=))", 2020-06-12T02:35:44.857 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:44.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.5253143700000003, 2020-06-12T02:35:44.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035457660000000001, 2020-06-12T02:35:44.858 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.858 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:44.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267945+0000", 2020-06-12T02:35:44.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9910999999999999e-05 2020-06-12T02:35:44.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267975+0000", 2020-06-12T02:35:44.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4700000000000001e-06 2020-06-12T02:35:44.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267981+0000", 2020-06-12T02:35:44.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.1090000000000004e-06 2020-06-12T02:35:44.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267990+0000", 2020-06-12T02:35:44.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5949999999999999e-06 2020-06-12T02:35:44.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.267993+0000", 2020-06-12T02:35:44.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029544860000000001 2020-06-12T02:35:44.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270948+0000", 2020-06-12T02:35:44.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054319500000000001 2020-06-12T02:35:44.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.271491+0000", 2020-06-12T02:35:44.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035457660000000001 2020-06-12T02:35:44.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.868 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.869 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=135, reqid=client.4555.0:313, at_version=29'16, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:44.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:44.870 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.5111950650000008, 2020-06-12T02:35:44.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996, 2020-06-12T02:35:44.871 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.871 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.871 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:44.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:44.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00068568199999999996 2020-06-12T02:35:44.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282750+0000", 2020-06-12T02:35:44.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9499000000000001e-05 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282810+0000", 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9295e-05 2020-06-12T02:35:44.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282839+0000", 2020-06-12T02:35:44.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:35:44.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282850+0000", 2020-06-12T02:35:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4931999999999994e-05 2020-06-12T02:35:44.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282915+0000", 2020-06-12T02:35:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3213999999999999e-05 2020-06-12T02:35:44.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282928+0000", 2020-06-12T02:35:44.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043331150000000002 2020-06-12T02:35:44.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287261+0000", 2020-06-12T02:35:44.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3059999999999994e-05 2020-06-12T02:35:44.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287344+0000", 2020-06-12T02:35:44.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996 2020-06-12T02:35:44.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:35:44.882 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:44.883 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.5010062029999993, 2020-06-12T02:35:44.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:35:44.883 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.883 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.883 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:44.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:44.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:35:44.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:35:44.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:35:44.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:35:44.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:35:44.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:35:44.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:35:44.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:35:44.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:35:44.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:35:44.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=138, reqid=client.4555.0:314, at_version=29'17, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.4950215870000001, 2020-06-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512, 2020-06-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.895 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:44.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050880100000000002 2020-06-12T02:35:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298747+0000", 2020-06-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7461999999999999e-05 2020-06-12T02:35:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298774+0000", 2020-06-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3760999999999999e-05 2020-06-12T02:35:44.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298788+0000", 2020-06-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9280000000000004e-06 2020-06-12T02:35:44.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298795+0000", 2020-06-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0432999999999994e-05 2020-06-12T02:35:44.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298875+0000", 2020-06-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2087e-05 2020-06-12T02:35:44.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298897+0000", 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069111329999999999 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305809+0000", 2020-06-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3906999999999996e-05 2020-06-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305882+0000", 2020-06-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512 2020-06-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.905 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.906 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=141, reqid=client.4555.0:315, at_version=29'18, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:44.906 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:44.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.4937687159999999, 2020-06-12T02:35:44.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003, 2020-06-12T02:35:44.907 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.907 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.907 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:44.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092376299999999997 2020-06-12T02:35:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300415+0000", 2020-06-12T02:35:44.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0585999999999999e-05 2020-06-12T02:35:44.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300435+0000", 2020-06-12T02:35:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2507000000000001e-05 2020-06-12T02:35:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300448+0000", 2020-06-12T02:35:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3489999999999997e-06 2020-06-12T02:35:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300454+0000", 2020-06-12T02:35:44.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4029000000000001e-05 2020-06-12T02:35:44.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300508+0000", 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4767000000000001e-05 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300543+0000", 2020-06-12T02:35:44.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053731100000000004 2020-06-12T02:35:44.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305916+0000", 2020-06-12T02:35:44.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3744999999999994e-05 2020-06-12T02:35:44.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305980+0000", 2020-06-12T02:35:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003 2020-06-12T02:35:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.918 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=142, reqid=client.4555.0:316, at_version=29'19, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:44.919 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.4916385779999999, 2020-06-12T02:35:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998, 2020-06-12T02:35:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.168e-05 2020-06-12T02:35:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301673+0000", 2020-06-12T02:35:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8664e-05 2020-06-12T02:35:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301691+0000", 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9213000000000001e-05 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301710+0000", 2020-06-12T02:35:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3760000000000008e-06 2020-06-12T02:35:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301719+0000", 2020-06-12T02:35:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042316700000000001 2020-06-12T02:35:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302142+0000", 2020-06-12T02:35:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5987999999999999e-05 2020-06-12T02:35:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302168+0000", 2020-06-12T02:35:44.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0038407580000000001 2020-06-12T02:35:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306009+0000", 2020-06-12T02:35:44.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1911999999999999e-05 2020-06-12T02:35:44.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306071+0000", 2020-06-12T02:35:44.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998 2020-06-12T02:35:44.933 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.934 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.935 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=146, reqid=client.4555.0:316, at_version=0'0, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:44.936 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:44.936 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.4855887580000005, 2020-06-12T02:35:44.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718, 2020-06-12T02:35:44.937 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.938 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.938 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:44.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:44.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9865e-05 2020-06-12T02:35:44.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307701+0000", 2020-06-12T02:35:44.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0020000000000001e-05 2020-06-12T02:35:44.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307711+0000", 2020-06-12T02:35:44.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1705999999999999e-05 2020-06-12T02:35:44.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307722+0000", 2020-06-12T02:35:44.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:35:44.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307727+0000", 2020-06-12T02:35:44.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3153999999999999e-05 2020-06-12T02:35:44.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307790+0000", 2020-06-12T02:35:44.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2943e-05 2020-06-12T02:35:44.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307803+0000", 2020-06-12T02:35:44.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036252849999999998 2020-06-12T02:35:44.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311429+0000", 2020-06-12T02:35:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0825999999999998e-05 2020-06-12T02:35:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311469+0000", 2020-06-12T02:35:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718 2020-06-12T02:35:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.950 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=151, reqid=osd.1.0:151, at_version=33'15, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:44.950 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:44.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8650702030000001, 2020-06-12T02:35:44.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001, 2020-06-12T02:35:44.951 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.951 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:44.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:44.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8978000000000003e-05 2020-06-12T02:35:44.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928258+0000", 2020-06-12T02:35:44.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6777000000000001e-05 2020-06-12T02:35:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928285+0000", 2020-06-12T02:35:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:35:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928303+0000", 2020-06-12T02:35:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0790000000000007e-06 2020-06-12T02:35:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928312+0000", 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00047842700000000002 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928790+0000", 2020-06-12T02:35:44.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4056000000000001e-05 2020-06-12T02:35:44.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928804+0000", 2020-06-12T02:35:44.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003089488 2020-06-12T02:35:44.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931894+0000", 2020-06-12T02:35:44.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7665999999999999e-05 2020-06-12T02:35:44.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931962+0000", 2020-06-12T02:35:44.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001 2020-06-12T02:35:44.967 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.967 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.967 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.969 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=152, reqid=osd.1.0:152, at_version=33'17, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:44.969 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:44.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8648809000000002, 2020-06-12T02:35:44.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996, 2020-06-12T02:35:44.970 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.971 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.971 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:44.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:44.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0865999999999995e-05 2020-06-12T02:35:44.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928449+0000", 2020-06-12T02:35:44.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4501000000000001e-05 2020-06-12T02:35:44.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928474+0000", 2020-06-12T02:35:44.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6772000000000001e-05 2020-06-12T02:35:44.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928491+0000", 2020-06-12T02:35:44.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1799999999999999e-06 2020-06-12T02:35:44.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928498+0000", 2020-06-12T02:35:44.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072590399999999998 2020-06-12T02:35:44.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929224+0000", 2020-06-12T02:35:44.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3964e-05 2020-06-12T02:35:44.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:44.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929238+0000", 2020-06-12T02:35:44.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051932339999999997 2020-06-12T02:35:44.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:44.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934431+0000", 2020-06-12T02:35:44.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7349999999999995e-05 2020-06-12T02:35:44.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:44.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934518+0000", 2020-06-12T02:35:44.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996 2020-06-12T02:35:44.986 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.987 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:44.987 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:44.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.988 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=153, reqid=osd.1.0:153, at_version=33'21, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:44.988 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:44.988 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8609017469999998, 2020-06-12T02:35:44.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211, 2020-06-12T02:35:44.989 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:44.989 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:44.989 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:44.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:44.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:44.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:44.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:44.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:44.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8218000000000002e-05 2020-06-12T02:35:44.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:44.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932436+0000", 2020-06-12T02:35:44.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0248999999999999e-05 2020-06-12T02:35:44.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:44.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932456+0000", 2020-06-12T02:35:44.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4163e-05 2020-06-12T02:35:44.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:44.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932470+0000", 2020-06-12T02:35:44.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7780000000000004e-06 2020-06-12T02:35:44.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:44.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932476+0000", 2020-06-12T02:35:44.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1088999999999997e-05 2020-06-12T02:35:44.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:44.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:44.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:44.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932537+0000", 2020-06-12T02:35:44.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6789000000000001e-05 2020-06-12T02:35:45.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.002 INFO:tasks.rados.rados.0.smithi142.stdout:141: done (6 left) 2020-06-12T02:35:45.002 INFO:tasks.rados.rados.0.smithi142.stdout:142: write oid 27 current snap is 10 2020-06-12T02:35:45.002 INFO:tasks.rados.rados.0.smithi142.stdout:142: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2020-06-12T02:35:45.003 INFO:tasks.rados.rados.0.smithi142.stdout:142: writing smithi14213939-27 from 544560 to 1328010 tid 1 2020-06-12T02:35:45.003 INFO:tasks.rados.rados.0.smithi142.stdout:142: writing smithi14213939-27 from 1915030 to 2396378 tid 2 2020-06-12T02:35:45.003 INFO:tasks.rados.rados.0.smithi142.stdout:142: writing smithi14213939-27 from 2797604 to 3277365 tid 3 2020-06-12T02:35:45.003 INFO:tasks.rados.rados.0.smithi142.stdout:134: expect (ObjNum 27 snap 0 seq_num 27) 2020-06-12T02:35:45.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932554+0000", 2020-06-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046876670000000004 2020-06-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937242+0000", 2020-06-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0258000000000004e-05 2020-06-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937312+0000", 2020-06-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211 2020-06-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=154, reqid=osd.1.0:152, at_version=0'0, trim_to=0'0, roll_forward_to=33'17))", 2020-06-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8552874790000002, 2020-06-12T02:35:45.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998, 2020-06-12T02:35:45.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010771400000000001 2020-06-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938080+0000", 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7977000000000001e-05 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938098+0000", 2020-06-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5340000000000001e-05 2020-06-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938123+0000", 2020-06-12T02:35:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2699999999999993e-06 2020-06-12T02:35:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938132+0000", 2020-06-12T02:35:45.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-05 2020-06-12T02:35:45.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938198+0000", 2020-06-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3832000000000002e-05 2020-06-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938222+0000", 2020-06-12T02:35:45.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043491199999999997 2020-06-12T02:35:45.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942571+0000", 2020-06-12T02:35:45.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4549000000000002e-05 2020-06-12T02:35:45.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942625+0000", 2020-06-12T02:35:45.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998 2020-06-12T02:35:45.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.019 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.020 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=156, reqid=osd.1.0:153, at_version=0'0, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:45.020 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:45.021 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8511309000000002, 2020-06-12T02:35:45.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001, 2020-06-12T02:35:45.021 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.021 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.021 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:45.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3413999999999998e-05 2020-06-12T02:35:45.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942212+0000", 2020-06-12T02:35:45.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6614999999999999e-05 2020-06-12T02:35:45.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942229+0000", 2020-06-12T02:35:45.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0424e-05 2020-06-12T02:35:45.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942249+0000", 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942257+0000", 2020-06-12T02:35:45.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064044099999999995 2020-06-12T02:35:45.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942898+0000", 2020-06-12T02:35:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5028000000000001e-05 2020-06-12T02:35:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942913+0000", 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00476955 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947682+0000", 2020-06-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6485999999999999e-05 2020-06-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947759+0000", 2020-06-12T02:35:45.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001 2020-06-12T02:35:45.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.031 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 33/18 ECSubWrite(tid=16, reqid=osd.6.0:16, at_version=33'15, trim_to=0'0, roll_forward_to=32'13))", 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.847771775, 2020-06-12T02:35:45.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998, 2020-06-12T02:35:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0977999999999995e-05 2020-06-12T02:35:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945579+0000", 2020-06-12T02:35:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0941000000000002e-05 2020-06-12T02:35:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945600+0000", 2020-06-12T02:35:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2208999999999999e-05 2020-06-12T02:35:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945612+0000", 2020-06-12T02:35:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1380000000000004e-06 2020-06-12T02:35:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945618+0000", 2020-06-12T02:35:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036558199999999998 2020-06-12T02:35:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945984+0000", 2020-06-12T02:35:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1464e-05 2020-06-12T02:35:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.946005+0000", 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044700829999999997 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950475+0000", 2020-06-12T02:35:45.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3517000000000003e-05 2020-06-12T02:35:45.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950529+0000", 2020-06-12T02:35:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998 2020-06-12T02:35:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 34/18 ECSubWrite(tid=166, reqid=osd.1.0:162, at_version=0'0, trim_to=0'0, roll_forward_to=34'21))", 2020-06-12T02:35:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.8455616680000002, 2020-06-12T02:35:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042519020000000001, 2020-06-12T02:35:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4316999999999997e-05 2020-06-12T02:35:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947732+0000", 2020-06-12T02:35:45.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0226e-05 2020-06-12T02:35:45.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947742+0000", 2020-06-12T02:35:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2429000000000001e-05 2020-06-12T02:35:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947755+0000", 2020-06-12T02:35:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0480000000000004e-06 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947764+0000", 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8236999999999998e-05 2020-06-12T02:35:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947822+0000", 2020-06-12T02:35:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5532e-05 2020-06-12T02:35:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947838+0000", 2020-06-12T02:35:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0040593030000000002 2020-06-12T02:35:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.951897+0000", 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2809999999999998e-05 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.951950+0000", 2020-06-12T02:35:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042519020000000001 2020-06-12T02:35:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 34/18 ECSubWrite(tid=19, reqid=osd.6.0:18, at_version=0'0, trim_to=0'0, roll_forward_to=34'17))", 2020-06-12T02:35:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.8427693619999999, 2020-06-12T02:35:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0055220870000000002, 2020-06-12T02:35:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:45.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8536999999999999e-05 2020-06-12T02:35:45.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950549+0000", 2020-06-12T02:35:45.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5608999999999999e-05 2020-06-12T02:35:45.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950564+0000", 2020-06-12T02:35:45.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7113999999999999e-05 2020-06-12T02:35:45.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950581+0000", 2020-06-12T02:35:45.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.52e-06 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950589+0000", 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121382 2020-06-12T02:35:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950710+0000", 2020-06-12T02:35:45.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2680000000000001e-05 2020-06-12T02:35:45.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950723+0000", 2020-06-12T02:35:45.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052350230000000001 2020-06-12T02:35:45.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.955958+0000", 2020-06-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4221999999999997e-05 2020-06-12T02:35:45.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.956012+0000", 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0055220870000000002 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.072 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.073 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.073 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 34/18 ECSubWrite(tid=168, reqid=osd.1.0:168, at_version=34'23, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:45.073 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:45.074 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.840567654, 2020-06-12T02:35:45.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051454129999999997, 2020-06-12T02:35:45.074 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.074 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.074 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:45.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2197999999999999e-05 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952724+0000", 2020-06-12T02:35:45.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7708000000000001e-05 2020-06-12T02:35:45.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952742+0000", 2020-06-12T02:35:45.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9650000000000003e-06 2020-06-12T02:35:45.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952752+0000", 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2170000000000002e-06 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952757+0000", 2020-06-12T02:35:45.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1983e-05 2020-06-12T02:35:45.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952809+0000", 2020-06-12T02:35:45.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6311999999999999e-05 2020-06-12T02:35:45.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952865+0000", 2020-06-12T02:35:45.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049115139999999996 2020-06-12T02:35:45.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957777+0000", 2020-06-12T02:35:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0516000000000001e-05 2020-06-12T02:35:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957837+0000", 2020-06-12T02:35:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051454129999999997 2020-06-12T02:35:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 34/18 ECSubWrite(tid=56, reqid=osd.3.0:56, at_version=34'11, trim_to=0'0, roll_forward_to=26'9))", 2020-06-12T02:35:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.8387661770000001, 2020-06-12T02:35:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064453660000000001, 2020-06-12T02:35:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2889000000000001e-05 2020-06-12T02:35:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954546+0000", 2020-06-12T02:35:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4028000000000001e-05 2020-06-12T02:35:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954570+0000", 2020-06-12T02:35:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5843999999999999e-05 2020-06-12T02:35:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954586+0000", 2020-06-12T02:35:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7949999999999996e-06 2020-06-12T02:35:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954595+0000", 2020-06-12T02:35:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121771 2020-06-12T02:35:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954717+0000", 2020-06-12T02:35:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2055000000000001e-05 2020-06-12T02:35:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954729+0000", 2020-06-12T02:35:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061701849999999999 2020-06-12T02:35:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.960899+0000", 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9799000000000003e-05 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.960939+0000", 2020-06-12T02:35:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064453660000000001 2020-06-12T02:35:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.098 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:45.098 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:45.100 INFO:tasks.rados.rados.0.smithi142.stdout:135: finishing write tid 2 to smithi14213939-24 2020-06-12T02:35:45.100 INFO:tasks.rados.rados.0.smithi142.stdout:135: finishing write tid 3 to smithi14213939-24 2020-06-12T02:35:45.101 INFO:tasks.rados.rados.0.smithi142.stdout:135: finishing write tid 5 to smithi14213939-24 2020-06-12T02:35:45.101 INFO:tasks.rados.rados.0.smithi142.stdout:139: finishing write tid 1 to smithi14213939-47 2020-06-12T02:35:45.101 INFO:tasks.rados.rados.0.smithi142.stdout:138: expect (ObjNum 11 snap 0 seq_num 11) 2020-06-12T02:35:45.101 INFO:tasks.rados.rados.0.smithi142.stdout:135: finishing write tid 6 to smithi14213939-24 2020-06-12T02:35:45.101 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 24 v 52 (ObjNum 76 snap 10 seq_num 76) dirty exists 2020-06-12T02:35:45.102 INFO:tasks.rados.rados.0.smithi142.stdout:135: left oid 24 (ObjNum 76 snap 10 seq_num 76) 2020-06-12T02:35:45.102 INFO:tasks.rados.rados.0.smithi142.stdout:137: expect (ObjNum 41 snap 0 seq_num 41) 2020-06-12T02:35:45.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:45.003+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:45.105 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:45.104+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:45.170 INFO:tasks.rados.rados.0.smithi142.stdout:139: finishing write tid 2 to smithi14213939-47 2020-06-12T02:35:45.171 INFO:tasks.rados.rados.0.smithi142.stdout:139: finishing write tid 3 to smithi14213939-47 2020-06-12T02:35:45.171 INFO:tasks.rados.rados.0.smithi142.stdout:139: finishing write tid 5 to smithi14213939-47 2020-06-12T02:35:45.171 INFO:tasks.rados.rados.0.smithi142.stdout:139: finishing write tid 6 to smithi14213939-47 2020-06-12T02:35:45.171 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 70 (ObjNum 78 snap 10 seq_num 78) dirty exists 2020-06-12T02:35:45.171 INFO:tasks.rados.rados.0.smithi142.stdout:139: left oid 47 (ObjNum 78 snap 10 seq_num 78) 2020-06-12T02:35:45.172 INFO:tasks.rados.rados.0.smithi142.stdout:140: finishing write tid 1 to smithi14213939-42 2020-06-12T02:35:45.172 INFO:tasks.rados.rados.0.smithi142.stdout:140: finishing write tid 2 to smithi14213939-42 2020-06-12T02:35:45.172 INFO:tasks.rados.rados.0.smithi142.stdout:140: finishing write tid 3 to smithi14213939-42 2020-06-12T02:35:45.172 INFO:tasks.rados.rados.0.smithi142.stdout:140: finishing write tid 5 to smithi14213939-42 2020-06-12T02:35:45.172 INFO:tasks.rados.rados.0.smithi142.stdout:140: finishing write tid 6 to smithi14213939-42 2020-06-12T02:35:45.173 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 42 v 27 (ObjNum 79 snap 10 seq_num 79) dirty exists 2020-06-12T02:35:45.173 INFO:tasks.rados.rados.0.smithi142.stdout:140: left oid 42 (ObjNum 79 snap 10 seq_num 79) 2020-06-12T02:35:45.173 INFO:tasks.rados.rados.0.smithi142.stdout:142: finishing write tid 1 to smithi14213939-27 2020-06-12T02:35:45.173 INFO:tasks.rados.rados.0.smithi142.stdout:142: finishing write tid 2 to smithi14213939-27 2020-06-12T02:35:45.173 INFO:tasks.rados.rados.0.smithi142.stdout:142: finishing write tid 3 to smithi14213939-27 2020-06-12T02:35:45.174 INFO:tasks.rados.rados.0.smithi142.stdout:142: finishing write tid 5 to smithi14213939-27 2020-06-12T02:35:45.174 INFO:tasks.rados.rados.0.smithi142.stdout:142: finishing write tid 6 to smithi14213939-27 2020-06-12T02:35:45.174 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 27 v 54 (ObjNum 80 snap 10 seq_num 80) dirty exists 2020-06-12T02:35:45.174 INFO:tasks.rados.rados.0.smithi142.stdout:142: left oid 27 (ObjNum 80 snap 10 seq_num 80) 2020-06-12T02:35:45.174 INFO:tasks.rados.rados.0.smithi142.stdout:134: done (6 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:135: done (5 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:137: done (4 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:138: done (3 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:139: done (2 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:140: done (1 left) 2020-06-12T02:35:45.175 INFO:tasks.rados.rados.0.smithi142.stdout:142: done (0 left) 2020-06-12T02:35:45.176 INFO:tasks.rados.rados.0.smithi142.stdout:143: write oid 34 current snap is 10 2020-06-12T02:35:45.176 INFO:tasks.rados.rados.0.smithi142.stdout:143: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2020-06-12T02:35:45.185 INFO:tasks.rados.rados.0.smithi142.stdout:143: writing smithi14213939-34 from 561367 to 1020066 tid 1 2020-06-12T02:35:45.192 INFO:tasks.rados.rados.0.smithi142.stdout:143: writing smithi14213939-34 from 1573512 to 2314871 tid 2 2020-06-12T02:35:45.199 INFO:tasks.rados.rados.0.smithi142.stdout:143: writing smithi14213939-34 from 2941380 to 3361367 tid 3 2020-06-12T02:35:45.200 INFO:tasks.rados.rados.0.smithi142.stdout:144: read oid 24 snap -1 2020-06-12T02:35:45.201 INFO:tasks.rados.rados.0.smithi142.stdout:144: expect (ObjNum 76 snap 10 seq_num 76) 2020-06-12T02:35:45.201 INFO:tasks.rados.rados.0.smithi142.stdout:145: read oid 48 snap 5 2020-06-12T02:35:45.201 INFO:tasks.rados.rados.0.smithi142.stdout:145: expect (ObjNum 41 snap 0 seq_num 41) 2020-06-12T02:35:45.202 INFO:tasks.rados.rados.0.smithi142.stdout:146: rollback oid 42 current snap is 10 2020-06-12T02:35:45.202 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 42 to 7 2020-06-12T02:35:45.203 INFO:tasks.rados.rados.0.smithi142.stdout:143: finishing write tid 1 to smithi14213939-34 2020-06-12T02:35:45.203 INFO:tasks.rados.rados.0.smithi142.stdout:147: snap_create 2020-06-12T02:35:45.206 INFO:tasks.rados.rados.0.smithi142.stdout:146: finishing rollback tid 0 to smithi14213939-42 2020-06-12T02:35:45.206 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:45.204+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:45.215 INFO:tasks.rados.rados.0.smithi142.stdout:144: expect (ObjNum 76 snap 10 seq_num 76) 2020-06-12T02:35:45.224 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:45.225 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:45.228 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:35:45.234 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:45.307 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:45.304+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:45.331 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:45.320+0000 7f9b7d1d3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:45.335 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:45.332+0000 7f9b7c9d2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:45.340 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:45.341 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:45.341 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:45.341 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:45.341 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:45.349 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:45.355 INFO:tasks.rados.rados.0.smithi142.stdout:145: expect (ObjNum 41 snap 0 seq_num 41) 2020-06-12T02:35:45.408 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:45.407+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:45.440 INFO:tasks.rados.rados.0.smithi142.stdout:146: finishing rollback tid 1 to smithi14213939-42 2020-06-12T02:35:45.440 INFO:tasks.rados.rados.0.smithi142.stdout:146: finishing rollback tid 2 to smithi14213939-42 2020-06-12T02:35:45.441 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 42 v 32 (ObjNum 41 snap 0 seq_num 41) dirty exists 2020-06-12T02:35:45.441 INFO:tasks.rados.rados.0.smithi142.stdout:143: finishing write tid 2 to smithi14213939-34 2020-06-12T02:35:45.442 INFO:tasks.rados.rados.0.smithi142.stdout:143: finishing write tid 3 to smithi14213939-34 2020-06-12T02:35:45.442 INFO:tasks.rados.rados.0.smithi142.stdout:143: finishing write tid 5 to smithi14213939-34 2020-06-12T02:35:45.442 INFO:tasks.rados.rados.0.smithi142.stdout:143: finishing write tid 6 to smithi14213939-34 2020-06-12T02:35:45.442 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 34 v 79 (ObjNum 81 snap 10 seq_num 81) dirty exists 2020-06-12T02:35:45.442 INFO:tasks.rados.rados.0.smithi142.stdout:143: left oid 34 (ObjNum 81 snap 10 seq_num 81) 2020-06-12T02:35:45.458 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:45.459 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:45.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:45.460 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:45.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.460 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:45.461 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:45.461 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.336481994, 2020-06-12T02:35:45.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:35:45.462 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.462 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:45.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:45.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:45.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:45.463 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:35:45.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.464 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:45.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:45.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:35:45.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:35:45.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:35:45.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:35:45.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:35:45.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:35:45.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:35:45.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:35:45.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:35:45.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:35:45.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:35:45.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:45.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:35:45.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:35:45.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:35:45.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:45.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:35:45.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:35:45.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:35:45.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:35:45.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:35:45.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:35:45.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:45.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:35:45.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:35:45.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:35:45.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:35:45.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.481 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.481 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.482 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:45.482 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:45.482 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.336343058000001, 2020-06-12T02:35:45.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:35:45.483 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.483 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:45.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:45.484 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:45.484 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:45.484 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:35:45.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.485 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:45.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:45.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:35:45.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:35:45.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:35:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:35:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:35:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:35:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:35:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:35:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:35:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:35:45.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:35:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:35:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:35:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:35:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:35:45.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:45.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:35:45.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:35:45.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:35:45.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:35:45.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:35:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:35:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:45.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:35:45.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:35:45.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:35:45.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:35:45.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.523 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.524 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:45.525 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:45.525 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.33620722, 2020-06-12T02:35:45.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:35:45.526 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.526 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:45.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:45.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:45.527 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:45.527 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:35:45.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.528 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:45.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:45.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:35:45.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:35:45.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:35:45.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:35:45.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:35:45.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:35:45.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:35:45.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:45.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:35:45.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:35:45.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:35:45.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:35:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:35:45.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:35:45.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:35:45.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:35:45.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:35:45.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:35:45.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:45.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:35:45.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:35:45.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:35:45.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:35:45.546 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.547 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.548 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:45.548 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:45.549 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.312542371999999, 2020-06-12T02:35:45.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:35:45.549 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.549 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.550 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:45.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:45.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:35:45.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:35:45.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:35:45.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:35:45.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:35:45.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:35:45.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:35:45.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:35:45.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:35:45.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:35:45.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:35:45.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:35:45.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:35:45.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:35:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:35:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:35:45.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:35:45.563 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.564 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.564 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.565 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 28/18 ECSubWrite(tid=87, reqid=client.4555.0:287, at_version=28'25, trim_to=0'0, roll_forward_to=26'23))", 2020-06-12T02:35:45.565 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:45.565 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.275793584000001, 2020-06-12T02:35:45.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905, 2020-06-12T02:35:45.566 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.566 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.570 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:45.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:45.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028867860000000001 2020-06-12T02:35:45.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185516+0000", 2020-06-12T02:35:45.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1566000000000002e-05 2020-06-12T02:35:45.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185548+0000", 2020-06-12T02:35:45.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8912000000000001e-05 2020-06-12T02:35:45.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185566+0000", 2020-06-12T02:35:45.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2199999999999992e-06 2020-06-12T02:35:45.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185575+0000", 2020-06-12T02:35:45.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1684e-05 2020-06-12T02:35:45.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185646+0000", 2020-06-12T02:35:45.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6929999999999999e-05 2020-06-12T02:35:45.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185663+0000", 2020-06-12T02:35:45.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046390820000000001 2020-06-12T02:35:45.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190302+0000", 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9725000000000002e-05 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190362+0000", 2020-06-12T02:35:45.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905 2020-06-12T02:35:45.580 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.580 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.580 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.581 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 29/18 ECSubWrite(tid=48, reqid=client.4555.0:300, at_version=29'20, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:45.581 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:45.582 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.2718145990000007, 2020-06-12T02:35:45.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998, 2020-06-12T02:35:45.582 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.582 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.582 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:45.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:45.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021036700000000002 2020-06-12T02:35:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188712+0000", 2020-06-12T02:35:45.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1732e-05 2020-06-12T02:35:45.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188744+0000", 2020-06-12T02:35:45.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7884999999999999e-05 2020-06-12T02:35:45.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188761+0000", 2020-06-12T02:35:45.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5829999999999996e-06 2020-06-12T02:35:45.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188771+0000", 2020-06-12T02:35:45.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2814999999999999e-05 2020-06-12T02:35:45.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188854+0000", 2020-06-12T02:35:45.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9015999999999999e-05 2020-06-12T02:35:45.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188873+0000", 2020-06-12T02:35:45.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048068499999999997 2020-06-12T02:35:45.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193680+0000", 2020-06-12T02:35:45.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6352000000000002e-05 2020-06-12T02:35:45.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193776+0000", 2020-06-12T02:35:45.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998 2020-06-12T02:35:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.594 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 29/18 ECSubWrite(tid=137, reqid=client.4555.0:303, at_version=29'24, trim_to=0'0, roll_forward_to=26'22))", 2020-06-12T02:35:45.594 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:45.595 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.1724489160000005, 2020-06-12T02:35:45.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321, 2020-06-12T02:35:45.595 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.595 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.596 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:45.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014014069999999999 2020-06-12T02:35:45.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287375+0000", 2020-06-12T02:35:45.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5082000000000001e-05 2020-06-12T02:35:45.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287410+0000", 2020-06-12T02:35:45.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6569999999999999e-05 2020-06-12T02:35:45.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287427+0000", 2020-06-12T02:35:45.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3130000000000004e-06 2020-06-12T02:35:45.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287436+0000", 2020-06-12T02:35:45.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2125000000000005e-05 2020-06-12T02:35:45.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287508+0000", 2020-06-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3589e-05 2020-06-12T02:35:45.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287522+0000", 2020-06-12T02:35:45.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045636469999999997 2020-06-12T02:35:45.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292086+0000", 2020-06-12T02:35:45.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108588 2020-06-12T02:35:45.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292194+0000", 2020-06-12T02:35:45.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321 2020-06-12T02:35:45.607 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.607 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.608 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.609 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:35:45.609 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:45.609 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2650984620000001, 2020-06-12T02:35:45.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:35:45.609 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:35:45.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.611 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:45.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:45.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:35:45.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:35:45.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:35:45.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:35:45.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:35:45.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:35:45.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:35:45.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:35:45.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:35:45.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:45.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:35:45.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:35:45.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:35:45.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:35:45.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:45.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:35:45.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:35:45.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:35:45.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:35:45.629 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.629 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.629 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.630 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.bs1 34/18 ECSubWrite(tid=102, reqid=osd.4.0:100, at_version=0'0, trim_to=0'0, roll_forward_to=34'31))", 2020-06-12T02:35:45.630 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:45.631 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4968369260000003, 2020-06-12T02:35:45.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003, 2020-06-12T02:35:45.631 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.632 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.632 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:45.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:45.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2791000000000002e-05 2020-06-12T02:35:45.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961659+0000", 2020-06-12T02:35:45.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:35:45.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961675+0000", 2020-06-12T02:35:45.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.825e-05 2020-06-12T02:35:45.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961693+0000", 2020-06-12T02:35:45.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9419999999999998e-06 2020-06-12T02:35:45.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961700+0000", 2020-06-12T02:35:45.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7218e-05 2020-06-12T02:35:45.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961757+0000", 2020-06-12T02:35:45.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1976e-05 2020-06-12T02:35:45.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961769+0000", 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059766539999999996 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967746+0000", 2020-06-12T02:35:45.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3628000000000003e-05 2020-06-12T02:35:45.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967790+0000", 2020-06-12T02:35:45.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003 2020-06-12T02:35:45.645 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.645 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.645 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.646 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 34/18 ECSubWrite(tid=59, reqid=osd.3.0:58, at_version=0'0, trim_to=0'0, roll_forward_to=34'26))", 2020-06-12T02:35:45.646 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:45.646 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4959489650000002, 2020-06-12T02:35:45.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004, 2020-06-12T02:35:45.646 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.647 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.647 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:45.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1511000000000001e-05 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962535+0000", 2020-06-12T02:35:45.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8549999999999997e-06 2020-06-12T02:35:45.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962545+0000", 2020-06-12T02:35:45.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.042e-05 2020-06-12T02:35:45.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962556+0000", 2020-06-12T02:35:45.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1889999999999998e-06 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962561+0000", 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9722999999999998e-05 2020-06-12T02:35:45.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962611+0000", 2020-06-12T02:35:45.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1527e-05 2020-06-12T02:35:45.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962622+0000", 2020-06-12T02:35:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052122080000000003 2020-06-12T02:35:45.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967834+0000", 2020-06-12T02:35:45.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.702e-05 2020-06-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967881+0000", 2020-06-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004 2020-06-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=109, reqid=osd.2.0:109, at_version=34'35, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:35:45.658 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4948271340000003, 2020-06-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002, 2020-06-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.659 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:45.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2299999999999996e-05 2020-06-12T02:35:45.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963658+0000", 2020-06-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4314000000000001e-05 2020-06-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963682+0000", 2020-06-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5594e-05 2020-06-12T02:35:45.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963698+0000", 2020-06-12T02:35:45.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1109999999999996e-06 2020-06-12T02:35:45.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963704+0000", 2020-06-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00087375300000000001 2020-06-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964578+0000", 2020-06-12T02:35:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5530000000000004e-06 2020-06-12T02:35:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964585+0000", 2020-06-12T02:35:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005270889 2020-06-12T02:35:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969856+0000", 2020-06-12T02:35:45.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7800000000000002e-05 2020-06-12T02:35:45.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969914+0000", 2020-06-12T02:35:45.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002 2020-06-12T02:35:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=110, reqid=osd.2.0:109, at_version=0'0, trim_to=0'0, roll_forward_to=34'35))", 2020-06-12T02:35:45.675 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.4819202819999999, 2020-06-12T02:35:45.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378, 2020-06-12T02:35:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.677 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2021000000000003e-05 2020-06-12T02:35:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976545+0000", 2020-06-12T02:35:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9760000000000007e-06 2020-06-12T02:35:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976554+0000", 2020-06-12T02:35:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2782999999999999e-05 2020-06-12T02:35:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976567+0000", 2020-06-12T02:35:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3529999999999995e-06 2020-06-12T02:35:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976576+0000", 2020-06-12T02:35:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0129000000000002e-05 2020-06-12T02:35:45.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976616+0000", 2020-06-12T02:35:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1949999999999997e-06 2020-06-12T02:35:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976623+0000", 2020-06-12T02:35:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007247369 2020-06-12T02:35:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983870+0000", 2020-06-12T02:35:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2552000000000001e-05 2020-06-12T02:35:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983923+0000", 2020-06-12T02:35:45.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378 2020-06-12T02:35:45.691 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.691 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.691 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.692 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 36/18 ECSubWrite(tid=141, reqid=client.4555.0:407, at_version=36'43, trim_to=0'0, roll_forward_to=36'41))", 2020-06-12T02:35:45.692 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:45.692 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.5565492320000001, 2020-06-12T02:35:45.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051632759999999996, 2020-06-12T02:35:45.693 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.693 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.693 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:45.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071228700000000003 2020-06-12T02:35:45.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902586+0000", 2020-06-12T02:35:45.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5059999999999999e-05 2020-06-12T02:35:45.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902631+0000", 2020-06-12T02:35:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2817000000000001e-05 2020-06-12T02:35:45.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902664+0000", 2020-06-12T02:35:45.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1967000000000001e-05 2020-06-12T02:35:45.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902676+0000", 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014670300000000001 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902822+0000", 2020-06-12T02:35:45.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4173e-05 2020-06-12T02:35:45.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902857+0000", 2020-06-12T02:35:45.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004080139 2020-06-12T02:35:45.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.906937+0000", 2020-06-12T02:35:45.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010013000000000001 2020-06-12T02:35:45.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.907037+0000", 2020-06-12T02:35:45.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051632759999999996 2020-06-12T02:35:45.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.704 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.705 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=229, reqid=osd.1.0:228, at_version=0'0, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:45.705 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:45.706 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.52200798699999995, 2020-06-12T02:35:45.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995, 2020-06-12T02:35:45.706 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.706 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.707 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:45.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:45.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2689999999999996e-05 2020-06-12T02:35:45.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936497+0000", 2020-06-12T02:35:45.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1767000000000003e-05 2020-06-12T02:35:45.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936529+0000", 2020-06-12T02:35:45.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3943000000000001e-05 2020-06-12T02:35:45.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936553+0000", 2020-06-12T02:35:45.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6479999999999992e-06 2020-06-12T02:35:45.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936562+0000", 2020-06-12T02:35:45.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6100000000000002e-05 2020-06-12T02:35:45.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936618+0000", 2020-06-12T02:35:45.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.361e-05 2020-06-12T02:35:45.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936632+0000", 2020-06-12T02:35:45.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008610843 2020-06-12T02:35:45.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945242+0000", 2020-06-12T02:35:45.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5210999999999995e-05 2020-06-12T02:35:45.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945318+0000", 2020-06-12T02:35:45.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995 2020-06-12T02:35:45.717 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.717 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.718 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:45.718 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:45.719 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.52136141899999999, 2020-06-12T02:35:45.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:35:45.719 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.719 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.720 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:45.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:45.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:35:45.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:35:45.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:35:45.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:35:45.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:35:45.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:35:45.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:35:45.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:35:45.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:35:45.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:35:45.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:35:45.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:35:45.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:35:45.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:35:45.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:35:45.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:35:45.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:35:45.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:45.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:45.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.52038804900000002, 2020-06-12T02:35:45.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:35:45.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.733 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:45.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:45.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:35:45.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:35:45.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:35:45.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:35:45.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:35:45.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:35:45.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:35:45.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:35:45.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:35:45.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:35:45.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:35:45.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:35:45.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:35:45.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:35:45.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:35:45.744 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.744 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.744 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.51917892899999996, 2020-06-12T02:35:45.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:35:45.746 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.746 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.746 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:45.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:45.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:35:45.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:35:45.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:35:45.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:35:45.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:35:45.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:35:45.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:35:45.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:35:45.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:35:45.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:35:45.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:35:45.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:35:45.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:35:45.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:35:45.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:35:45.756 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.756 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.756 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=162, reqid=osd.2.0:162, at_version=38'49, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.51805890799999998, 2020-06-12T02:35:45.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997, 2020-06-12T02:35:45.758 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.758 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.758 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:45.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:45.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8365000000000001e-05 2020-06-12T02:35:45.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940422+0000", 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9471e-05 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940442+0000", 2020-06-12T02:35:45.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4909000000000001e-05 2020-06-12T02:35:45.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940457+0000", 2020-06-12T02:35:45.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-06 2020-06-12T02:35:45.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940463+0000", 2020-06-12T02:35:45.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6838000000000001e-05 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940510+0000", 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9485000000000001e-05 2020-06-12T02:35:45.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940530+0000", 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068075849999999997 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947337+0000", 2020-06-12T02:35:45.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2507000000000002e-05 2020-06-12T02:35:45.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947410+0000", 2020-06-12T02:35:45.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997 2020-06-12T02:35:45.769 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.769 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.769 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.770 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:45.770 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:45.770 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.51791594399999996, 2020-06-12T02:35:45.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:35:45.771 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.771 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.771 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:45.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:45.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:35:45.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:35:45.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:45.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:35:45.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:35:45.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:35:45.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:35:45.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:35:45.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:35:45.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:35:45.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:35:45.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:35:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:35:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:35:45.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:35:45.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.781 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=164, reqid=client.4555.0:445, at_version=38'52, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.51476926499999998, 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937, 2020-06-12T02:35:45.782 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:45.783 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:45.783 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:45.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:45.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:45.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:45.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:45.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:45.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000665089 2020-06-12T02:35:45.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944319+0000", 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2676999999999999e-05 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:45.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944351+0000", 2020-06-12T02:35:45.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7135999999999999e-05 2020-06-12T02:35:45.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:45.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944378+0000", 2020-06-12T02:35:45.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:35:45.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:45.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944388+0000", 2020-06-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00091818399999999995 2020-06-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945306+0000", 2020-06-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8420000000000005e-06 2020-06-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945314+0000", 2020-06-12T02:35:45.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054267839999999996 2020-06-12T02:35:45.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950741+0000", 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7828999999999999e-05 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950788+0000", 2020-06-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937 2020-06-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:45.795 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:45.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:45.795+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:45.797 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:45.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:45.899+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:45.900 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:45.896+0000 7f83e7804700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:45.906 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:45.904+0000 7f83e65a2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:45.926 INFO:tasks.rados.rados.0.smithi142.stdout:143: done (4 left) 2020-06-12T02:35:45.926 INFO:tasks.rados.rados.0.smithi142.stdout:144: done (3 left) 2020-06-12T02:35:45.927 INFO:tasks.rados.rados.0.smithi142.stdout:145: done (2 left) 2020-06-12T02:35:45.927 INFO:tasks.rados.rados.0.smithi142.stdout:146: done (1 left) 2020-06-12T02:35:45.927 INFO:tasks.rados.rados.0.smithi142.stdout:147: done (0 left) 2020-06-12T02:35:45.927 INFO:tasks.rados.rados.0.smithi142.stdout:148: rollback oid 35 current snap is 11 2020-06-12T02:35:45.927 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 35 to 7 2020-06-12T02:35:45.928 INFO:tasks.rados.rados.0.smithi142.stdout:149: snap_create 2020-06-12T02:35:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:35:45.934 INFO:tasks.rados.rados.0.smithi142.stdout:148: finishing rollback tid 0 to smithi14213939-35 2020-06-12T02:35:45.935 INFO:tasks.rados.rados.0.smithi142.stdout:148: finishing rollback tid 1 to smithi14213939-35 2020-06-12T02:35:45.938 INFO:tasks.rados.rados.0.smithi142.stdout:148: finishing rollback tid 2 to smithi14213939-35 2020-06-12T02:35:45.938 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 38 (ObjNum 58 snap 3 seq_num 58) dirty exists 2020-06-12T02:35:45.943 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:45.958 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:45.959 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:45.959 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:45.959 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:45.964 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:45.967 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:45.986 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:46.007 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:46.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:46.011+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:46.030 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:46.055 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:46.080 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:46.098 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:46.099+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:46.105 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:46.107 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.108 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.108 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.108 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.108 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.108 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.109 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.109 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:46.121 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.121 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.130 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:46.199 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:46.196+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:46.280 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.281 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.290 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:46.336 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:46.336+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:46.401 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:46.400+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:46.410 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.411 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.420 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:46.502 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:46.503+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:46.577 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.577 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.586 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:46.632 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:46.632+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:46.697 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.697 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.703 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:46.700+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:46.706 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:46.804 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:46.804+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:46.866 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:46.867 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:46.875 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:46.906 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:46.907+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:46.931 INFO:tasks.rados.rados.0.smithi142.stdout:148: done (1 left) 2020-06-12T02:35:46.931 INFO:tasks.rados.rados.0.smithi142.stdout:149: done (0 left) 2020-06-12T02:35:46.932 INFO:tasks.rados.rados.0.smithi142.stdout:150: write oid 19 current snap is 12 2020-06-12T02:35:46.932 INFO:tasks.rados.rados.0.smithi142.stdout:150: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2020-06-12T02:35:46.938 INFO:tasks.rados.rados.0.smithi142.stdout:150: writing smithi14213939-19 from 578174 to 1112122 tid 1 2020-06-12T02:35:46.944 INFO:tasks.rados.rados.0.smithi142.stdout:150: writing smithi14213939-19 from 1515641 to 2000658 tid 2 2020-06-12T02:35:46.953 INFO:tasks.rados.rados.0.smithi142.stdout:150: writing smithi14213939-19 from 2736097 to 3238402 tid 3 2020-06-12T02:35:46.953 INFO:tasks.rados.rados.0.smithi142.stdout:151: read oid 43 snap -1 2020-06-12T02:35:46.953 INFO:tasks.rados.rados.0.smithi142.stdout:151: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:46.953 INFO:tasks.rados.rados.0.smithi142.stdout:152: copy_from oid 32 from oid 26 current snap is 12 2020-06-12T02:35:46.954 INFO:tasks.rados.rados.0.smithi142.stdout:153: read oid 28 snap -1 2020-06-12T02:35:46.954 INFO:tasks.rados.rados.0.smithi142.stdout:153: expect (ObjNum 27 snap 0 seq_num 27) 2020-06-12T02:35:46.954 INFO:tasks.rados.rados.0.smithi142.stdout:154: write (excl) oid 5 current snap is 12 2020-06-12T02:35:46.954 INFO:tasks.rados.rados.0.smithi142.stdout:154: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2020-06-12T02:35:46.960 INFO:tasks.rados.rados.0.smithi142.stdout:154: writing smithi14213939-5 from 594981 to 1204178 tid 1 2020-06-12T02:35:46.972 INFO:tasks.rados.rados.0.smithi142.stdout:154: writing smithi14213939-5 from 1974123 to 2719151 tid 2 2020-06-12T02:35:46.977 INFO:tasks.rados.rados.0.smithi142.stdout:154: writing smithi14213939-5 from 3279873 to 3394981 tid 3 2020-06-12T02:35:46.977 INFO:tasks.rados.rados.0.smithi142.stdout:155: write (excl) oid 8 current snap is 12 2020-06-12T02:35:46.977 INFO:tasks.rados.rados.0.smithi142.stdout:155: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2020-06-12T02:35:46.983 INFO:tasks.rados.rados.0.smithi142.stdout:155: writing smithi14213939-8 from 611788 to 1012587 tid 1 2020-06-12T02:35:46.992 INFO:tasks.rados.rados.0.smithi142.stdout:155: writing smithi14213939-8 from 1748958 to 2237644 tid 2 2020-06-12T02:35:46.999 INFO:tasks.rados.rados.0.smithi142.stdout:155: writing smithi14213939-8 from 2907296 to 3411788 tid 3 2020-06-12T02:35:46.999 INFO:tasks.rados.rados.0.smithi142.stdout:156: read oid 41 snap -1 2020-06-12T02:35:47.000 INFO:tasks.rados.rados.0.smithi142.stdout:156: expect (ObjNum 40 snap 0 seq_num 40) 2020-06-12T02:35:47.000 INFO:tasks.rados.rados.0.smithi142.stdout:157: write oid 39 current snap is 12 2020-06-12T02:35:47.000 INFO:tasks.rados.rados.0.smithi142.stdout:157: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2020-06-12T02:35:47.006 INFO:tasks.rados.rados.0.smithi142.stdout:157: writing smithi14213939-39 from 628595 to 1104643 tid 1 2020-06-12T02:35:47.007 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:47.007+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:47.018 INFO:tasks.rados.rados.0.smithi142.stdout:157: writing smithi14213939-39 from 1807440 to 2439784 tid 2 2020-06-12T02:35:47.024 INFO:tasks.rados.rados.0.smithi142.stdout:157: writing smithi14213939-39 from 2934719 to 3387193 tid 3 2020-06-12T02:35:47.024 INFO:tasks.rados.rados.0.smithi142.stdout:158: copy_from oid 37 from oid 50 current snap is 12 2020-06-12T02:35:47.024 INFO:tasks.rados.rados.0.smithi142.stdout:150: finishing write tid 1 to smithi14213939-19 2020-06-12T02:35:47.024 INFO:tasks.rados.rados.0.smithi142.stdout:150: finishing write tid 2 to smithi14213939-19 2020-06-12T02:35:47.025 INFO:tasks.rados.rados.0.smithi142.stdout:150: finishing write tid 3 to smithi14213939-19 2020-06-12T02:35:47.025 INFO:tasks.rados.rados.0.smithi142.stdout:159: read oid 36 snap -1 2020-06-12T02:35:47.025 INFO:tasks.rados.rados.0.smithi142.stdout:159: expect (ObjNum 35 snap 0 seq_num 35) 2020-06-12T02:35:47.025 INFO:tasks.rados.rados.0.smithi142.stdout:160: delete oid 15 current snap is 12 2020-06-12T02:35:47.025 INFO:tasks.rados.rados.0.smithi142.stdout:150: finishing write tid 5 to smithi14213939-19 2020-06-12T02:35:47.026 INFO:tasks.rados.rados.0.smithi142.stdout:154: finishing write tid 1 to smithi14213939-5 2020-06-12T02:35:47.026 INFO:tasks.rados.rados.0.smithi142.stdout:150: finishing write tid 6 to smithi14213939-19 2020-06-12T02:35:47.026 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 69 (ObjNum 82 snap 12 seq_num 82) dirty exists 2020-06-12T02:35:47.027 INFO:tasks.rados.rados.0.smithi142.stdout:150: left oid 19 (ObjNum 82 snap 12 seq_num 82) 2020-06-12T02:35:47.027 INFO:tasks.rados.rados.0.smithi142.stdout:153: expect (ObjNum 27 snap 0 seq_num 27) 2020-06-12T02:35:47.064 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.064 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.073 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:47.105 INFO:tasks.rados.rados.0.smithi142.stdout:151: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:47.108 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:47.104+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:47.208 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.212 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.213 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:47.208+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:47.221 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:47.242 INFO:tasks.rados.rados.0.smithi142.stdout:152: finishing copy_from to smithi14213939-32 2020-06-12T02:35:47.243 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 32 v 3 (ObjNum 25 snap 0 seq_num 25) dirty exists 2020-06-12T02:35:47.243 INFO:tasks.rados.rados.0.smithi142.stdout:152: finishing copy_from racing read to smithi14213939-32 2020-06-12T02:35:47.243 INFO:tasks.rados.rados.0.smithi142.stdout:154: finishing write tid 2 to smithi14213939-5 2020-06-12T02:35:47.243 INFO:tasks.rados.rados.0.smithi142.stdout:154: finishing write tid 3 to smithi14213939-5 2020-06-12T02:35:47.243 INFO:tasks.rados.rados.0.smithi142.stdout:154: finishing write tid 5 to smithi14213939-5 2020-06-12T02:35:47.244 INFO:tasks.rados.rados.0.smithi142.stdout:155: finishing write tid 1 to smithi14213939-8 2020-06-12T02:35:47.244 INFO:tasks.rados.rados.0.smithi142.stdout:154: finishing write tid 6 to smithi14213939-5 2020-06-12T02:35:47.244 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 5 v 65 (ObjNum 83 snap 12 seq_num 83) dirty exists 2020-06-12T02:35:47.244 INFO:tasks.rados.rados.0.smithi142.stdout:154: left oid 5 (ObjNum 83 snap 12 seq_num 83) 2020-06-12T02:35:47.244 INFO:tasks.rados.rados.0.smithi142.stdout:155: finishing write tid 2 to smithi14213939-8 2020-06-12T02:35:47.245 INFO:tasks.rados.rados.0.smithi142.stdout:155: finishing write tid 3 to smithi14213939-8 2020-06-12T02:35:47.245 INFO:tasks.rados.rados.0.smithi142.stdout:150: done (10 left) 2020-06-12T02:35:47.245 INFO:tasks.rados.rados.0.smithi142.stdout:151: done (9 left) 2020-06-12T02:35:47.245 INFO:tasks.rados.rados.0.smithi142.stdout:152: done (8 left) 2020-06-12T02:35:47.245 INFO:tasks.rados.rados.0.smithi142.stdout:153: done (7 left) 2020-06-12T02:35:47.246 INFO:tasks.rados.rados.0.smithi142.stdout:154: done (6 left) 2020-06-12T02:35:47.246 INFO:tasks.rados.rados.0.smithi142.stdout:160: done (5 left) 2020-06-12T02:35:47.246 INFO:tasks.rados.rados.0.smithi142.stdout:161: copy_from oid 34 from oid 28 current snap is 12 2020-06-12T02:35:47.246 INFO:tasks.rados.rados.0.smithi142.stdout:155: finishing write tid 5 to smithi14213939-8 2020-06-12T02:35:47.246 INFO:tasks.rados.rados.0.smithi142.stdout:156: expect (ObjNum 40 snap 0 seq_num 40) 2020-06-12T02:35:47.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:47.311+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:47.328 INFO:tasks.rados.rados.0.smithi142.stdout:155: finishing write tid 6 to smithi14213939-8 2020-06-12T02:35:47.328 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 83 (ObjNum 84 snap 12 seq_num 84) dirty exists 2020-06-12T02:35:47.329 INFO:tasks.rados.rados.0.smithi142.stdout:155: left oid 8 (ObjNum 84 snap 12 seq_num 84) 2020-06-12T02:35:47.329 INFO:tasks.rados.rados.0.smithi142.stdout:157: finishing write tid 1 to smithi14213939-39 2020-06-12T02:35:47.330 INFO:tasks.rados.rados.0.smithi142.stdout:157: finishing write tid 2 to smithi14213939-39 2020-06-12T02:35:47.330 INFO:tasks.rados.rados.0.smithi142.stdout:157: finishing write tid 3 to smithi14213939-39 2020-06-12T02:35:47.331 INFO:tasks.rados.rados.0.smithi142.stdout:157: finishing write tid 5 to smithi14213939-39 2020-06-12T02:35:47.331 INFO:tasks.rados.rados.0.smithi142.stdout:155: done (5 left) 2020-06-12T02:35:47.331 INFO:tasks.rados.rados.0.smithi142.stdout:156: done (4 left) 2020-06-12T02:35:47.331 INFO:tasks.rados.rados.0.smithi142.stdout:162: snap_remove snap 7 2020-06-12T02:35:47.367 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.368 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.368 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:47.429 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:47.428+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:47.482 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.483 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.492 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:47.516 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:47.519+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:47.617 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:47.619+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:47.646 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.646 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.663 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:47.720 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:47.719+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:47.774 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.774 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.784 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:47.821 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:47.823+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:47.893 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:47.893 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:47.902 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:47.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:47.923+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:47.944 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:35:48.015 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:48.016 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:48.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:48.023+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:48.025 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:48.040+0000 7fb755366700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:48.056+0000 7fb74ffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:48.120 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:48.129 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:48.128+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:48.149 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:48.149 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:48.158 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:48.224 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:48.220+0000 7f831daf2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:48.228 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:48.224+0000 7f831daf2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:48.230 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:48.231+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:48.236 INFO:tasks.rados.rados.0.smithi142.stdout:162: done (4 left) 2020-06-12T02:35:48.237 INFO:tasks.rados.rados.0.smithi142.stdout:163: delete oid 44 current snap is 12 2020-06-12T02:35:48.240 INFO:tasks.rados.rados.0.smithi142.stdout:157: finishing write tid 6 to smithi14213939-39 2020-06-12T02:35:48.240 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 39 v 59 (ObjNum 85 snap 12 seq_num 85) dirty exists 2020-06-12T02:35:48.240 INFO:tasks.rados.rados.0.smithi142.stdout:157: left oid 39 (ObjNum 85 snap 12 seq_num 85) 2020-06-12T02:35:48.240 INFO:tasks.rados.rados.0.smithi142.stdout:159: expect (ObjNum 35 snap 0 seq_num 35) 2020-06-12T02:35:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:35:48.277 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:48.278 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:48.280 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:48.287 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:48.304 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:48.326 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:48.331 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:48.331+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:48.331 INFO:tasks.rados.rados.0.smithi142.stdout:158: finishing copy_from to smithi14213939-37 2020-06-12T02:35:48.332 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 37 v 18 (ObjNum 49 snap 0 seq_num 49) dirty exists 2020-06-12T02:35:48.332 INFO:tasks.rados.rados.0.smithi142.stdout:158: finishing copy_from racing read to smithi14213939-37 2020-06-12T02:35:48.332 INFO:tasks.rados.rados.0.smithi142.stdout:161: finishing copy_from to smithi14213939-34 2020-06-12T02:35:48.333 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 34 v 3 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:35:48.333 INFO:tasks.rados.rados.0.smithi142.stdout:161: finishing copy_from racing read to smithi14213939-34 2020-06-12T02:35:48.333 INFO:tasks.rados.rados.0.smithi142.stdout:157: done (4 left) 2020-06-12T02:35:48.333 INFO:tasks.rados.rados.0.smithi142.stdout:158: done (3 left) 2020-06-12T02:35:48.333 INFO:tasks.rados.rados.0.smithi142.stdout:159: done (2 left) 2020-06-12T02:35:48.334 INFO:tasks.rados.rados.0.smithi142.stdout:161: done (1 left) 2020-06-12T02:35:48.334 INFO:tasks.rados.rados.0.smithi142.stdout:163: done (0 left) 2020-06-12T02:35:48.334 INFO:tasks.rados.rados.0.smithi142.stdout:164: snap_create 2020-06-12T02:35:48.343 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:48.432 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:48.431+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:48.437 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:48.437 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:48.446 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:48.540 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:48.539+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:48.573 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:48.603 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:48.604 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:48.604 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:48.604 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:48.604 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:48.614 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:48.627 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:48.633 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:48.635+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:48.648 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:48.734 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:48.735+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:48.764 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:48.764 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:48.764 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:48.764 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:48.765 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:48.774 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:48.835 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:48.835+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 23/18 ECSubWrite(tid=8, reqid=client.4555.0:215, at_version=23'7, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.750581257, 2020-06-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002, 2020-06-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131940+0000", 2020-06-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4559000000000001e-05 2020-06-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132024+0000", 2020-06-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5899999999999999e-05 2020-06-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132050+0000", 2020-06-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2875999999999999e-05 2020-06-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132073+0000", 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2930000000000006e-06 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132082+0000", 2020-06-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054950300000000001 2020-06-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132632+0000", 2020-06-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6909999999999999e-05 2020-06-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132649+0000", 2020-06-12T02:35:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046183320000000002 2020-06-12T02:35:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137267+0000", 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6516000000000001e-05 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137303+0000", 2020-06-12T02:35:48.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053638890000000002 2020-06-12T02:35:48.897 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.897 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.897 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.898 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:48.898 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:48.898 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.736781058999998, 2020-06-12T02:35:48.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:48.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:35:48.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:35:48.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:35:48.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:35:48.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:35:48.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:35:48.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:35:48.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:35:48.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:35:48.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:35:48.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:35:48.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:35:48.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:35:48.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:35:48.910 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.910 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.910 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.912 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=135, reqid=client.4555.0:313, at_version=29'16, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:48.912 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:48.912 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.60045641, 2020-06-12T02:35:48.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996, 2020-06-12T02:35:48.913 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.913 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.913 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:48.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282064+0000", 2020-06-12T02:35:48.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00068568199999999996 2020-06-12T02:35:48.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282750+0000", 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9499000000000001e-05 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282810+0000", 2020-06-12T02:35:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9295e-05 2020-06-12T02:35:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282839+0000", 2020-06-12T02:35:48.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:35:48.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282850+0000", 2020-06-12T02:35:48.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4931999999999994e-05 2020-06-12T02:35:48.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282915+0000", 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3213999999999999e-05 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.282928+0000", 2020-06-12T02:35:48.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043331150000000002 2020-06-12T02:35:48.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287261+0000", 2020-06-12T02:35:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3059999999999994e-05 2020-06-12T02:35:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287344+0000", 2020-06-12T02:35:48.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052800269999999996 2020-06-12T02:35:48.926 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.926 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.926 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.927 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:35:48.927 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:48.927 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.590267548, 2020-06-12T02:35:48.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:35:48.928 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.928 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.928 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:48.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:35:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:35:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:35:48.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:35:48.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:35:48.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:35:48.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:35:48.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:35:48.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:35:48.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:35:48.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:35:48.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:35:48.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:35:48.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:35:48.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:35:48.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:35:48.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.939 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.940 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=138, reqid=client.4555.0:314, at_version=29'17, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:35:48.940 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:48.940 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.584282932000001, 2020-06-12T02:35:48.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512, 2020-06-12T02:35:48.941 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.941 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.941 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:35:48.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050880100000000002 2020-06-12T02:35:48.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298747+0000", 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7461999999999999e-05 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298774+0000", 2020-06-12T02:35:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3760999999999999e-05 2020-06-12T02:35:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298788+0000", 2020-06-12T02:35:48.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9280000000000004e-06 2020-06-12T02:35:48.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298795+0000", 2020-06-12T02:35:48.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0432999999999994e-05 2020-06-12T02:35:48.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298875+0000", 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2087e-05 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298897+0000", 2020-06-12T02:35:48.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069111329999999999 2020-06-12T02:35:48.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305809+0000", 2020-06-12T02:35:48.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3906999999999996e-05 2020-06-12T02:35:48.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305882+0000", 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.957 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=141, reqid=client.4555.0:315, at_version=29'18, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:48.957 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:48.957 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.583030061000001, 2020-06-12T02:35:48.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003, 2020-06-12T02:35:48.958 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.958 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.958 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.299491+0000", 2020-06-12T02:35:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092376299999999997 2020-06-12T02:35:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300415+0000", 2020-06-12T02:35:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0585999999999999e-05 2020-06-12T02:35:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300435+0000", 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2507000000000001e-05 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300448+0000", 2020-06-12T02:35:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3489999999999997e-06 2020-06-12T02:35:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300454+0000", 2020-06-12T02:35:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4029000000000001e-05 2020-06-12T02:35:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300508+0000", 2020-06-12T02:35:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4767000000000001e-05 2020-06-12T02:35:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.300543+0000", 2020-06-12T02:35:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053731100000000004 2020-06-12T02:35:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305916+0000", 2020-06-12T02:35:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3744999999999994e-05 2020-06-12T02:35:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305980+0000", 2020-06-12T02:35:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064888560000000003 2020-06-12T02:35:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=142, reqid=client.4555.0:316, at_version=29'19, trim_to=0'0, roll_forward_to=29'16))", 2020-06-12T02:35:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.580899923, 2020-06-12T02:35:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998, 2020-06-12T02:35:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301621+0000", 2020-06-12T02:35:48.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.168e-05 2020-06-12T02:35:48.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301673+0000", 2020-06-12T02:35:48.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8664e-05 2020-06-12T02:35:48.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301691+0000", 2020-06-12T02:35:48.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9213000000000001e-05 2020-06-12T02:35:48.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301710+0000", 2020-06-12T02:35:48.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3760000000000008e-06 2020-06-12T02:35:48.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.301719+0000", 2020-06-12T02:35:48.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042316700000000001 2020-06-12T02:35:48.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302142+0000", 2020-06-12T02:35:48.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5987999999999999e-05 2020-06-12T02:35:48.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302168+0000", 2020-06-12T02:35:48.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0038407580000000001 2020-06-12T02:35:48.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306009+0000", 2020-06-12T02:35:48.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1911999999999999e-05 2020-06-12T02:35:48.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.306071+0000", 2020-06-12T02:35:48.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044497579999999998 2020-06-12T02:35:48.984 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.984 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.984 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.985 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=146, reqid=client.4555.0:316, at_version=0'0, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:48.985 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:48.985 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.574850102999999, 2020-06-12T02:35:48.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718, 2020-06-12T02:35:48.986 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:48.986 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:48.987 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:48.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:48.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:48.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:48.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:48.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307671+0000", 2020-06-12T02:35:48.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9865e-05 2020-06-12T02:35:48.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:48.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307701+0000", 2020-06-12T02:35:48.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0020000000000001e-05 2020-06-12T02:35:48.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:48.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307711+0000", 2020-06-12T02:35:48.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1705999999999999e-05 2020-06-12T02:35:48.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:48.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307722+0000", 2020-06-12T02:35:48.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:35:48.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:48.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307727+0000", 2020-06-12T02:35:48.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3153999999999999e-05 2020-06-12T02:35:48.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:48.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307790+0000", 2020-06-12T02:35:48.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2943e-05 2020-06-12T02:35:48.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:48.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.307803+0000", 2020-06-12T02:35:48.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036252849999999998 2020-06-12T02:35:48.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:48.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311429+0000", 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0825999999999998e-05 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.311469+0000", 2020-06-12T02:35:48.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003798718 2020-06-12T02:35:48.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.999 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:48.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:48.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:48.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.000 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=151, reqid=osd.1.0:151, at_version=33'15, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:49.000 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:49.000 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9543315480000008, 2020-06-12T02:35:49.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001, 2020-06-12T02:35:49.000 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.001 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.001 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928189+0000", 2020-06-12T02:35:49.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8978000000000003e-05 2020-06-12T02:35:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928258+0000", 2020-06-12T02:35:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6777000000000001e-05 2020-06-12T02:35:49.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928285+0000", 2020-06-12T02:35:49.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:35:49.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928303+0000", 2020-06-12T02:35:49.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0790000000000007e-06 2020-06-12T02:35:49.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928312+0000", 2020-06-12T02:35:49.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00047842700000000002 2020-06-12T02:35:49.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928790+0000", 2020-06-12T02:35:49.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4056000000000001e-05 2020-06-12T02:35:49.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928804+0000", 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003089488 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931894+0000", 2020-06-12T02:35:49.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7665999999999999e-05 2020-06-12T02:35:49.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.931962+0000", 2020-06-12T02:35:49.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037722720000000001 2020-06-12T02:35:49.012 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.012 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.013 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=152, reqid=osd.1.0:152, at_version=33'17, trim_to=0'0, roll_forward_to=29'13))", 2020-06-12T02:35:49.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:49.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9541422449999999, 2020-06-12T02:35:49.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996, 2020-06-12T02:35:49.014 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.014 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.015 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:49.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928379+0000", 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0865999999999995e-05 2020-06-12T02:35:49.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928449+0000", 2020-06-12T02:35:49.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4501000000000001e-05 2020-06-12T02:35:49.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928474+0000", 2020-06-12T02:35:49.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6772000000000001e-05 2020-06-12T02:35:49.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928491+0000", 2020-06-12T02:35:49.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1799999999999999e-06 2020-06-12T02:35:49.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.928498+0000", 2020-06-12T02:35:49.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072590399999999998 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929224+0000", 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3964e-05 2020-06-12T02:35:49.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.929238+0000", 2020-06-12T02:35:49.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051932339999999997 2020-06-12T02:35:49.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934431+0000", 2020-06-12T02:35:49.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7349999999999995e-05 2020-06-12T02:35:49.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.934518+0000", 2020-06-12T02:35:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061397709999999996 2020-06-12T02:35:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.026 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=153, reqid=osd.1.0:153, at_version=33'21, trim_to=0'0, roll_forward_to=29'19))", 2020-06-12T02:35:49.026 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:49.026 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9501630920000004, 2020-06-12T02:35:49.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211, 2020-06-12T02:35:49.027 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.027 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.027 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932358+0000", 2020-06-12T02:35:49.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8218000000000002e-05 2020-06-12T02:35:49.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932436+0000", 2020-06-12T02:35:49.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0248999999999999e-05 2020-06-12T02:35:49.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932456+0000", 2020-06-12T02:35:49.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4163e-05 2020-06-12T02:35:49.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932470+0000", 2020-06-12T02:35:49.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7780000000000004e-06 2020-06-12T02:35:49.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932476+0000", 2020-06-12T02:35:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1088999999999997e-05 2020-06-12T02:35:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932537+0000", 2020-06-12T02:35:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6789000000000001e-05 2020-06-12T02:35:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.932554+0000", 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046876670000000004 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937242+0000", 2020-06-12T02:35:49.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0258000000000004e-05 2020-06-12T02:35:49.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937312+0000", 2020-06-12T02:35:49.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004954211 2020-06-12T02:35:49.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 33/18 ECSubWrite(tid=154, reqid=osd.1.0:152, at_version=0'0, trim_to=0'0, roll_forward_to=33'17))", 2020-06-12T02:35:49.039 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:49.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.944548824, 2020-06-12T02:35:49.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998, 2020-06-12T02:35:49.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:49.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.937972+0000", 2020-06-12T02:35:49.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010771400000000001 2020-06-12T02:35:49.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938080+0000", 2020-06-12T02:35:49.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7977000000000001e-05 2020-06-12T02:35:49.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938098+0000", 2020-06-12T02:35:49.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5340000000000001e-05 2020-06-12T02:35:49.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938123+0000", 2020-06-12T02:35:49.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2699999999999993e-06 2020-06-12T02:35:49.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938132+0000", 2020-06-12T02:35:49.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-05 2020-06-12T02:35:49.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938198+0000", 2020-06-12T02:35:49.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3832000000000002e-05 2020-06-12T02:35:49.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.938222+0000", 2020-06-12T02:35:49.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043491199999999997 2020-06-12T02:35:49.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942571+0000", 2020-06-12T02:35:49.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4549000000000002e-05 2020-06-12T02:35:49.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942625+0000", 2020-06-12T02:35:49.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046534419999999998 2020-06-12T02:35:49.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.054 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.055 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 33/18 ECSubWrite(tid=156, reqid=osd.1.0:153, at_version=0'0, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:49.055 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:49.055 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.940392245, 2020-06-12T02:35:49.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001, 2020-06-12T02:35:49.055 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.056 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.056 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:49.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942129+0000", 2020-06-12T02:35:49.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3413999999999998e-05 2020-06-12T02:35:49.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942212+0000", 2020-06-12T02:35:49.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6614999999999999e-05 2020-06-12T02:35:49.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942229+0000", 2020-06-12T02:35:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0424e-05 2020-06-12T02:35:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942249+0000", 2020-06-12T02:35:49.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4300000000000006e-06 2020-06-12T02:35:49.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942257+0000", 2020-06-12T02:35:49.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064044099999999995 2020-06-12T02:35:49.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942898+0000", 2020-06-12T02:35:49.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5028000000000001e-05 2020-06-12T02:35:49.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.942913+0000", 2020-06-12T02:35:49.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00476955 2020-06-12T02:35:49.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947682+0000", 2020-06-12T02:35:49.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6485999999999999e-05 2020-06-12T02:35:49.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.947759+0000", 2020-06-12T02:35:49.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0056303880000000001 2020-06-12T02:35:49.066 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.066 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.066 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.067 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 33/18 ECSubWrite(tid=16, reqid=osd.6.0:16, at_version=33'15, trim_to=0'0, roll_forward_to=32'13))", 2020-06-12T02:35:49.067 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:49.067 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.9370331200000006, 2020-06-12T02:35:49.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998, 2020-06-12T02:35:49.068 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.068 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.068 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:49.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945488+0000", 2020-06-12T02:35:49.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0977999999999995e-05 2020-06-12T02:35:49.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945579+0000", 2020-06-12T02:35:49.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0941000000000002e-05 2020-06-12T02:35:49.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945600+0000", 2020-06-12T02:35:49.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2208999999999999e-05 2020-06-12T02:35:49.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945612+0000", 2020-06-12T02:35:49.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1380000000000004e-06 2020-06-12T02:35:49.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945618+0000", 2020-06-12T02:35:49.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036558199999999998 2020-06-12T02:35:49.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.945984+0000", 2020-06-12T02:35:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1464e-05 2020-06-12T02:35:49.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.946005+0000", 2020-06-12T02:35:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044700829999999997 2020-06-12T02:35:49.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950475+0000", 2020-06-12T02:35:49.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3517000000000003e-05 2020-06-12T02:35:49.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.950529+0000", 2020-06-12T02:35:49.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050409119999999998 2020-06-12T02:35:49.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.079 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.079 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.079 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 34/18 ECSubWrite(tid=166, reqid=osd.1.0:162, at_version=0'0, trim_to=0'0, roll_forward_to=34'21))", 2020-06-12T02:35:49.080 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:49.080 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.9348230129999999, 2020-06-12T02:35:49.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042519020000000001, 2020-06-12T02:35:49.082 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.082 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:49.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947698+0000", 2020-06-12T02:35:49.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4316999999999997e-05 2020-06-12T02:35:49.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947732+0000", 2020-06-12T02:35:49.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0226e-05 2020-06-12T02:35:49.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947742+0000", 2020-06-12T02:35:49.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2429000000000001e-05 2020-06-12T02:35:49.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947755+0000", 2020-06-12T02:35:49.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0480000000000004e-06 2020-06-12T02:35:49.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947764+0000", 2020-06-12T02:35:49.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8236999999999998e-05 2020-06-12T02:35:49.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947822+0000", 2020-06-12T02:35:49.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5532e-05 2020-06-12T02:35:49.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.947838+0000", 2020-06-12T02:35:49.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0040593030000000002 2020-06-12T02:35:49.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.951897+0000", 2020-06-12T02:35:49.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2809999999999998e-05 2020-06-12T02:35:49.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.951950+0000", 2020-06-12T02:35:49.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042519020000000001 2020-06-12T02:35:49.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.100 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.101 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 34/18 ECSubWrite(tid=19, reqid=osd.6.0:18, at_version=0'0, trim_to=0'0, roll_forward_to=34'17))", 2020-06-12T02:35:49.102 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:49.102 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.932030707, 2020-06-12T02:35:49.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0055220870000000002, 2020-06-12T02:35:49.103 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.103 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.103 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:49.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950490+0000", 2020-06-12T02:35:49.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8536999999999999e-05 2020-06-12T02:35:49.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950549+0000", 2020-06-12T02:35:49.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5608999999999999e-05 2020-06-12T02:35:49.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950564+0000", 2020-06-12T02:35:49.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7113999999999999e-05 2020-06-12T02:35:49.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950581+0000", 2020-06-12T02:35:49.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.52e-06 2020-06-12T02:35:49.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950589+0000", 2020-06-12T02:35:49.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121382 2020-06-12T02:35:49.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950710+0000", 2020-06-12T02:35:49.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2680000000000001e-05 2020-06-12T02:35:49.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.950723+0000", 2020-06-12T02:35:49.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052350230000000001 2020-06-12T02:35:49.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.955958+0000", 2020-06-12T02:35:49.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4221999999999997e-05 2020-06-12T02:35:49.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.956012+0000", 2020-06-12T02:35:49.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0055220870000000002 2020-06-12T02:35:49.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.117 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.120 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 34/18 ECSubWrite(tid=168, reqid=osd.1.0:168, at_version=34'23, trim_to=0'0, roll_forward_to=33'21))", 2020-06-12T02:35:49.120 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.9298289989999997, 2020-06-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051454129999999997, 2020-06-12T02:35:49.122 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.122 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.122 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:49.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952692+0000", 2020-06-12T02:35:49.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2197999999999999e-05 2020-06-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952724+0000", 2020-06-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7708000000000001e-05 2020-06-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952742+0000", 2020-06-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9650000000000003e-06 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952752+0000", 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2170000000000002e-06 2020-06-12T02:35:49.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952757+0000", 2020-06-12T02:35:49.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1983e-05 2020-06-12T02:35:49.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952809+0000", 2020-06-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6311999999999999e-05 2020-06-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.952865+0000", 2020-06-12T02:35:49.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049115139999999996 2020-06-12T02:35:49.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957777+0000", 2020-06-12T02:35:49.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0516000000000001e-05 2020-06-12T02:35:49.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.957837+0000", 2020-06-12T02:35:49.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051454129999999997 2020-06-12T02:35:49.133 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 34/18 ECSubWrite(tid=56, reqid=osd.3.0:56, at_version=34'11, trim_to=0'0, roll_forward_to=26'9))", 2020-06-12T02:35:49.134 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 7.9280275219999998, 2020-06-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064453660000000001, 2020-06-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954493+0000", 2020-06-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2889000000000001e-05 2020-06-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954546+0000", 2020-06-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4028000000000001e-05 2020-06-12T02:35:49.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954570+0000", 2020-06-12T02:35:49.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5843999999999999e-05 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954586+0000", 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7949999999999996e-06 2020-06-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954595+0000", 2020-06-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121771 2020-06-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954717+0000", 2020-06-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2055000000000001e-05 2020-06-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.954729+0000", 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061701849999999999 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.960899+0000", 2020-06-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9799000000000003e-05 2020-06-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.960939+0000", 2020-06-12T02:35:49.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064453660000000001 2020-06-12T02:35:49.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.145 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 38/18 ECSubWrite(tid=20, reqid=osd.6.0:20, at_version=38'19, trim_to=0'0, roll_forward_to=34'17))", 2020-06-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937662+0000", 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.9448591099999999, 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057893729999999996, 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937662+0000", 2020-06-12T02:35:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937662+0000", 2020-06-12T02:35:49.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9163000000000001e-05 2020-06-12T02:35:49.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937741+0000", 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2617000000000003e-05 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937774+0000", 2020-06-12T02:35:49.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0499000000000001e-05 2020-06-12T02:35:49.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937794+0000", 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0559999999999994e-06 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937803+0000", 2020-06-12T02:35:49.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000163821 2020-06-12T02:35:49.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937967+0000", 2020-06-12T02:35:49.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5797000000000001e-05 2020-06-12T02:35:49.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937983+0000", 2020-06-12T02:35:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053926950000000003 2020-06-12T02:35:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943375+0000", 2020-06-12T02:35:49.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5724999999999997e-05 2020-06-12T02:35:49.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943451+0000", 2020-06-12T02:35:49.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057893729999999996 2020-06-12T02:35:49.160 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.161 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.161 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.161 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.cs1 38/18 ECSubWrite(tid=21, reqid=osd.6.0:20, at_version=0'0, trim_to=0'0, roll_forward_to=38'19))", 2020-06-12T02:35:49.162 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.945428+0000", 2020-06-12T02:35:49.162 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.9370928279999999, 2020-06-12T02:35:49.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037060489999999999, 2020-06-12T02:35:49.163 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.163 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.163 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945428+0000", 2020-06-12T02:35:49.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945428+0000", 2020-06-12T02:35:49.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3393999999999996e-05 2020-06-12T02:35:49.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945491+0000", 2020-06-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7853999999999999e-05 2020-06-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945509+0000", 2020-06-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8753000000000002e-05 2020-06-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945528+0000", 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8370000000000003e-06 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945537+0000", 2020-06-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4013999999999999e-05 2020-06-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945621+0000", 2020-06-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5104e-05 2020-06-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945636+0000", 2020-06-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034354849999999998 2020-06-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949071+0000", 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2607999999999994e-05 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949134+0000", 2020-06-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037060489999999999 2020-06-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:49.176 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:49.175+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:49.250 INFO:tasks.rados.rados.0.smithi142.stdout:164: done (0 left) 2020-06-12T02:35:49.250 INFO:tasks.rados.rados.0.smithi142.stdout:165: read oid 40 snap -1 2020-06-12T02:35:49.250 INFO:tasks.rados.rados.0.smithi142.stdout:165: expect (ObjNum 23 snap 0 seq_num 23) 2020-06-12T02:35:49.251 INFO:tasks.rados.rados.0.smithi142.stdout:166: write (excl) oid 17 current snap is 13 2020-06-12T02:35:49.251 INFO:tasks.rados.rados.0.smithi142.stdout:166: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2020-06-12T02:35:49.259 INFO:tasks.rados.rados.0.smithi142.stdout:166: writing smithi14213939-17 from 679016 to 1380811 tid 1 2020-06-12T02:35:49.264 INFO:tasks.rados.rados.0.smithi142.stdout:166: writing smithi14213939-17 from 1866533 to 2362557 tid 2 2020-06-12T02:35:49.269 INFO:tasks.rados.rados.0.smithi142.stdout:166: writing smithi14213939-17 from 2900635 to 3303278 tid 3 2020-06-12T02:35:49.270 INFO:tasks.rados.rados.0.smithi142.stdout:167: snap_remove snap 11 2020-06-12T02:35:49.279 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:49.279+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:49.334 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:49.335 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:49.335 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:49.342 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:49.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:49.387+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:49.482 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:49.483+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:49.503 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:49.503 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:49.504 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:49.504 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:49.508 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:49.514 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:49.514 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 0 1 2020-06-12T02:35:49.593 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:49.595+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:49.634 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:49.623+0000 7fd3d272e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:49.639 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:49.639+0000 7fd3d14cc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:49.659 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.660 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.538802371999999, 2020-06-12T02:35:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:35:49.661 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:49.662 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:49.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:35:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:35:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:35:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:35:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:35:49.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:35:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:35:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:35:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:35:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:35:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:35:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:49.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:35:49.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:35:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:35:49.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:35:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:35:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:35:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:35:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:35:49.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:35:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:49.685 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.538663436, 2020-06-12T02:35:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:35:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:49.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.688 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:35:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:35:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:35:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:35:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:35:49.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:35:49.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:35:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:35:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:35:49.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:35:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:35:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:35:49.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:49.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:35:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:35:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:35:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:35:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:35:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:35:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:35:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:35:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:35:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:35:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.727 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:49.728 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.538527598000002, 2020-06-12T02:35:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:35:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:49.729 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:35:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.730 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:49.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:35:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:35:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:35:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:35:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:35:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:35:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:35:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:35:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:35:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:35:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:35:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:35:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:35:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:35:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:35:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:35:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:35:49.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:35:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:35:49.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.514862749999999, 2020-06-12T02:35:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:35:49.747 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:35:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:35:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:35:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:35:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:35:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:35:49.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:35:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:35:49.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 28/18 ECSubWrite(tid=87, reqid=client.4555.0:287, at_version=28'25, trim_to=0'0, roll_forward_to=26'23))", 2020-06-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.478113962, 2020-06-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905, 2020-06-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:49.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:49.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028867860000000001 2020-06-12T02:35:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185516+0000", 2020-06-12T02:35:49.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1566000000000002e-05 2020-06-12T02:35:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185548+0000", 2020-06-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8912000000000001e-05 2020-06-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185566+0000", 2020-06-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2199999999999992e-06 2020-06-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185575+0000", 2020-06-12T02:35:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1684e-05 2020-06-12T02:35:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185646+0000", 2020-06-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6929999999999999e-05 2020-06-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185663+0000", 2020-06-12T02:35:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046390820000000001 2020-06-12T02:35:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190302+0000", 2020-06-12T02:35:49.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9725000000000002e-05 2020-06-12T02:35:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190362+0000", 2020-06-12T02:35:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905 2020-06-12T02:35:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 29/18 ECSubWrite(tid=48, reqid=client.4555.0:300, at_version=29'20, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 13.474134977, 2020-06-12T02:35:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998, 2020-06-12T02:35:49.778 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021036700000000002 2020-06-12T02:35:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188712+0000", 2020-06-12T02:35:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1732e-05 2020-06-12T02:35:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188744+0000", 2020-06-12T02:35:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7884999999999999e-05 2020-06-12T02:35:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188761+0000", 2020-06-12T02:35:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5829999999999996e-06 2020-06-12T02:35:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188771+0000", 2020-06-12T02:35:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2814999999999999e-05 2020-06-12T02:35:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188854+0000", 2020-06-12T02:35:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9015999999999999e-05 2020-06-12T02:35:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188873+0000", 2020-06-12T02:35:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048068499999999997 2020-06-12T02:35:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193680+0000", 2020-06-12T02:35:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6352000000000002e-05 2020-06-12T02:35:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193776+0000", 2020-06-12T02:35:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998 2020-06-12T02:35:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.789 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 29/18 ECSubWrite(tid=137, reqid=client.4555.0:303, at_version=29'24, trim_to=0'0, roll_forward_to=26'22))", 2020-06-12T02:35:49.790 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 13.374769294, 2020-06-12T02:35:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321, 2020-06-12T02:35:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.791 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014014069999999999 2020-06-12T02:35:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287375+0000", 2020-06-12T02:35:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5082000000000001e-05 2020-06-12T02:35:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287410+0000", 2020-06-12T02:35:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6569999999999999e-05 2020-06-12T02:35:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287427+0000", 2020-06-12T02:35:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3130000000000004e-06 2020-06-12T02:35:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287436+0000", 2020-06-12T02:35:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2125000000000005e-05 2020-06-12T02:35:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287508+0000", 2020-06-12T02:35:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3589e-05 2020-06-12T02:35:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287522+0000", 2020-06-12T02:35:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045636469999999997 2020-06-12T02:35:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292086+0000", 2020-06-12T02:35:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108588 2020-06-12T02:35:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292194+0000", 2020-06-12T02:35:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321 2020-06-12T02:35:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.802 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:35:49.803 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.467418840000001, 2020-06-12T02:35:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:35:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:49.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:35:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.805 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:35:49.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:35:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:35:49.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:35:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:35:49.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:35:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:35:49.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:35:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:35:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:35:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:35:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:35:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:35:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:35:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:35:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:35:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:35:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:35:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:35:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:35:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:35:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.820 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.bs1 34/18 ECSubWrite(tid=102, reqid=osd.4.0:100, at_version=0'0, trim_to=0'0, roll_forward_to=34'31))", 2020-06-12T02:35:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:49.821 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6991573039999999, 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003, 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2791000000000002e-05 2020-06-12T02:35:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961659+0000", 2020-06-12T02:35:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:35:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961675+0000", 2020-06-12T02:35:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.825e-05 2020-06-12T02:35:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961693+0000", 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9419999999999998e-06 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961700+0000", 2020-06-12T02:35:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7218e-05 2020-06-12T02:35:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961757+0000", 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1976e-05 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961769+0000", 2020-06-12T02:35:49.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059766539999999996 2020-06-12T02:35:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967746+0000", 2020-06-12T02:35:49.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3628000000000003e-05 2020-06-12T02:35:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967790+0000", 2020-06-12T02:35:49.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.832 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 34/18 ECSubWrite(tid=59, reqid=osd.3.0:58, at_version=0'0, trim_to=0'0, roll_forward_to=34'26))", 2020-06-12T02:35:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6982693429999998, 2020-06-12T02:35:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004, 2020-06-12T02:35:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.833 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:49.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1511000000000001e-05 2020-06-12T02:35:49.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962535+0000", 2020-06-12T02:35:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8549999999999997e-06 2020-06-12T02:35:49.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962545+0000", 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.042e-05 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962556+0000", 2020-06-12T02:35:49.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1889999999999998e-06 2020-06-12T02:35:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962561+0000", 2020-06-12T02:35:49.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9722999999999998e-05 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962611+0000", 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1527e-05 2020-06-12T02:35:49.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962622+0000", 2020-06-12T02:35:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052122080000000003 2020-06-12T02:35:49.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967834+0000", 2020-06-12T02:35:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.702e-05 2020-06-12T02:35:49.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967881+0000", 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.843 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=109, reqid=osd.2.0:109, at_version=34'35, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:35:49.844 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6971475120000008, 2020-06-12T02:35:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002, 2020-06-12T02:35:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.845 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2299999999999996e-05 2020-06-12T02:35:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963658+0000", 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4314000000000001e-05 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963682+0000", 2020-06-12T02:35:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5594e-05 2020-06-12T02:35:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963698+0000", 2020-06-12T02:35:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1109999999999996e-06 2020-06-12T02:35:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963704+0000", 2020-06-12T02:35:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00087375300000000001 2020-06-12T02:35:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964578+0000", 2020-06-12T02:35:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5530000000000004e-06 2020-06-12T02:35:49.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964585+0000", 2020-06-12T02:35:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005270889 2020-06-12T02:35:49.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969856+0000", 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7800000000000002e-05 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969914+0000", 2020-06-12T02:35:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002 2020-06-12T02:35:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.856 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.857 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=110, reqid=osd.2.0:109, at_version=0'0, trim_to=0'0, roll_forward_to=34'35))", 2020-06-12T02:35:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6842406600000004, 2020-06-12T02:35:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378, 2020-06-12T02:35:49.858 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2021000000000003e-05 2020-06-12T02:35:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976545+0000", 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9760000000000007e-06 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976554+0000", 2020-06-12T02:35:49.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2782999999999999e-05 2020-06-12T02:35:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976567+0000", 2020-06-12T02:35:49.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3529999999999995e-06 2020-06-12T02:35:49.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976576+0000", 2020-06-12T02:35:49.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0129000000000002e-05 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976616+0000", 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1949999999999997e-06 2020-06-12T02:35:49.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976623+0000", 2020-06-12T02:35:49.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007247369 2020-06-12T02:35:49.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983870+0000", 2020-06-12T02:35:49.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2552000000000001e-05 2020-06-12T02:35:49.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983923+0000", 2020-06-12T02:35:49.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378 2020-06-12T02:35:49.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.869 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.870 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 36/18 ECSubWrite(tid=141, reqid=client.4555.0:407, at_version=36'43, trim_to=0'0, roll_forward_to=36'41))", 2020-06-12T02:35:49.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:49.870 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.7588696099999996, 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051632759999999996, 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:49.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.901874+0000", 2020-06-12T02:35:49.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00071228700000000003 2020-06-12T02:35:49.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902586+0000", 2020-06-12T02:35:49.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5059999999999999e-05 2020-06-12T02:35:49.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902631+0000", 2020-06-12T02:35:49.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2817000000000001e-05 2020-06-12T02:35:49.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902664+0000", 2020-06-12T02:35:49.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1967000000000001e-05 2020-06-12T02:35:49.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902676+0000", 2020-06-12T02:35:49.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014670300000000001 2020-06-12T02:35:49.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902822+0000", 2020-06-12T02:35:49.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4173e-05 2020-06-12T02:35:49.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.902857+0000", 2020-06-12T02:35:49.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004080139 2020-06-12T02:35:49.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.906937+0000", 2020-06-12T02:35:49.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010013000000000001 2020-06-12T02:35:49.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:43.907037+0000", 2020-06-12T02:35:49.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051632759999999996 2020-06-12T02:35:49.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.882 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.883 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=229, reqid=osd.1.0:228, at_version=0'0, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:49.883 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:49.883 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7243283649999999, 2020-06-12T02:35:49.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995, 2020-06-12T02:35:49.883 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:49.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:49.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2689999999999996e-05 2020-06-12T02:35:49.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936497+0000", 2020-06-12T02:35:49.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1767000000000003e-05 2020-06-12T02:35:49.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936529+0000", 2020-06-12T02:35:49.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3943000000000001e-05 2020-06-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936553+0000", 2020-06-12T02:35:49.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6479999999999992e-06 2020-06-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936562+0000", 2020-06-12T02:35:49.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6100000000000002e-05 2020-06-12T02:35:49.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936618+0000", 2020-06-12T02:35:49.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.361e-05 2020-06-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936632+0000", 2020-06-12T02:35:49.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008610843 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945242+0000", 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5210999999999995e-05 2020-06-12T02:35:49.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945318+0000", 2020-06-12T02:35:49.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995 2020-06-12T02:35:49.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.894 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7236817970000002, 2020-06-12T02:35:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:35:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:49.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:35:49.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:35:49.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:35:49.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:35:49.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:35:49.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:35:49.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:35:49.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:35:49.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:35:49.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:35:49.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:35:49.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:35:49.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:35:49.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.907 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:49.907 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:49.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7227084269999997, 2020-06-12T02:35:49.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:35:49.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.908 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.908 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:49.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:49.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:35:49.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:35:49.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:35:49.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:35:49.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:35:49.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:35:49.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:35:49.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:35:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:35:49.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:35:49.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:35:49.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:35:49.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:35:49.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:35:49.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:35:49.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.919 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:49.920 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7214993070000002, 2020-06-12T02:35:49.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:35:49.921 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.921 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.921 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:49.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:49.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:35:49.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:35:49.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:35:49.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:35:49.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:35:49.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:35:49.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:35:49.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:35:49.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:35:49.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:35:49.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:35:49.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:35:49.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:35:49.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:35:49.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:35:49.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:35:49.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.934 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=162, reqid=osd.2.0:162, at_version=38'49, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:49.935 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:49.935 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.720379286, 2020-06-12T02:35:49.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997, 2020-06-12T02:35:49.935 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.935 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.936 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:49.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:49.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8365000000000001e-05 2020-06-12T02:35:49.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940422+0000", 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9471e-05 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940442+0000", 2020-06-12T02:35:49.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4909000000000001e-05 2020-06-12T02:35:49.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940457+0000", 2020-06-12T02:35:49.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-06 2020-06-12T02:35:49.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940463+0000", 2020-06-12T02:35:49.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6838000000000001e-05 2020-06-12T02:35:49.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940510+0000", 2020-06-12T02:35:49.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9485000000000001e-05 2020-06-12T02:35:49.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940530+0000", 2020-06-12T02:35:49.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068075849999999997 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947337+0000", 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2507000000000002e-05 2020-06-12T02:35:49.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947410+0000", 2020-06-12T02:35:49.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997 2020-06-12T02:35:49.948 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.948 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.949 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:49.949 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:49.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7202363219999999, 2020-06-12T02:35:49.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:35:49.950 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.950 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.950 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:49.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:35:49.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:35:49.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:49.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:35:49.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:35:49.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:35:49.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:35:49.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:35:49.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:35:49.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:35:49.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:35:49.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:35:49.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:35:49.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.963 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=164, reqid=client.4555.0:445, at_version=38'52, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:49.964 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7170896430000004, 2020-06-12T02:35:49.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937, 2020-06-12T02:35:49.965 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:49.965 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:49.965 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:49.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:49.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:49.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:49.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:49.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:49.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000665089 2020-06-12T02:35:49.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:49.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944319+0000", 2020-06-12T02:35:49.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2676999999999999e-05 2020-06-12T02:35:49.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:49.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944351+0000", 2020-06-12T02:35:49.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7135999999999999e-05 2020-06-12T02:35:49.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:49.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944378+0000", 2020-06-12T02:35:49.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:35:49.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:49.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944388+0000", 2020-06-12T02:35:49.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00091818399999999995 2020-06-12T02:35:49.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:49.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945306+0000", 2020-06-12T02:35:49.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8420000000000005e-06 2020-06-12T02:35:49.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:49.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945314+0000", 2020-06-12T02:35:49.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054267839999999996 2020-06-12T02:35:49.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:49.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950741+0000", 2020-06-12T02:35:49.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7828999999999999e-05 2020-06-12T02:35:49.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:49.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950788+0000", 2020-06-12T02:35:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937 2020-06-12T02:35:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:49.977 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:49.977 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:49.984 INFO:tasks.rados.rados.0.smithi142.stdout:167: done (2 left) 2020-06-12T02:35:49.985 INFO:tasks.rados.rados.0.smithi142.stdout:168: read oid 49 snap 5 2020-06-12T02:35:49.985 INFO:tasks.rados.rados.0.smithi142.stdout:168: expect deleted 2020-06-12T02:35:49.985 INFO:tasks.rados.rados.0.smithi142.stdout:169: write oid 9 current snap is 13 2020-06-12T02:35:49.985 INFO:tasks.rados.rados.0.smithi142.stdout:169: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2020-06-12T02:35:49.986 INFO:tasks.rados.rados.0.smithi142.stdout:169: writing smithi14213939-9 from 695823 to 1472867 tid 1 2020-06-12T02:35:49.986 INFO:tasks.rados.rados.0.smithi142.stdout:169: writing smithi14213939-9 from 1925015 to 2564697 tid 2 2020-06-12T02:35:49.986 INFO:tasks.rados.rados.0.smithi142.stdout:169: writing smithi14213939-9 from 3328058 to 3495823 tid 3 2020-06-12T02:35:49.986 INFO:tasks.rados.rados.0.smithi142.stdout:165: expect (ObjNum 23 snap 0 seq_num 23) 2020-06-12T02:35:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.0 to 1 (10000) 2020-06-12T02:35:49.987 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:49.983+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:49.987 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 1 1 2020-06-12T02:35:49.988 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:50.036 INFO:tasks.rados.rados.0.smithi142.stdout:166: finishing write tid 1 to smithi14213939-17 2020-06-12T02:35:50.036 INFO:tasks.rados.rados.0.smithi142.stdout:166: finishing write tid 2 to smithi14213939-17 2020-06-12T02:35:50.037 INFO:tasks.rados.rados.0.smithi142.stdout:165: done (3 left) 2020-06-12T02:35:50.037 INFO:tasks.rados.rados.0.smithi142.stdout:170: rollback oid 19 current snap is 13 2020-06-12T02:35:50.037 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 19 to 12 2020-06-12T02:35:50.037 INFO:tasks.rados.rados.0.smithi142.stdout:166: finishing write tid 3 to smithi14213939-17 2020-06-12T02:35:50.038 INFO:tasks.rados.rados.0.smithi142.stdout:166: finishing write tid 5 to smithi14213939-17 2020-06-12T02:35:50.038 INFO:tasks.rados.rados.0.smithi142.stdout:166: finishing write tid 6 to smithi14213939-17 2020-06-12T02:35:50.038 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 17 v 69 (ObjNum 88 snap 13 seq_num 88) dirty exists 2020-06-12T02:35:50.038 INFO:tasks.rados.rados.0.smithi142.stdout:166: left oid 17 (ObjNum 88 snap 13 seq_num 88) 2020-06-12T02:35:50.038 INFO:tasks.rados.rados.0.smithi142.stdout:169: finishing write tid 1 to smithi14213939-9 2020-06-12T02:35:50.039 INFO:tasks.rados.rados.0.smithi142.stdout:169: finishing write tid 2 to smithi14213939-9 2020-06-12T02:35:50.040 INFO:tasks.rados.rados.0.smithi142.stdout:169: finishing write tid 3 to smithi14213939-9 2020-06-12T02:35:50.040 INFO:tasks.rados.rados.0.smithi142.stdout:169: finishing write tid 5 to smithi14213939-9 2020-06-12T02:35:50.040 INFO:tasks.rados.rados.0.smithi142.stdout:169: finishing write tid 6 to smithi14213939-9 2020-06-12T02:35:50.040 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 9 v 98 (ObjNum 89 snap 13 seq_num 89) dirty exists 2020-06-12T02:35:50.040 INFO:tasks.rados.rados.0.smithi142.stdout:169: left oid 9 (ObjNum 89 snap 13 seq_num 89) 2020-06-12T02:35:50.041 INFO:tasks.rados.rados.0.smithi142.stdout:166: done (3 left) 2020-06-12T02:35:50.041 INFO:tasks.rados.rados.0.smithi142.stdout:168: done (2 left) 2020-06-12T02:35:50.041 INFO:tasks.rados.rados.0.smithi142.stdout:169: done (1 left) 2020-06-12T02:35:50.041 INFO:tasks.rados.rados.0.smithi142.stdout:171: read oid 43 snap -1 2020-06-12T02:35:50.041 INFO:tasks.rados.rados.0.smithi142.stdout:171: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:50.042 INFO:tasks.rados.rados.0.smithi142.stdout:172: read oid 36 snap -1 2020-06-12T02:35:50.042 INFO:tasks.rados.rados.0.smithi142.stdout:172: expect (ObjNum 35 snap 0 seq_num 35) 2020-06-12T02:35:50.042 INFO:tasks.rados.rados.0.smithi142.stdout:173: delete oid 7 current snap is 13 2020-06-12T02:35:50.053 INFO:tasks.rados.rados.0.smithi142.stdout:170: finishing rollback tid 0 to smithi14213939-19 2020-06-12T02:35:50.053 INFO:tasks.rados.rados.0.smithi142.stdout:170: finishing rollback tid 1 to smithi14213939-19 2020-06-12T02:35:50.054 INFO:tasks.rados.rados.0.smithi142.stdout:173: done (3 left) 2020-06-12T02:35:50.054 INFO:tasks.rados.rados.0.smithi142.stdout:174: snap_create 2020-06-12T02:35:50.054 INFO:tasks.rados.rados.0.smithi142.stdout:170: finishing rollback tid 2 to smithi14213939-19 2020-06-12T02:35:50.054 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 83 (ObjNum 82 snap 12 seq_num 82) dirty exists 2020-06-12T02:35:50.055 INFO:tasks.rados.rados.0.smithi142.stdout:172: expect (ObjNum 35 snap 0 seq_num 35) 2020-06-12T02:35:50.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:50.087+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:50.130 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.123+0000 7f4908a06700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.134 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.135+0000 7f490359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.137 INFO:tasks.rados.rados.0.smithi142.stdout:171: expect (ObjNum 56 snap 3 seq_num 56) 2020-06-12T02:35:50.138 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:50.138 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:50.138 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:50.138 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:50.148 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:50.193 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:50.195+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:50.260 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:35:50.286 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:50.287+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:50.302 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:50.310 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:50.310 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:50.311 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:50.311 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:50.312 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:50.360 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.355+0000 7f03a6eea700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.363 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.363+0000 7f03a5c88700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.401 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:50.403+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:50.469 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:50.469 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:50.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:50.469 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:50.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.470 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:203 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:50.470 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:50.470 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.371086531, 2020-06-12T02:35:50.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564, 2020-06-12T02:35:50.471 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.471 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.471 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.471 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.472 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.473 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 203 2020-06-12T02:35:50.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.474 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:50.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:50.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3640000000000006e-05 2020-06-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097693+0000", 2020-06-12T02:35:50.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5359999999999999e-05 2020-06-12T02:35:50.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:35:50.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6433999999999997e-05 2020-06-12T02:35:50.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097745+0000", 2020-06-12T02:35:50.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0820000000000001e-05 2020-06-12T02:35:50.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097766+0000", 2020-06-12T02:35:50.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012371999999999999 2020-06-12T02:35:50.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097890+0000", 2020-06-12T02:35:50.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097907+0000", 2020-06-12T02:35:50.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053765519999999997 2020-06-12T02:35:50.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103283+0000", 2020-06-12T02:35:50.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120228 2020-06-12T02:35:50.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103403+0000", 2020-06-12T02:35:50.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057519930000000004 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.109155+0000", 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564 2020-06-12T02:35:50.486 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.487 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.488 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.489 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:204 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:50.489 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:50.490 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.370814234000001, 2020-06-12T02:35:50.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001, 2020-06-12T02:35:50.490 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 204 2020-06-12T02:35:50.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.492 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:50.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:50.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1323999999999997e-05 2020-06-12T02:35:50.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097963+0000", 2020-06-12T02:35:50.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3753e-05 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097977+0000", 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4084000000000001e-05 2020-06-12T02:35:50.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098011+0000", 2020-06-12T02:35:50.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.436e-05 2020-06-12T02:35:50.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098026+0000", 2020-06-12T02:35:50.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2340000000000001e-05 2020-06-12T02:35:50.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098108+0000", 2020-06-12T02:35:50.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2573e-05 2020-06-12T02:35:50.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:50.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098120+0000", 2020-06-12T02:35:50.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057105419999999999 2020-06-12T02:35:50.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103831+0000", 2020-06-12T02:35:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2423000000000006e-05 2020-06-12T02:35:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103923+0000", 2020-06-12T02:35:50.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080684209999999992 2020-06-12T02:35:50.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111992+0000", 2020-06-12T02:35:50.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001 2020-06-12T02:35:50.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.505 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.506 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:205 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:50.506 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.370534436, 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999, 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.508 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.508 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 205 2020-06-12T02:35:50.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.508 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:50.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:50.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.36e-05 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098245+0000", 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1090000000000001e-05 2020-06-12T02:35:50.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098257+0000", 2020-06-12T02:35:50.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9026e-05 2020-06-12T02:35:50.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098276+0000", 2020-06-12T02:35:50.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8769999999999999e-06 2020-06-12T02:35:50.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098284+0000", 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011569300000000001 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098400+0000", 2020-06-12T02:35:50.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3874e-05 2020-06-12T02:35:50.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:50.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098414+0000", 2020-06-12T02:35:50.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086850239999999995 2020-06-12T02:35:50.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107099+0000", 2020-06-12T02:35:50.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9898e-05 2020-06-12T02:35:50.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107179+0000", 2020-06-12T02:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070512750000000001 2020-06-12T02:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.114230+0000", 2020-06-12T02:35:50.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999 2020-06-12T02:35:50.521 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.522 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.522 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.522 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s2 29/18 ECSubWrite(tid=48, reqid=client.4555.0:300, at_version=29'20, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:50.523 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:50.525 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.281959527, 2020-06-12T02:35:50.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0079975549999999999, 2020-06-12T02:35:50.526 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.527 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:50.528 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:50.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:50.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025483760000000002 2020-06-12T02:35:50.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189295+0000", 2020-06-12T02:35:50.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3050999999999999e-05 2020-06-12T02:35:50.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189328+0000", 2020-06-12T02:35:50.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2345e-05 2020-06-12T02:35:50.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189351+0000", 2020-06-12T02:35:50.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0743e-05 2020-06-12T02:35:50.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189361+0000", 2020-06-12T02:35:50.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0683e-05 2020-06-12T02:35:50.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189442+0000", 2020-06-12T02:35:50.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2305000000000001e-05 2020-06-12T02:35:50.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189464+0000", 2020-06-12T02:35:50.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005221486 2020-06-12T02:35:50.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.194686+0000", 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8566000000000001e-05 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.194744+0000", 2020-06-12T02:35:50.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0079975549999999999 2020-06-12T02:35:50.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.539 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.540 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:305 1.4s0 1:2207f711:::smithi14213939-36:head [append 0~0] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:50.540 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:50.540 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.203190596000001, 2020-06-12T02:35:50.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080482729999999999, 2020-06-12T02:35:50.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.541 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.541 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.542 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 305 2020-06-12T02:35:50.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.544 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:50.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:50.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6239999999999999e-05 2020-06-12T02:35:50.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265542+0000", 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8990000000000004e-06 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265549+0000", 2020-06-12T02:35:50.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1525999999999999e-05 2020-06-12T02:35:50.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265560+0000", 2020-06-12T02:35:50.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.781e-06 2020-06-12T02:35:50.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265567+0000", 2020-06-12T02:35:50.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5641000000000001e-05 2020-06-12T02:35:50.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265663+0000", 2020-06-12T02:35:50.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022724900000000001 2020-06-12T02:35:50.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265890+0000", 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002545533 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.268436+0000", 2020-06-12T02:35:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0038634009999999998 2020-06-12T02:35:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.272299+0000", 2020-06-12T02:35:50.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012105869999999999 2020-06-12T02:35:50.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273510+0000", 2020-06-12T02:35:50.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416000000000002e-05 2020-06-12T02:35:50.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273564+0000", 2020-06-12T02:35:50.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080482729999999999 2020-06-12T02:35:50.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.556 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.557 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:306 1.4s0 1:2207f711:::smithi14213939-36:head [rollback 7] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:50.557 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:50.557 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.203105857000001, 2020-06-12T02:35:50.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002, 2020-06-12T02:35:50.558 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.558 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 306 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:50.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:50.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3867999999999999e-05 2020-06-12T02:35:50.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265624+0000", 2020-06-12T02:35:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.374e-06 2020-06-12T02:35:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265629+0000", 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.63e-06 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265635+0000", 2020-06-12T02:35:50.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4470000000000002e-06 2020-06-12T02:35:50.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265639+0000", 2020-06-12T02:35:50.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034773959999999998 2020-06-12T02:35:50.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269116+0000", 2020-06-12T02:35:50.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3361000000000004e-05 2020-06-12T02:35:50.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269199+0000", 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062354000000000001 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269823+0000", 2020-06-12T02:35:50.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034596140000000002 2020-06-12T02:35:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273283+0000", 2020-06-12T02:35:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011887429999999999 2020-06-12T02:35:50.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274471+0000", 2020-06-12T02:35:50.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6236999999999994e-05 2020-06-12T02:35:50.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274558+0000", 2020-06-12T02:35:50.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002 2020-06-12T02:35:50.571 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.571 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.571 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.572 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:307 1.4s0 1:2207f711:::smithi14213939-36:head [append 0~0] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:50.572 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:50.572 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.203042414, 2020-06-12T02:35:50.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858, 2020-06-12T02:35:50.572 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.573 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.575 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 307 2020-06-12T02:35:50.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.575 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:50.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.726e-05 2020-06-12T02:35:50.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265691+0000", 2020-06-12T02:35:50.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3119999999999998e-06 2020-06-12T02:35:50.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265694+0000", 2020-06-12T02:35:50.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0460000000000002e-06 2020-06-12T02:35:50.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265700+0000", 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5019999999999999e-06 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265703+0000", 2020-06-12T02:35:50.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048970230000000003 2020-06-12T02:35:50.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270600+0000", 2020-06-12T02:35:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5030000000000006e-05 2020-06-12T02:35:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270665+0000", 2020-06-12T02:35:50.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037581000000000002 2020-06-12T02:35:50.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.271041+0000", 2020-06-12T02:35:50.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022585970000000002 2020-06-12T02:35:50.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273299+0000", 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037265929999999998 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277026+0000", 2020-06-12T02:35:50.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7684999999999997e-05 2020-06-12T02:35:50.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277124+0000", 2020-06-12T02:35:50.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858 2020-06-12T02:35:50.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.587 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.588 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:413 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 460525~690852,stat] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:50.588 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:50.588 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2335450870000004, 2020-06-12T02:35:50.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001, 2020-06-12T02:35:50.589 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.589 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.590 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 413 2020-06-12T02:35:50.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:50.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:50.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014047179999999999 2020-06-12T02:35:50.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236566+0000", 2020-06-12T02:35:50.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6436999999999999e-05 2020-06-12T02:35:50.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236582+0000", 2020-06-12T02:35:50.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0372999999999999e-05 2020-06-12T02:35:50.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236613+0000", 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7439999999999999e-05 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236630+0000", 2020-06-12T02:35:50.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013173699999999999 2020-06-12T02:35:50.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236762+0000", 2020-06-12T02:35:50.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022973399999999999 2020-06-12T02:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236992+0000", 2020-06-12T02:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021509749999999998 2020-06-12T02:35:50.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.239143+0000", 2020-06-12T02:35:50.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032350040000000001 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242378+0000", 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036755490000000002 2020-06-12T02:35:50.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246053+0000", 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012699400000000001 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246180+0000", 2020-06-12T02:35:50.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001 2020-06-12T02:35:50.609 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.609 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.609 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.610 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:414 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 1622620~730352] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:50.611 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:50.611 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2264932379999998, 2020-06-12T02:35:50.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473, 2020-06-12T02:35:50.612 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.612 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 414 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:50.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014507610000000001 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243664+0000", 2020-06-12T02:35:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0052999999999998e-05 2020-06-12T02:35:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243694+0000", 2020-06-12T02:35:50.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3764000000000002e-05 2020-06-12T02:35:50.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243748+0000", 2020-06-12T02:35:50.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3773000000000001e-05 2020-06-12T02:35:50.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243771+0000", 2020-06-12T02:35:50.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4173999999999997e-05 2020-06-12T02:35:50.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243856+0000", 2020-06-12T02:35:50.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000125909 2020-06-12T02:35:50.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:50.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243981+0000", 2020-06-12T02:35:50.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025715690000000001 2020-06-12T02:35:50.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246553+0000", 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5254000000000007e-05 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246648+0000", 2020-06-12T02:35:50.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001592483 2020-06-12T02:35:50.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248241+0000", 2020-06-12T02:35:50.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045813770000000002 2020-06-12T02:35:50.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252822+0000", 2020-06-12T02:35:50.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025664300000000002 2020-06-12T02:35:50.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255389+0000", 2020-06-12T02:35:50.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133926 2020-06-12T02:35:50.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255523+0000", 2020-06-12T02:35:50.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473 2020-06-12T02:35:50.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.628 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:415 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 3060489~200036] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:50.630 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2213933929999996, 2020-06-12T02:35:50.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996, 2020-06-12T02:35:50.630 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.630 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.631 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.631 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.631 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.631 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 415 2020-06-12T02:35:50.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.632 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:50.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052327099999999996 2020-06-12T02:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247836+0000", 2020-06-12T02:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6460000000000001e-05 2020-06-12T02:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247863+0000", 2020-06-12T02:35:50.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6666999999999998e-05 2020-06-12T02:35:50.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247919+0000", 2020-06-12T02:35:50.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6555999999999999e-05 2020-06-12T02:35:50.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247936+0000", 2020-06-12T02:35:50.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018652619999999999 2020-06-12T02:35:50.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249801+0000", 2020-06-12T02:35:50.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000228316 2020-06-12T02:35:50.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250029+0000", 2020-06-12T02:35:50.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014026869999999999 2020-06-12T02:35:50.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.251432+0000", 2020-06-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041290340000000002 2020-06-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255561+0000", 2020-06-12T02:35:50.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001052968 2020-06-12T02:35:50.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256614+0000", 2020-06-12T02:35:50.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3012999999999999e-05 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256707+0000", 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996 2020-06-12T02:35:50.647 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:416 1.4s0 1:2b9499a4:::smithi14213939-35:head [setxattr _header (57) in=7b,truncate 3260525] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2206055320000004, 2020-06-12T02:35:50.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999, 2020-06-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.651 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 416 2020-06-12T02:35:50.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.651 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017055999999999999 2020-06-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248271+0000", 2020-06-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5933999999999999e-05 2020-06-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248297+0000", 2020-06-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9759999999999998e-05 2020-06-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248347+0000", 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4456e-05 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248361+0000", 2020-06-12T02:35:50.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045179110000000003 2020-06-12T02:35:50.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252879+0000", 2020-06-12T02:35:50.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021748199999999999 2020-06-12T02:35:50.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253097+0000", 2020-06-12T02:35:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000829862 2020-06-12T02:35:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253927+0000", 2020-06-12T02:35:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028617040000000001 2020-06-12T02:35:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256788+0000", 2020-06-12T02:35:50.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020799640000000001 2020-06-12T02:35:50.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.258868+0000", 2020-06-12T02:35:50.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017190700000000001 2020-06-12T02:35:50.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259040+0000", 2020-06-12T02:35:50.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999 2020-06-12T02:35:50.663 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.664 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.664 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.665 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:35:50.666 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:50.666 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2202502449999999, 2020-06-12T02:35:50.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:35:50.667 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.667 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.667 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.667 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.667 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.668 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:35:50.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.668 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:50.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:50.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:35:50.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:35:50.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:35:50.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:35:50.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:35:50.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:35:50.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:35:50.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:35:50.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:418 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2198477170000004, 2020-06-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468, 2020-06-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 418 2020-06-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:50.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022298000000000001 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249082+0000", 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.931e-05 2020-06-12T02:35:50.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249101+0000", 2020-06-12T02:35:50.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9820000000000002e-05 2020-06-12T02:35:50.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249141+0000", 2020-06-12T02:35:50.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3679999999999999e-05 2020-06-12T02:35:50.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249154+0000", 2020-06-12T02:35:50.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064441919999999996 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255599+0000", 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011178100000000001 2020-06-12T02:35:50.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255710+0000", 2020-06-12T02:35:50.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071867049999999998 2020-06-12T02:35:50.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.262897+0000", 2020-06-12T02:35:50.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468 2020-06-12T02:35:50.691 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:419 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:50.692 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:50.693 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.2193745539999998, 2020-06-12T02:35:50.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999, 2020-06-12T02:35:50.693 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.693 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.694 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.694 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 419 2020-06-12T02:35:50.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.694 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:50.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000268977 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249601+0000", 2020-06-12T02:35:50.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8689999999999999e-05 2020-06-12T02:35:50.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249619+0000", 2020-06-12T02:35:50.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9376999999999999e-05 2020-06-12T02:35:50.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249659+0000", 2020-06-12T02:35:50.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.821e-05 2020-06-12T02:35:50.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249677+0000", 2020-06-12T02:35:50.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064908220000000003 2020-06-12T02:35:50.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256168+0000", 2020-06-12T02:35:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4083000000000001e-05 2020-06-12T02:35:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256252+0000", 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084599500000000008 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.264712+0000", 2020-06-12T02:35:50.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999 2020-06-12T02:35:50.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.703 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.704 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:50.704 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:50.705 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.218833193, 2020-06-12T02:35:50.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:35:50.705 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.705 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.707 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:35:50.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.707 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:50.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:50.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:35:50.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:35:50.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:35:50.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:35:50.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:35:50.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:35:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:35:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:35:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:35:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:35:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:35:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:35:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:35:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:35:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:35:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:464 1.4s0 1:2b9499a4:::smithi14213939-35:head [append 0~0] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930535+0000", 2020-06-12T02:35:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.5381710139999996, 2020-06-12T02:35:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075665849999999998, 2020-06-12T02:35:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 464 2020-06-12T02:35:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930535+0000", 2020-06-12T02:35:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930535+0000", 2020-06-12T02:35:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9981999999999997e-05 2020-06-12T02:35:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930585+0000", 2020-06-12T02:35:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0917999999999999e-05 2020-06-12T02:35:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930596+0000", 2020-06-12T02:35:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8034e-05 2020-06-12T02:35:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930614+0000", 2020-06-12T02:35:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7373000000000001e-05 2020-06-12T02:35:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930632+0000", 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033409299999999999 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930966+0000", 2020-06-12T02:35:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016887299999999999 2020-06-12T02:35:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.931135+0000", 2020-06-12T02:35:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099043500000000001 2020-06-12T02:35:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.932125+0000", 2020-06-12T02:35:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044968580000000003 2020-06-12T02:35:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936622+0000", 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014249969999999999 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.938047+0000", 2020-06-12T02:35:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5022000000000003e-05 2020-06-12T02:35:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.938102+0000", 2020-06-12T02:35:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075665849999999998 2020-06-12T02:35:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.742 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:465 1.4s0 1:2b9499a4:::smithi14213939-35:head [rollback c] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:50.742 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:50.742 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.5380156270000001, 2020-06-12T02:35:50.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994, 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.743 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 465 2020-06-12T02:35:50.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.744 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:50.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:50.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9047e-05 2020-06-12T02:35:50.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930740+0000", 2020-06-12T02:35:50.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5460000000000003e-06 2020-06-12T02:35:50.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930747+0000", 2020-06-12T02:35:50.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3519999999999999e-05 2020-06-12T02:35:50.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930761+0000", 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6219999999999997e-06 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930766+0000", 2020-06-12T02:35:50.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027740130000000001 2020-06-12T02:35:50.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933540+0000", 2020-06-12T02:35:50.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000194954 2020-06-12T02:35:50.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933735+0000", 2020-06-12T02:35:50.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094835199999999996 2020-06-12T02:35:50.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.934684+0000", 2020-06-12T02:35:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020709050000000001 2020-06-12T02:35:50.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936755+0000", 2020-06-12T02:35:50.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029704919999999999 2020-06-12T02:35:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939725+0000", 2020-06-12T02:35:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2645999999999994e-05 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939808+0000", 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994 2020-06-12T02:35:50.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.759 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.759 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:466 1.4s0 1:2b9499a4:::smithi14213939-35:head [append 0~0] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:50.760 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:50.760 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.5378932089999999, 2020-06-12T02:35:50.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632, 2020-06-12T02:35:50.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:50.761 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.761 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.761 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.761 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 466 2020-06-12T02:35:50.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.762 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:50.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.761e-05 2020-06-12T02:35:50.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930861+0000", 2020-06-12T02:35:50.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2320000000000004e-06 2020-06-12T02:35:50.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930868+0000", 2020-06-12T02:35:50.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3369e-05 2020-06-12T02:35:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930881+0000", 2020-06-12T02:35:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4280000000000004e-06 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930887+0000", 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048704559999999996 2020-06-12T02:35:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935757+0000", 2020-06-12T02:35:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012276 2020-06-12T02:35:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935880+0000", 2020-06-12T02:35:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052191100000000001 2020-06-12T02:35:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936402+0000", 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028551010000000001 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939257+0000", 2020-06-12T02:35:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030580550000000001 2020-06-12T02:35:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942315+0000", 2020-06-12T02:35:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4709999999999995e-05 2020-06-12T02:35:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942380+0000", 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.ds2 43/18 ECSubWrite(tid=217, reqid=osd.2.0:217, at_version=43'81, trim_to=0'0, roll_forward_to=41'77))", 2020-06-12T02:35:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.535228327, 2020-06-12T02:35:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081356540000000008, 2020-06-12T02:35:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5704000000000004e-05 2020-06-12T02:35:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933574+0000", 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5109999999999998e-05 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933599+0000", 2020-06-12T02:35:50.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6912e-05 2020-06-12T02:35:50.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933616+0000", 2020-06-12T02:35:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1620000000000008e-06 2020-06-12T02:35:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933624+0000", 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000495014 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.934119+0000", 2020-06-12T02:35:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7158000000000001e-05 2020-06-12T02:35:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.934136+0000", 2020-06-12T02:35:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074276059999999998 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.941564+0000", 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9988000000000003e-05 2020-06-12T02:35:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.941614+0000", 2020-06-12T02:35:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081356540000000008 2020-06-12T02:35:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:535 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~2588245,checksum] snapc 0=[] ondisk+read+known_if_redirected e43)", 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.42705911699999999, 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076, 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:50.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:50.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:50.787 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 535 2020-06-12T02:35:50.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.787 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:50.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:50.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:50.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:50.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019748300000000001 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041845+0000", 2020-06-12T02:35:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7210999999999998e-05 2020-06-12T02:35:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041862+0000", 2020-06-12T02:35:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9805999999999999e-05 2020-06-12T02:35:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041892+0000", 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7217000000000001e-05 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041909+0000", 2020-06-12T02:35:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051008499999999997 2020-06-12T02:35:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042419+0000", 2020-06-12T02:35:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011063 2020-06-12T02:35:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042530+0000", 2020-06-12T02:35:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091386439999999996 2020-06-12T02:35:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.051668+0000", 2020-06-12T02:35:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076 2020-06-12T02:35:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:50.798 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:50.803 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:50.805 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:50.802+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:50.806 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:50.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:50.907+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:50.919 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.918+0000 7fb5c3bce700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.933 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:50.922+0000 7fb5c296c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:50.933 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:50.934 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:50.935 INFO:tasks.rados.rados.0.smithi142.stdout:170: done (3 left) 2020-06-12T02:35:50.936 INFO:tasks.rados.rados.0.smithi142.stdout:171: done (2 left) 2020-06-12T02:35:50.936 INFO:tasks.rados.rados.0.smithi142.stdout:172: done (1 left) 2020-06-12T02:35:50.937 INFO:tasks.rados.rados.0.smithi142.stdout:174: done (0 left) 2020-06-12T02:35:50.937 INFO:tasks.rados.rados.0.smithi142.stdout:175: write oid 8 current snap is 14 2020-06-12T02:35:50.937 INFO:tasks.rados.rados.0.smithi142.stdout:175: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2020-06-12T02:35:50.938 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:50.939 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:35:50.939 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.1 to 1 (10000) 2020-06-12T02:35:50.945 INFO:tasks.rados.rados.0.smithi142.stdout:175: writing smithi14213939-8 from 729437 to 1256979 tid 1 2020-06-12T02:35:50.956 INFO:tasks.rados.rados.0.smithi142.stdout:175: writing smithi14213939-8 from 1925626 to 2568977 tid 2 2020-06-12T02:35:50.956 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 2 1 2020-06-12T02:35:50.963 INFO:tasks.rados.rados.0.smithi142.stdout:175: writing smithi14213939-8 from 3266551 to 3529437 tid 3 2020-06-12T02:35:50.963 INFO:tasks.rados.rados.0.smithi142.stdout:176: delete oid 50 current snap is 14 2020-06-12T02:35:50.964 INFO:tasks.rados.rados.0.smithi142.stdout:175: finishing write tid 1 to smithi14213939-8 2020-06-12T02:35:50.969 INFO:tasks.rados.rados.0.smithi142.stdout:176: done (1 left) 2020-06-12T02:35:50.969 INFO:tasks.rados.rados.0.smithi142.stdout:177: snap_remove snap 13 2020-06-12T02:35:50.974 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:50.994 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:51.005 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:51.007+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:51.016 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:51.040 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:51.053 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.053 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.062 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:51.067 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:51.080 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:51.070+0000 7f50663b2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:51.084 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:51.082+0000 7f5065150700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:51.095 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:51.106 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:51.106+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:51.133 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:51.159 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:51.161 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.161 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.161 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:51.171 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.171 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.181 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:51.222 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:51.222+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:51.313 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:51.315+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:51.325 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.325 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.334 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:51.416 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:51.419+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:51.436 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.436 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.445 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:51.517 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:51.514+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:51.549 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.549 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.559 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:51.647 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:51.646+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:51.709 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.710 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.719 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:51.762 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:51.762+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:51.825 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:51.827+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:51.886 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:51.926 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:51.927+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:51.943 INFO:tasks.rados.rados.0.smithi142.stdout:177: done (1 left) 2020-06-12T02:35:51.944 INFO:tasks.rados.rados.0.smithi142.stdout:178: snap_remove snap 5 2020-06-12T02:35:51.950 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.2 to 1 (10000) 2020-06-12T02:35:51.957 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 3 1 2020-06-12T02:35:52.011 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.012 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.022 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:52.026 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:52.027+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:52.064 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:52.054+0000 7fc708909700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:52.066 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:52.066+0000 7fc708909700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:52.127 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:52.127+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:52.143 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.143 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.156 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:52.242 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:52.242+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.316 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:52.336 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:52.335+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:52.434 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:52.430+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:52.474 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.474 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.483 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:52.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:52.535+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:52.601 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.602 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.610 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:52.636 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:52.633+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:52.737 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:52.739+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:52.767 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.768 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.777 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:52.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:52.867+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:52.932 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:52.932 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:52.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:52.939+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:52.941 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:52.942 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:52.943+0000 7f411eb83700 -1 osd.6 pg_epoch: 46 pg[1.cs0( v 41'21 (0'0,41'21] local-lis/les=18/19 n=2 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [6,5,4]p6(0) r=0 lpr=18 crt=41'21 lcod 38'19 mlcod 38'19 active+clean+snaptrim trimq=[a~1] ps=[b~2,f~1,14~1,18~1]] removing snap head 2020-06-12T02:35:52.946 INFO:tasks.rados.rados.0.smithi142.stdout:178: done (1 left) 2020-06-12T02:35:52.946 INFO:tasks.rados.rados.0.smithi142.stdout:179: snap_create 2020-06-12T02:35:52.946 INFO:tasks.rados.rados.0.smithi142.stdout:175: finishing write tid 2 to smithi14213939-8 2020-06-12T02:35:52.946 INFO:tasks.rados.rados.0.smithi142.stdout:175: finishing write tid 3 to smithi14213939-8 2020-06-12T02:35:52.946 INFO:tasks.rados.rados.0.smithi142.stdout:175: finishing write tid 5 to smithi14213939-8 2020-06-12T02:35:52.947 INFO:tasks.rados.rados.0.smithi142.stdout:175: finishing write tid 6 to smithi14213939-8 2020-06-12T02:35:52.947 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 103 (ObjNum 91 snap 14 seq_num 91) dirty exists 2020-06-12T02:35:52.947 INFO:tasks.rados.rados.0.smithi142.stdout:175: left oid 8 (ObjNum 91 snap 14 seq_num 91) 2020-06-12T02:35:52.954 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.3 to 1 (10000) 2020-06-12T02:35:52.964 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:35:52.973 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 4 1 2020-06-12T02:35:52.975 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:52.969+0000 7fb62b0a3700 -1 osd.2 pg_epoch: 46 pg[1.ds0( v 46'85 (0'0,46'85] local-lis/les=18/19 n=11 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [2,1,7]p2(0) r=0 lpr=18 crt=46'85 lcod 46'83 mlcod 46'83 active+clean+snaptrim trimq=[a~1] ps=[b~2,f~1,14~1,18~1]] removing snap head 2020-06-12T02:35:53.039 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:53.037+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:53.052 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:53.052 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:53.061 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.085+0000 7f7a74475700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.081+0000 7f582ab34700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.094 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.089+0000 7f7a74475700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.093+0000 7f58298d2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:53.143+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:53.168 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:53.169 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:53.174 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:53.178 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:53.265 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:53.267+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:53.283 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.277+0000 7f9375068700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.286 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:53.281+0000 7f9374867700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:53.314 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:53.332 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:53.334 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:53.335 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:53.343 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:53.337+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:53.345 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:53.351 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:53.377 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:53.401 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:53.421 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:53.441 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:53.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:53.443+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:53.461 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.465 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.465 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.465 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.465 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:53.503 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:53.503 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:53.503 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:53.504 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:53.514 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:53.553 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:53.541+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:53.644 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:53.641+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:53.669 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:53.670 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:53.671 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:53.671 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:53.671 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:53.677 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:53.746 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:53.741+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:53.788 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:53.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:53.789 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.667846006000001, 2020-06-12T02:35:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:35:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:53.790 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:35:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:53.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:35:53.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:35:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:35:53.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:35:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:35:53.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:35:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:35:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:35:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:35:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:35:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:53.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:35:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:35:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:35:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:35:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.667707069999999, 2020-06-12T02:35:53.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:35:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:53.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:53.815 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:35:53.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:35:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:35:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:35:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:35:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:35:53.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:35:53.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:35:53.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:35:53.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:35:53.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:35:53.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:53.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:35:53.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:35:53.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:35:53.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:35:53.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:53.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:35:53.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:35:53.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:35:53.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:35:53.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:35:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:35:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.831 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:53.831 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:53.831 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.667571232, 2020-06-12T02:35:53.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:35:53.832 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.832 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:53.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:53.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:53.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:53.833 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:35:53.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.833 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:53.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:35:53.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:35:53.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:35:53.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:35:53.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:35:53.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:35:53.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:35:53.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:35:53.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:35:53.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:35:53.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:35:53.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:35:53.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:53.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:35:53.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:35:53.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:35:53.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:35:53.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:53.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:35:53.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:35:53.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:35:53.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:35:53.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:53.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:35:53.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:35:53.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:35:53.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:35:53.854 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.855 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:35:53.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:53.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.643906384000001, 2020-06-12T02:35:53.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:35:53.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:53.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:35:53.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:35:53.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:35:53.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:35:53.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:35:53.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:35:53.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:35:53.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:35:53.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:35:53.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:35:53.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:35:53.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:35:53.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:35:53.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:35:53.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:35:53.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.872 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.873 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 28/18 ECSubWrite(tid=87, reqid=client.4555.0:287, at_version=28'25, trim_to=0'0, roll_forward_to=26'23))", 2020-06-12T02:35:53.873 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:53.873 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.607157596, 2020-06-12T02:35:53.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905, 2020-06-12T02:35:53.873 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.874 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.874 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:53.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.182629+0000", 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028867860000000001 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185516+0000", 2020-06-12T02:35:53.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1566000000000002e-05 2020-06-12T02:35:53.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185548+0000", 2020-06-12T02:35:53.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8912000000000001e-05 2020-06-12T02:35:53.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185566+0000", 2020-06-12T02:35:53.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2199999999999992e-06 2020-06-12T02:35:53.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185575+0000", 2020-06-12T02:35:53.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1684e-05 2020-06-12T02:35:53.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185646+0000", 2020-06-12T02:35:53.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6929999999999999e-05 2020-06-12T02:35:53.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.185663+0000", 2020-06-12T02:35:53.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046390820000000001 2020-06-12T02:35:53.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190302+0000", 2020-06-12T02:35:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9725000000000002e-05 2020-06-12T02:35:53.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:35.190362+0000", 2020-06-12T02:35:53.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007732905 2020-06-12T02:35:53.885 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.885 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.885 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.886 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 29/18 ECSubWrite(tid=48, reqid=client.4555.0:300, at_version=29'20, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:53.886 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:53.886 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.603178611000001, 2020-06-12T02:35:53.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998, 2020-06-12T02:35:53.886 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.887 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.887 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:53.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186608+0000", 2020-06-12T02:35:53.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021036700000000002 2020-06-12T02:35:53.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188712+0000", 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1732e-05 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188744+0000", 2020-06-12T02:35:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7884999999999999e-05 2020-06-12T02:35:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188761+0000", 2020-06-12T02:35:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5829999999999996e-06 2020-06-12T02:35:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188771+0000", 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2814999999999999e-05 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188854+0000", 2020-06-12T02:35:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9015999999999999e-05 2020-06-12T02:35:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.188873+0000", 2020-06-12T02:35:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048068499999999997 2020-06-12T02:35:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193680+0000", 2020-06-12T02:35:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6352000000000002e-05 2020-06-12T02:35:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.193776+0000", 2020-06-12T02:35:53.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071679029999999998 2020-06-12T02:35:53.898 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.898 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.899 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 29/18 ECSubWrite(tid=137, reqid=client.4555.0:303, at_version=29'24, trim_to=0'0, roll_forward_to=26'22))", 2020-06-12T02:35:53.901 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:53.901 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.503812927999999, 2020-06-12T02:35:53.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321, 2020-06-12T02:35:53.901 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.902 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.902 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:53.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.285974+0000", 2020-06-12T02:35:53.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014014069999999999 2020-06-12T02:35:53.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287375+0000", 2020-06-12T02:35:53.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5082000000000001e-05 2020-06-12T02:35:53.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287410+0000", 2020-06-12T02:35:53.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6569999999999999e-05 2020-06-12T02:35:53.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287427+0000", 2020-06-12T02:35:53.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3130000000000004e-06 2020-06-12T02:35:53.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287436+0000", 2020-06-12T02:35:53.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2125000000000005e-05 2020-06-12T02:35:53.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287508+0000", 2020-06-12T02:35:53.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3589e-05 2020-06-12T02:35:53.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.287522+0000", 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045636469999999997 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292086+0000", 2020-06-12T02:35:53.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108588 2020-06-12T02:35:53.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292194+0000", 2020-06-12T02:35:53.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.006220321 2020-06-12T02:35:53.914 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.914 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.915 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:35:53.915 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.596462474000001, 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:53.916 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:53.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:53.917 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:35:53.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.917 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:53.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:35:53.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:35:53.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:35:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:35:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:35:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:35:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:35:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:35:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:35:53.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:35:53.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:35:53.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:35:53.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:35:53.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:35:53.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:35:53.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:35:53.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:53.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:35:53.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.bs1 34/18 ECSubWrite(tid=102, reqid=osd.4.0:100, at_version=0'0, trim_to=0'0, roll_forward_to=34'31))", 2020-06-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.828200938, 2020-06-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003, 2020-06-12T02:35:53.932 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961586+0000", 2020-06-12T02:35:53.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2791000000000002e-05 2020-06-12T02:35:53.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961659+0000", 2020-06-12T02:35:53.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:35:53.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961675+0000", 2020-06-12T02:35:53.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.825e-05 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961693+0000", 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9419999999999998e-06 2020-06-12T02:35:53.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961700+0000", 2020-06-12T02:35:53.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7218e-05 2020-06-12T02:35:53.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961757+0000", 2020-06-12T02:35:53.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1976e-05 2020-06-12T02:35:53.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.961769+0000", 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059766539999999996 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967746+0000", 2020-06-12T02:35:53.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.3628000000000003e-05 2020-06-12T02:35:53.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967790+0000", 2020-06-12T02:35:53.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062038040000000003 2020-06-12T02:35:53.943 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.943 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.943 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.944 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s1 34/18 ECSubWrite(tid=59, reqid=osd.3.0:58, at_version=0'0, trim_to=0'0, roll_forward_to=34'26))", 2020-06-12T02:35:53.944 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:53.944 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.827312977, 2020-06-12T02:35:53.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004, 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:53.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962474+0000", 2020-06-12T02:35:53.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1511000000000001e-05 2020-06-12T02:35:53.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962535+0000", 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8549999999999997e-06 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962545+0000", 2020-06-12T02:35:53.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.042e-05 2020-06-12T02:35:53.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962556+0000", 2020-06-12T02:35:53.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1889999999999998e-06 2020-06-12T02:35:53.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962561+0000", 2020-06-12T02:35:53.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9722999999999998e-05 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962611+0000", 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1527e-05 2020-06-12T02:35:53.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.962622+0000", 2020-06-12T02:35:53.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052122080000000003 2020-06-12T02:35:53.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967834+0000", 2020-06-12T02:35:53.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.702e-05 2020-06-12T02:35:53.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.967881+0000", 2020-06-12T02:35:53.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054074530000000004 2020-06-12T02:35:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=109, reqid=osd.2.0:109, at_version=34'35, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:35:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.826191145999999, 2020-06-12T02:35:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002, 2020-06-12T02:35:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963596+0000", 2020-06-12T02:35:53.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2299999999999996e-05 2020-06-12T02:35:53.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963658+0000", 2020-06-12T02:35:53.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4314000000000001e-05 2020-06-12T02:35:53.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963682+0000", 2020-06-12T02:35:53.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5594e-05 2020-06-12T02:35:53.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963698+0000", 2020-06-12T02:35:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1109999999999996e-06 2020-06-12T02:35:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.963704+0000", 2020-06-12T02:35:53.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00087375300000000001 2020-06-12T02:35:53.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964578+0000", 2020-06-12T02:35:53.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5530000000000004e-06 2020-06-12T02:35:53.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.964585+0000", 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005270889 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969856+0000", 2020-06-12T02:35:53.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7800000000000002e-05 2020-06-12T02:35:53.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.969914+0000", 2020-06-12T02:35:53.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063183140000000002 2020-06-12T02:35:53.972 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.972 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.972 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.973 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 34/18 ECSubWrite(tid=110, reqid=osd.2.0:109, at_version=0'0, trim_to=0'0, roll_forward_to=34'35))", 2020-06-12T02:35:53.973 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:53.973 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.813284294000001, 2020-06-12T02:35:53.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378, 2020-06-12T02:35:53.974 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.974 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.974 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:53.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976502+0000", 2020-06-12T02:35:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2021000000000003e-05 2020-06-12T02:35:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976545+0000", 2020-06-12T02:35:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9760000000000007e-06 2020-06-12T02:35:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976554+0000", 2020-06-12T02:35:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2782999999999999e-05 2020-06-12T02:35:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976567+0000", 2020-06-12T02:35:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3529999999999995e-06 2020-06-12T02:35:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976576+0000", 2020-06-12T02:35:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0129000000000002e-05 2020-06-12T02:35:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976616+0000", 2020-06-12T02:35:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1949999999999997e-06 2020-06-12T02:35:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.976623+0000", 2020-06-12T02:35:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007247369 2020-06-12T02:35:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983870+0000", 2020-06-12T02:35:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2552000000000001e-05 2020-06-12T02:35:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:40.983923+0000", 2020-06-12T02:35:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007420378 2020-06-12T02:35:53.984 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=229, reqid=osd.1.0:228, at_version=0'0, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8533719990000002, 2020-06-12T02:35:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995, 2020-06-12T02:35:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936415+0000", 2020-06-12T02:35:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2689999999999996e-05 2020-06-12T02:35:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936497+0000", 2020-06-12T02:35:53.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1767000000000003e-05 2020-06-12T02:35:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936529+0000", 2020-06-12T02:35:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3943000000000001e-05 2020-06-12T02:35:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936553+0000", 2020-06-12T02:35:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6479999999999992e-06 2020-06-12T02:35:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936562+0000", 2020-06-12T02:35:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6100000000000002e-05 2020-06-12T02:35:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936618+0000", 2020-06-12T02:35:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.361e-05 2020-06-12T02:35:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.936632+0000", 2020-06-12T02:35:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008610843 2020-06-12T02:35:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945242+0000", 2020-06-12T02:35:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5210999999999995e-05 2020-06-12T02:35:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945318+0000", 2020-06-12T02:35:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089028119999999995 2020-06-12T02:35:54.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8527254309999996, 2020-06-12T02:35:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:35:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:35:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:35:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:35:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:35:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:35:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:35:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:35:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:35:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:35:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:35:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:35:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:35:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:35:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:35:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:35:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:35:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:35:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:35:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8517520609999991, 2020-06-12T02:35:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:35:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:35:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:35:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:35:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:35:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:35:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:35:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:35:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:35:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:35:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:35:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:35:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:35:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:35:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:35:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:35:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:35:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:35:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:35:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:35:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8505429410000005, 2020-06-12T02:35:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:35:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:35:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:35:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:35:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:35:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:35:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:35:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:35:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:35:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:35:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:35:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:35:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:35:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:35:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:35:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:35:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:35:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:35:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:35:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=162, reqid=osd.2.0:162, at_version=38'49, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8494229200000003, 2020-06-12T02:35:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997, 2020-06-12T02:35:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940364+0000", 2020-06-12T02:35:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8365000000000001e-05 2020-06-12T02:35:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940422+0000", 2020-06-12T02:35:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9471e-05 2020-06-12T02:35:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940442+0000", 2020-06-12T02:35:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4909000000000001e-05 2020-06-12T02:35:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940457+0000", 2020-06-12T02:35:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5640000000000002e-06 2020-06-12T02:35:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940463+0000", 2020-06-12T02:35:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6838000000000001e-05 2020-06-12T02:35:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940510+0000", 2020-06-12T02:35:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9485000000000001e-05 2020-06-12T02:35:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940530+0000", 2020-06-12T02:35:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0068075849999999997 2020-06-12T02:35:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947337+0000", 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2507000000000002e-05 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947410+0000", 2020-06-12T02:35:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070457239999999997 2020-06-12T02:35:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8492799560000002, 2020-06-12T02:35:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:35:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:35:54.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:35:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:35:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:35:54.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:35:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:35:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:35:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:35:54.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:35:54.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:35:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:35:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:35:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=164, reqid=client.4555.0:445, at_version=38'52, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.8461332769999999, 2020-06-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937, 2020-06-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943654+0000", 2020-06-12T02:35:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000665089 2020-06-12T02:35:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944319+0000", 2020-06-12T02:35:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2676999999999999e-05 2020-06-12T02:35:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944351+0000", 2020-06-12T02:35:54.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7135999999999999e-05 2020-06-12T02:35:54.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944378+0000", 2020-06-12T02:35:54.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:35:54.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.944388+0000", 2020-06-12T02:35:54.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00091818399999999995 2020-06-12T02:35:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945306+0000", 2020-06-12T02:35:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8420000000000005e-06 2020-06-12T02:35:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.945314+0000", 2020-06-12T02:35:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054267839999999996 2020-06-12T02:35:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950741+0000", 2020-06-12T02:35:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7828999999999999e-05 2020-06-12T02:35:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.950788+0000", 2020-06-12T02:35:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007134937 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 43/18 ECSubWrite(tid=274, reqid=client.4555.0:527, at_version=43'81, trim_to=0'0, roll_forward_to=43'79))", 2020-06-12T02:35:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:50.044717+0000", 2020-06-12T02:35:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 3.745069505, 2020-06-12T02:35:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0067165530000000001, 2020-06-12T02:35:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044717+0000", 2020-06-12T02:35:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044717+0000", 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121014 2020-06-12T02:35:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044838+0000", 2020-06-12T02:35:54.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2878000000000003e-05 2020-06-12T02:35:54.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044911+0000", 2020-06-12T02:35:54.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4168000000000001e-05 2020-06-12T02:35:54.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044955+0000", 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.562e-05 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.044971+0000", 2020-06-12T02:35:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150512 2020-06-12T02:35:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.045121+0000", 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8034e-05 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.045150+0000", 2020-06-12T02:35:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060716119999999997 2020-06-12T02:35:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.051221+0000", 2020-06-12T02:35:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021271500000000001 2020-06-12T02:35:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.051434+0000", 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0067165530000000001 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.111 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:54.113 INFO:tasks.rados.rados.0.smithi142.stdout:175: done (1 left) 2020-06-12T02:35:54.113 INFO:tasks.rados.rados.0.smithi142.stdout:179: done (0 left) 2020-06-12T02:35:54.113 INFO:tasks.rados.rados.0.smithi142.stdout:180: copy_from oid 5 from oid 17 current snap is 15 2020-06-12T02:35:54.114 INFO:tasks.rados.rados.0.smithi142.stdout:181: rollback oid 6 current snap is 15 2020-06-12T02:35:54.114 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 6 to 12 2020-06-12T02:35:54.114 INFO:tasks.rados.rados.0.smithi142.stdout:182: snap_remove snap 9 2020-06-12T02:35:54.114 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:35:54.115 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.4 to 1 (10000) 2020-06-12T02:35:54.115 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 5 1 2020-06-12T02:35:54.116 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:54.115+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:54.116 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:54.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:54.215+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:54.271 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:54.271 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:54.272 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:54.275 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:54.261+0000 7f0382cb9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:54.281 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:54.273+0000 7f0381a57700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:54.282 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:54.315 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:54.313+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:54.416 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:54.415+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:54.431 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:54.432 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:54.432 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:54.441 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:54.518 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:54.512+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:54.611 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:54.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:203 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:54.612 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.512082196000001, 2020-06-12T02:35:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564, 2020-06-12T02:35:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.613 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.630 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 203 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:54.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:54.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3640000000000006e-05 2020-06-12T02:35:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097693+0000", 2020-06-12T02:35:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5359999999999999e-05 2020-06-12T02:35:54.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:35:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6433999999999997e-05 2020-06-12T02:35:54.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097745+0000", 2020-06-12T02:35:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0820000000000001e-05 2020-06-12T02:35:54.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097766+0000", 2020-06-12T02:35:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012371999999999999 2020-06-12T02:35:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097890+0000", 2020-06-12T02:35:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097907+0000", 2020-06-12T02:35:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053765519999999997 2020-06-12T02:35:54.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103283+0000", 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120228 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103403+0000", 2020-06-12T02:35:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057519930000000004 2020-06-12T02:35:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.109155+0000", 2020-06-12T02:35:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564 2020-06-12T02:35:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:204 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:54.654 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.511809898999999, 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001, 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 204 2020-06-12T02:35:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1323999999999997e-05 2020-06-12T02:35:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097963+0000", 2020-06-12T02:35:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3753e-05 2020-06-12T02:35:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097977+0000", 2020-06-12T02:35:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4084000000000001e-05 2020-06-12T02:35:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098011+0000", 2020-06-12T02:35:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.436e-05 2020-06-12T02:35:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098026+0000", 2020-06-12T02:35:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2340000000000001e-05 2020-06-12T02:35:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098108+0000", 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2573e-05 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098120+0000", 2020-06-12T02:35:54.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057105419999999999 2020-06-12T02:35:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103831+0000", 2020-06-12T02:35:54.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2423000000000006e-05 2020-06-12T02:35:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103923+0000", 2020-06-12T02:35:54.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080684209999999992 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111992+0000", 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001 2020-06-12T02:35:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.669 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:205 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:54.670 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:54.670 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.511530101000002, 2020-06-12T02:35:54.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999, 2020-06-12T02:35:54.670 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.671 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.671 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.671 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.671 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 205 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:54.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:54.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.36e-05 2020-06-12T02:35:54.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098245+0000", 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1090000000000001e-05 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098257+0000", 2020-06-12T02:35:54.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9026e-05 2020-06-12T02:35:54.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098276+0000", 2020-06-12T02:35:54.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8769999999999999e-06 2020-06-12T02:35:54.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098284+0000", 2020-06-12T02:35:54.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011569300000000001 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098400+0000", 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3874e-05 2020-06-12T02:35:54.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:54.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098414+0000", 2020-06-12T02:35:54.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086850239999999995 2020-06-12T02:35:54.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107099+0000", 2020-06-12T02:35:54.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9898e-05 2020-06-12T02:35:54.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107179+0000", 2020-06-12T02:35:54.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070512750000000001 2020-06-12T02:35:54.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.114230+0000", 2020-06-12T02:35:54.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999 2020-06-12T02:35:54.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.683 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.684 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.6s2 29/18 ECSubWrite(tid=48, reqid=client.4555.0:300, at_version=29'20, trim_to=0'0, roll_forward_to=26'18))", 2020-06-12T02:35:54.684 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:54.684 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.422955192, 2020-06-12T02:35:54.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0079975549999999999, 2020-06-12T02:35:54.685 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.685 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.685 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:54.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.186747+0000", 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025483760000000002 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189295+0000", 2020-06-12T02:35:54.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3050999999999999e-05 2020-06-12T02:35:54.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189328+0000", 2020-06-12T02:35:54.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2345e-05 2020-06-12T02:35:54.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189351+0000", 2020-06-12T02:35:54.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0743e-05 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189361+0000", 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0683e-05 2020-06-12T02:35:54.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189442+0000", 2020-06-12T02:35:54.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2305000000000001e-05 2020-06-12T02:35:54.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.189464+0000", 2020-06-12T02:35:54.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005221486 2020-06-12T02:35:54.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.194686+0000", 2020-06-12T02:35:54.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8566000000000001e-05 2020-06-12T02:35:54.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.194744+0000", 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0079975549999999999 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.700 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.701 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:305 1.4s0 1:2207f711:::smithi14213939-36:head [append 0~0] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:54.701 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:54.702 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.344186261000001, 2020-06-12T02:35:54.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080482729999999999, 2020-06-12T02:35:54.702 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.702 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.703 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 305 2020-06-12T02:35:54.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:54.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265516+0000", 2020-06-12T02:35:54.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6239999999999999e-05 2020-06-12T02:35:54.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265542+0000", 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8990000000000004e-06 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265549+0000", 2020-06-12T02:35:54.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1525999999999999e-05 2020-06-12T02:35:54.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265560+0000", 2020-06-12T02:35:54.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.781e-06 2020-06-12T02:35:54.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265567+0000", 2020-06-12T02:35:54.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5641000000000001e-05 2020-06-12T02:35:54.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265663+0000", 2020-06-12T02:35:54.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022724900000000001 2020-06-12T02:35:54.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265890+0000", 2020-06-12T02:35:54.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002545533 2020-06-12T02:35:54.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.268436+0000", 2020-06-12T02:35:54.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0038634009999999998 2020-06-12T02:35:54.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.272299+0000", 2020-06-12T02:35:54.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012105869999999999 2020-06-12T02:35:54.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273510+0000", 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416000000000002e-05 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273564+0000", 2020-06-12T02:35:54.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080482729999999999 2020-06-12T02:35:54.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.718 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.719 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:306 1.4s0 1:2207f711:::smithi14213939-36:head [rollback 7] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:54.719 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:54.719 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.344101521999999, 2020-06-12T02:35:54.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002, 2020-06-12T02:35:54.720 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.720 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 306 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:54.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:54.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3867999999999999e-05 2020-06-12T02:35:54.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265624+0000", 2020-06-12T02:35:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.374e-06 2020-06-12T02:35:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265629+0000", 2020-06-12T02:35:54.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.63e-06 2020-06-12T02:35:54.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265635+0000", 2020-06-12T02:35:54.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4470000000000002e-06 2020-06-12T02:35:54.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265639+0000", 2020-06-12T02:35:54.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034773959999999998 2020-06-12T02:35:54.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269116+0000", 2020-06-12T02:35:54.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3361000000000004e-05 2020-06-12T02:35:54.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269199+0000", 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062354000000000001 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269823+0000", 2020-06-12T02:35:54.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034596140000000002 2020-06-12T02:35:54.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273283+0000", 2020-06-12T02:35:54.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011887429999999999 2020-06-12T02:35:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274471+0000", 2020-06-12T02:35:54.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6236999999999994e-05 2020-06-12T02:35:54.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274558+0000", 2020-06-12T02:35:54.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002 2020-06-12T02:35:54.735 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.735 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.735 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.736 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:307 1.4s0 1:2207f711:::smithi14213939-36:head [append 0~0] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:54.736 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:54.736 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.344038079000001, 2020-06-12T02:35:54.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858, 2020-06-12T02:35:54.737 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.737 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.738 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 307 2020-06-12T02:35:54.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.738 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:54.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:54.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.726e-05 2020-06-12T02:35:54.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265691+0000", 2020-06-12T02:35:54.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3119999999999998e-06 2020-06-12T02:35:54.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265694+0000", 2020-06-12T02:35:54.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0460000000000002e-06 2020-06-12T02:35:54.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265700+0000", 2020-06-12T02:35:54.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5019999999999999e-06 2020-06-12T02:35:54.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265703+0000", 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048970230000000003 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270600+0000", 2020-06-12T02:35:54.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5030000000000006e-05 2020-06-12T02:35:54.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270665+0000", 2020-06-12T02:35:54.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037581000000000002 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.271041+0000", 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022585970000000002 2020-06-12T02:35:54.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273299+0000", 2020-06-12T02:35:54.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037265929999999998 2020-06-12T02:35:54.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277026+0000", 2020-06-12T02:35:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7684999999999997e-05 2020-06-12T02:35:54.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277124+0000", 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.750 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.751 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:413 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 460525~690852,stat] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:54.751 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:54.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.374540752, 2020-06-12T02:35:54.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001, 2020-06-12T02:35:54.752 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.752 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.752 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 413 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:54.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:54.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014047179999999999 2020-06-12T02:35:54.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236566+0000", 2020-06-12T02:35:54.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6436999999999999e-05 2020-06-12T02:35:54.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236582+0000", 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0372999999999999e-05 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236613+0000", 2020-06-12T02:35:54.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7439999999999999e-05 2020-06-12T02:35:54.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236630+0000", 2020-06-12T02:35:54.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013173699999999999 2020-06-12T02:35:54.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236762+0000", 2020-06-12T02:35:54.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022973399999999999 2020-06-12T02:35:54.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236992+0000", 2020-06-12T02:35:54.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021509749999999998 2020-06-12T02:35:54.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.239143+0000", 2020-06-12T02:35:54.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032350040000000001 2020-06-12T02:35:54.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242378+0000", 2020-06-12T02:35:54.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036755490000000002 2020-06-12T02:35:54.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246053+0000", 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012699400000000001 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246180+0000", 2020-06-12T02:35:54.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001 2020-06-12T02:35:54.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.767 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.768 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:414 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 1622620~730352] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:54.768 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:54.768 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.367488903, 2020-06-12T02:35:54.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473, 2020-06-12T02:35:54.769 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.769 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 414 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:54.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:54.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014507610000000001 2020-06-12T02:35:54.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243664+0000", 2020-06-12T02:35:54.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0052999999999998e-05 2020-06-12T02:35:54.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243694+0000", 2020-06-12T02:35:54.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3764000000000002e-05 2020-06-12T02:35:54.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243748+0000", 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3773000000000001e-05 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243771+0000", 2020-06-12T02:35:54.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4173999999999997e-05 2020-06-12T02:35:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243856+0000", 2020-06-12T02:35:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000125909 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243981+0000", 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025715690000000001 2020-06-12T02:35:54.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246553+0000", 2020-06-12T02:35:54.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5254000000000007e-05 2020-06-12T02:35:54.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246648+0000", 2020-06-12T02:35:54.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001592483 2020-06-12T02:35:54.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248241+0000", 2020-06-12T02:35:54.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045813770000000002 2020-06-12T02:35:54.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252822+0000", 2020-06-12T02:35:54.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025664300000000002 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255389+0000", 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133926 2020-06-12T02:35:54.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255523+0000", 2020-06-12T02:35:54.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473 2020-06-12T02:35:54.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.784 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.784 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:415 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 3060489~200036] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:54.785 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:54.785 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.362389058, 2020-06-12T02:35:54.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996, 2020-06-12T02:35:54.785 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.786 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.786 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.786 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.787 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 415 2020-06-12T02:35:54.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.787 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:54.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052327099999999996 2020-06-12T02:35:54.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247836+0000", 2020-06-12T02:35:54.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6460000000000001e-05 2020-06-12T02:35:54.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247863+0000", 2020-06-12T02:35:54.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6666999999999998e-05 2020-06-12T02:35:54.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247919+0000", 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6555999999999999e-05 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247936+0000", 2020-06-12T02:35:54.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018652619999999999 2020-06-12T02:35:54.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249801+0000", 2020-06-12T02:35:54.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000228316 2020-06-12T02:35:54.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250029+0000", 2020-06-12T02:35:54.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014026869999999999 2020-06-12T02:35:54.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.251432+0000", 2020-06-12T02:35:54.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041290340000000002 2020-06-12T02:35:54.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255561+0000", 2020-06-12T02:35:54.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001052968 2020-06-12T02:35:54.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256614+0000", 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3012999999999999e-05 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256707+0000", 2020-06-12T02:35:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996 2020-06-12T02:35:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.800 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:416 1.4s0 1:2b9499a4:::smithi14213939-35:head [setxattr _header (57) in=7b,truncate 3260525] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.361601197000001, 2020-06-12T02:35:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999, 2020-06-12T02:35:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 416 2020-06-12T02:35:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017055999999999999 2020-06-12T02:35:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248271+0000", 2020-06-12T02:35:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5933999999999999e-05 2020-06-12T02:35:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248297+0000", 2020-06-12T02:35:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9759999999999998e-05 2020-06-12T02:35:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248347+0000", 2020-06-12T02:35:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4456e-05 2020-06-12T02:35:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248361+0000", 2020-06-12T02:35:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045179110000000003 2020-06-12T02:35:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252879+0000", 2020-06-12T02:35:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021748199999999999 2020-06-12T02:35:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253097+0000", 2020-06-12T02:35:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000829862 2020-06-12T02:35:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253927+0000", 2020-06-12T02:35:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028617040000000001 2020-06-12T02:35:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256788+0000", 2020-06-12T02:35:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020799640000000001 2020-06-12T02:35:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.258868+0000", 2020-06-12T02:35:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017190700000000001 2020-06-12T02:35:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259040+0000", 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:35:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.361245909999999, 2020-06-12T02:35:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:35:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:35:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:35:54.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:35:54.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:35:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:35:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:35:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:35:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:35:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:35:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:35:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:35:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:35:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:35:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:35:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:35:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:35:54.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:35:54.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:35:54.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:35:54.834 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.834 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.835 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:418 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.360843382000001, 2020-06-12T02:35:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468, 2020-06-12T02:35:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 418 2020-06-12T02:35:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022298000000000001 2020-06-12T02:35:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249082+0000", 2020-06-12T02:35:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.931e-05 2020-06-12T02:35:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249101+0000", 2020-06-12T02:35:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9820000000000002e-05 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249141+0000", 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3679999999999999e-05 2020-06-12T02:35:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249154+0000", 2020-06-12T02:35:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064441919999999996 2020-06-12T02:35:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255599+0000", 2020-06-12T02:35:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011178100000000001 2020-06-12T02:35:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255710+0000", 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071867049999999998 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.262897+0000", 2020-06-12T02:35:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468 2020-06-12T02:35:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:419 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.360370219, 2020-06-12T02:35:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999, 2020-06-12T02:35:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 419 2020-06-12T02:35:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000268977 2020-06-12T02:35:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249601+0000", 2020-06-12T02:35:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8689999999999999e-05 2020-06-12T02:35:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249619+0000", 2020-06-12T02:35:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9376999999999999e-05 2020-06-12T02:35:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249659+0000", 2020-06-12T02:35:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.821e-05 2020-06-12T02:35:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249677+0000", 2020-06-12T02:35:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064908220000000003 2020-06-12T02:35:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256168+0000", 2020-06-12T02:35:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4083000000000001e-05 2020-06-12T02:35:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256252+0000", 2020-06-12T02:35:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084599500000000008 2020-06-12T02:35:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.264712+0000", 2020-06-12T02:35:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999 2020-06-12T02:35:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.359828858, 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:35:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:35:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:35:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:35:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:35:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:35:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:35:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:35:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:35:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:35:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:35:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:35:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:35:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:35:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:465 1.4s0 1:2b9499a4:::smithi14213939-35:head [rollback c] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6790112920000002, 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994, 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 465 2020-06-12T02:35:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9047e-05 2020-06-12T02:35:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930740+0000", 2020-06-12T02:35:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5460000000000003e-06 2020-06-12T02:35:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930747+0000", 2020-06-12T02:35:54.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3519999999999999e-05 2020-06-12T02:35:54.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930761+0000", 2020-06-12T02:35:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6219999999999997e-06 2020-06-12T02:35:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930766+0000", 2020-06-12T02:35:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027740130000000001 2020-06-12T02:35:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933540+0000", 2020-06-12T02:35:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000194954 2020-06-12T02:35:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933735+0000", 2020-06-12T02:35:54.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094835199999999996 2020-06-12T02:35:54.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.934684+0000", 2020-06-12T02:35:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020709050000000001 2020-06-12T02:35:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936755+0000", 2020-06-12T02:35:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029704919999999999 2020-06-12T02:35:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939725+0000", 2020-06-12T02:35:54.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2645999999999994e-05 2020-06-12T02:35:54.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939808+0000", 2020-06-12T02:35:54.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994 2020-06-12T02:35:54.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.893 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:466 1.4s0 1:2b9499a4:::smithi14213939-35:head [append 0~0] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.6788888740000001, 2020-06-12T02:35:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632, 2020-06-12T02:35:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 466 2020-06-12T02:35:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.761e-05 2020-06-12T02:35:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930861+0000", 2020-06-12T02:35:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2320000000000004e-06 2020-06-12T02:35:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930868+0000", 2020-06-12T02:35:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3369e-05 2020-06-12T02:35:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930881+0000", 2020-06-12T02:35:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4280000000000004e-06 2020-06-12T02:35:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930887+0000", 2020-06-12T02:35:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048704559999999996 2020-06-12T02:35:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935757+0000", 2020-06-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012276 2020-06-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935880+0000", 2020-06-12T02:35:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052191100000000001 2020-06-12T02:35:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936402+0000", 2020-06-12T02:35:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028551010000000001 2020-06-12T02:35:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939257+0000", 2020-06-12T02:35:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030580550000000001 2020-06-12T02:35:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942315+0000", 2020-06-12T02:35:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4709999999999995e-05 2020-06-12T02:35:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942380+0000", 2020-06-12T02:35:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632 2020-06-12T02:35:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.914 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.ds2 43/18 ECSubWrite(tid=217, reqid=osd.2.0:217, at_version=43'81, trim_to=0'0, roll_forward_to=41'77))", 2020-06-12T02:35:54.914 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:54.914 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.6762239919999997, 2020-06-12T02:35:54.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081356540000000008, 2020-06-12T02:35:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933478+0000", 2020-06-12T02:35:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5704000000000004e-05 2020-06-12T02:35:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933574+0000", 2020-06-12T02:35:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5109999999999998e-05 2020-06-12T02:35:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933599+0000", 2020-06-12T02:35:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6912e-05 2020-06-12T02:35:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933616+0000", 2020-06-12T02:35:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1620000000000008e-06 2020-06-12T02:35:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.933624+0000", 2020-06-12T02:35:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000495014 2020-06-12T02:35:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.934119+0000", 2020-06-12T02:35:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7158000000000001e-05 2020-06-12T02:35:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.934136+0000", 2020-06-12T02:35:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074276059999999998 2020-06-12T02:35:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.941564+0000", 2020-06-12T02:35:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9988000000000003e-05 2020-06-12T02:35:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:49.941614+0000", 2020-06-12T02:35:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0081356540000000008 2020-06-12T02:35:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:535 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~2588245,checksum] snapc 0=[] ondisk+read+known_if_redirected e43)", 2020-06-12T02:35:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.5680547819999999, 2020-06-12T02:35:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076, 2020-06-12T02:35:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 535 2020-06-12T02:35:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019748300000000001 2020-06-12T02:35:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041845+0000", 2020-06-12T02:35:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7210999999999998e-05 2020-06-12T02:35:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041862+0000", 2020-06-12T02:35:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9805999999999999e-05 2020-06-12T02:35:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041892+0000", 2020-06-12T02:35:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7217000000000001e-05 2020-06-12T02:35:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041909+0000", 2020-06-12T02:35:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051008499999999997 2020-06-12T02:35:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042419+0000", 2020-06-12T02:35:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011063 2020-06-12T02:35:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042530+0000", 2020-06-12T02:35:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091386439999999996 2020-06-12T02:35:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.051668+0000", 2020-06-12T02:35:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076 2020-06-12T02:35:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.ds2 47/18 ECSubWrite(tid=235, reqid=client.4555.0:547, at_version=47'93, trim_to=0'0, roll_forward_to=46'91))", 2020-06-12T02:35:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.63182688499999995, 2020-06-12T02:35:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092340830000000006, 2020-06-12T02:35:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001654109 2020-06-12T02:35:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979529+0000", 2020-06-12T02:35:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7809000000000003e-05 2020-06-12T02:35:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979577+0000", 2020-06-12T02:35:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4306e-05 2020-06-12T02:35:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979611+0000", 2020-06-12T02:35:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6069000000000001e-05 2020-06-12T02:35:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979627+0000", 2020-06-12T02:35:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000173676 2020-06-12T02:35:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979801+0000", 2020-06-12T02:35:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5009999999999999e-05 2020-06-12T02:35:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979836+0000", 2020-06-12T02:35:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071243290000000004 2020-06-12T02:35:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.986960+0000", 2020-06-12T02:35:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000148775 2020-06-12T02:35:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.987109+0000", 2020-06-12T02:35:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092340830000000006 2020-06-12T02:35:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:54.957 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:54.959 INFO:tasks.rados.rados.0.smithi142.stdout:182: done (2 left) 2020-06-12T02:35:54.959 INFO:tasks.rados.rados.0.smithi142.stdout:183: rollback oid 50 current snap is 15 2020-06-12T02:35:54.959 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 50 to 14 2020-06-12T02:35:54.960 INFO:tasks.rados.rados.0.smithi142.stdout:184: snap_create 2020-06-12T02:35:54.960 INFO:tasks.rados.rados.0.smithi142.stdout:181: finishing rollback tid 0 to smithi14213939-6 2020-06-12T02:35:54.960 INFO:tasks.rados.rados.0.smithi142.stdout:181: finishing rollback tid 1 to smithi14213939-6 2020-06-12T02:35:54.961 INFO:tasks.rados.rados.0.smithi142.stdout:181: finishing rollback tid 2 to smithi14213939-6 2020-06-12T02:35:54.961 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 95 (ObjNum 69 snap 9 seq_num 69) dirty exists 2020-06-12T02:35:54.961 INFO:tasks.rados.rados.0.smithi142.stdout:180: finishing copy_from to smithi14213939-5 2020-06-12T02:35:54.961 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 5 v 69 (ObjNum 88 snap 13 seq_num 88) dirty exists 2020-06-12T02:35:54.961 INFO:tasks.rados.rados.0.smithi142.stdout:180: finishing copy_from racing read to smithi14213939-5 2020-06-12T02:35:54.962 INFO:tasks.rados.rados.0.smithi142.stdout:183: finishing rollback tid 1 to smithi14213939-50 2020-06-12T02:35:54.962 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 50 v 36 (ObjNum -442844848 snap 21999 seq_num 3851699360) dirty dne 2020-06-12T02:35:54.962 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.5 to 1 (10000) 2020-06-12T02:35:54.962 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:54.940+0000 7fcd48611700 -1 osd.1 pg_epoch: 48 pg[1.7s0( v 47'95 (0'0,47'95] local-lis/les=18/19 n=9 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) [1,6,2]p1(0) r=0 lpr=18 crt=47'95 lcod 47'94 mlcod 47'94 active+clean+snaptrim trimq=[11~1] ps=[a~1,14~1,18~1]] removing snap head 2020-06-12T02:35:54.963 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 6 1 2020-06-12T02:35:54.964 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:54.959+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:54.965 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:55.060 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:55.058+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:55.104 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:55.088+0000 7f61b7f3c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:55.109 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:55.104+0000 7f61b6cda700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:55.109 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:55.110 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:55.122 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:55.175 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:55.172+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:55.230 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:55.231 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:55.239 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:55.274 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:55.262+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:55.365 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:55.366+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:55.390 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:55.390 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:55.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:55.391 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:55.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.391 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:55.392 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:55.392 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.289049479999999, 2020-06-12T02:35:55.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:35:55.392 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.392 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:35:55.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.394 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:55.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:55.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:35:55.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:35:55.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:35:55.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:35:55.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:35:55.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:35:55.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:35:55.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:35:55.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:35:55.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:35:55.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:35:55.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:35:55.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:35:55.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:35:55.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:35:55.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:35:55.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:35:55.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:35:55.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:35:55.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.407 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:35:55.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:55.408 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.288879113, 2020-06-12T02:35:55.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:35:55.408 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.408 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:55.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:35:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:55.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:35:55.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:35:55.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:35:55.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:35:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:35:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:35:55.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:35:55.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:35:55.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:35:55.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:35:55.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:55.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:35:55.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:35:55.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:35:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:35:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:35:55.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:35:55.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.423 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:208 1.2s0 1:40342bec:::smithi14213939-47:head [write 440350~460568] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:55.423 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.277358883000002, 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998, 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 208 2020-06-12T02:35:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:55.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000287497 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109447+0000", 2020-06-12T02:35:55.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6830000000000002e-06 2020-06-12T02:35:55.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109453+0000", 2020-06-12T02:35:55.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6283e-05 2020-06-12T02:35:55.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109470+0000", 2020-06-12T02:35:55.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0479999999999998e-06 2020-06-12T02:35:55.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109475+0000", 2020-06-12T02:35:55.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6121e-05 2020-06-12T02:35:55.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109531+0000", 2020-06-12T02:35:55.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114108 2020-06-12T02:35:55.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109645+0000", 2020-06-12T02:35:55.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035523009999999999 2020-06-12T02:35:55.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.113197+0000", 2020-06-12T02:35:55.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013270552 2020-06-12T02:35:55.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126468+0000", 2020-06-12T02:35:55.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023953399999999999 2020-06-12T02:35:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126707+0000", 2020-06-12T02:35:55.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013569499999999999 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126843+0000", 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998 2020-06-12T02:35:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:55.439 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:55.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.270741086000001, 2020-06-12T02:35:55.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:35:55.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:35:55.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:35:55.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:35:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:35:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:35:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:35:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:35:55.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:35:55.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:35:55.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:35:55.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:35:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:35:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:35:55.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:35:55.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:35:55.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:35:55.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:35:55.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:35:55.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.453 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.264804203000001, 2020-06-12T02:35:55.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:35:55.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.456 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:35:55.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.456 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:55.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:35:55.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:35:55.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:35:55.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:35:55.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:35:55.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:35:55.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:35:55.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:35:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:35:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:35:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:35:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:35:55.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:35:55.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:35:55.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:35:55.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:35:55.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:35:55.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:35:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:35:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.264295132000001, 2020-06-12T02:35:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.471 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:35:55.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.472 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:55.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:55.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:35:55.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:35:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:35:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:35:55.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:35:55.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:35:55.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:35:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:35:55.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:35:55.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:35:55.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:35:55.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:35:55.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:35:55.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:35:55.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.484 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:35:55.484 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:55.485 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.264136866000001, 2020-06-12T02:35:55.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:35:55.485 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.485 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:55.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.486 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:35:55.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.487 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:55.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:35:55.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:35:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:35:55.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:35:55.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:35:55.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:35:55.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:35:55.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:35:55.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:35:55.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:298 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.209119292, 2020-06-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982, 2020-06-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 298 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2509999999999995e-05 2020-06-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177471+0000", 2020-06-12T02:35:55.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5789999999999993e-06 2020-06-12T02:35:55.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177481+0000", 2020-06-12T02:35:55.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:35:55.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177499+0000", 2020-06-12T02:35:55.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0701e-05 2020-06-12T02:35:55.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177509+0000", 2020-06-12T02:35:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057272240000000004 2020-06-12T02:35:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183237+0000", 2020-06-12T02:35:55.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018898499999999999 2020-06-12T02:35:55.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183426+0000", 2020-06-12T02:35:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00076048100000000003 2020-06-12T02:35:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.184186+0000", 2020-06-12T02:35:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037303620000000001 2020-06-12T02:35:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.187916+0000", 2020-06-12T02:35:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032542600000000001 2020-06-12T02:35:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191171+0000", 2020-06-12T02:35:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5078999999999999e-05 2020-06-12T02:35:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191226+0000", 2020-06-12T02:35:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.519 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:320 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~2117649] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.098147055999998, 2020-06-12T02:35:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0127136, 2020-06-12T02:35:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:55.521 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.521 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.521 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.521 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 320 2020-06-12T02:35:55.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9022e-05 2020-06-12T02:35:55.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288410+0000", 2020-06-12T02:35:55.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6389999999999997e-06 2020-06-12T02:35:55.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288416+0000", 2020-06-12T02:35:55.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0268999999999999e-05 2020-06-12T02:35:55.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288426+0000", 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4349999999999999e-06 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288430+0000", 2020-06-12T02:35:55.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044584389999999998 2020-06-12T02:35:55.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.292889+0000", 2020-06-12T02:35:55.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012272300000000001 2020-06-12T02:35:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.293012+0000", 2020-06-12T02:35:55.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080730730000000001 2020-06-12T02:35:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301085+0000", 2020-06-12T02:35:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0127136 2020-06-12T02:35:55.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.531 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.189740064, 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.532 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.533 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.533 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.533 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.533 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:35:55.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.534 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:55.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:55.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:35:55.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:35:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:35:55.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:35:55.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:35:55.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:35:55.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:35:55.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:35:55.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:35:55.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:35:55.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:35:55.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:35:55.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:35:55.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:35:55.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:35:55.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:35:55.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:35:55.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.549 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:451 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 2941380~419987] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:55.549 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:55.549 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.183380861, 2020-06-12T02:35:55.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001, 2020-06-12T02:35:55.550 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.550 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.551 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.551 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.551 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.551 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 451 2020-06-12T02:35:55.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:55.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000289315 2020-06-12T02:35:55.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203427+0000", 2020-06-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3359999999999995e-06 2020-06-12T02:35:55.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203435+0000", 2020-06-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9905999999999999e-05 2020-06-12T02:35:55.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203455+0000", 2020-06-12T02:35:55.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2639999999999997e-06 2020-06-12T02:35:55.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203464+0000", 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046779599999999998 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203932+0000", 2020-06-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1891999999999994e-05 2020-06-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204024+0000", 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069815440000000001 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.211005+0000", 2020-06-12T02:35:55.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036673360000000002 2020-06-12T02:35:55.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214673+0000", 2020-06-12T02:35:55.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077744160000000001 2020-06-12T02:35:55.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222447+0000", 2020-06-12T02:35:55.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129228 2020-06-12T02:35:55.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222576+0000", 2020-06-12T02:35:55.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001 2020-06-12T02:35:55.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:452 1.2s0 1:4fe4d12b:::smithi14213939-34:head [setxattr _header (57) in=7b,truncate 3361367] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.182931180000001, 2020-06-12T02:35:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001, 2020-06-12T02:35:55.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.568 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.568 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.568 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 452 2020-06-12T02:35:55.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:55.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:55.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107166 2020-06-12T02:35:55.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203694+0000", 2020-06-12T02:35:55.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2969999999999992e-06 2020-06-12T02:35:55.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203703+0000", 2020-06-12T02:35:55.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7147e-05 2020-06-12T02:35:55.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203721+0000", 2020-06-12T02:35:55.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4060000000000002e-06 2020-06-12T02:35:55.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203727+0000", 2020-06-12T02:35:55.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557648 2020-06-12T02:35:55.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204285+0000", 2020-06-12T02:35:55.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013640700000000001 2020-06-12T02:35:55.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204421+0000", 2020-06-12T02:35:55.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080134209999999997 2020-06-12T02:35:55.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212434+0000", 2020-06-12T02:35:55.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002242675 2020-06-12T02:35:55.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214677+0000", 2020-06-12T02:35:55.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080765639999999996 2020-06-12T02:35:55.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222754+0000", 2020-06-12T02:35:55.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016176999999999999 2020-06-12T02:35:55.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222915+0000", 2020-06-12T02:35:55.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001 2020-06-12T02:35:55.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.586 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:35:55.586 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:55.586 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.182729242000001, 2020-06-12T02:35:55.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:35:55.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.588 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:55.588 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.588 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.588 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.588 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:35:55.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.589 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:55.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:55.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:35:55.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:35:55.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:35:55.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:35:55.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:35:55.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:35:55.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:35:55.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:35:55.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:35:55.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:35:55.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:35:55.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:55.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:35:55.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:35:55.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:35:55.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:35:55.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:35:55.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:35:55.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:35:55.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:35:55.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.602 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.603 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:522 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 695823~777044] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:55.603 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:55.604 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.4532452989999998, 2020-06-12T02:35:55.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001, 2020-06-12T02:35:55.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.604 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.604 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.605 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.605 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.605 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 522 2020-06-12T02:35:55.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.606 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:55.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:55.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056703400000000001 2020-06-12T02:35:55.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933840+0000", 2020-06-12T02:35:55.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0903e-05 2020-06-12T02:35:55.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933851+0000", 2020-06-12T02:35:55.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6198e-05 2020-06-12T02:35:55.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933867+0000", 2020-06-12T02:35:55.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:35:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933875+0000", 2020-06-12T02:35:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9525999999999997e-05 2020-06-12T02:35:55.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933955+0000", 2020-06-12T02:35:55.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0988000000000001e-05 2020-06-12T02:35:55.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:35:55.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933966+0000", 2020-06-12T02:35:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036756929999999998 2020-06-12T02:35:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937641+0000", 2020-06-12T02:35:55.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013941800000000001 2020-06-12T02:35:55.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937781+0000", 2020-06-12T02:35:55.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074804579999999997 2020-06-12T02:35:55.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.945261+0000", 2020-06-12T02:35:55.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044656610000000001 2020-06-12T02:35:55.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949727+0000", 2020-06-12T02:35:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036480600000000002 2020-06-12T02:35:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950092+0000", 2020-06-12T02:35:55.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105678 2020-06-12T02:35:55.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950197+0000", 2020-06-12T02:35:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001 2020-06-12T02:35:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.624 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.624 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:523 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 1925015~639682] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:55.625 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:55.625 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.4438967429999998, 2020-06-12T02:35:55.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272, 2020-06-12T02:35:55.625 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.625 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.626 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 523 2020-06-12T02:35:55.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.627 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:55.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032343600000000003 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942945+0000", 2020-06-12T02:35:55.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1165000000000001e-05 2020-06-12T02:35:55.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942956+0000", 2020-06-12T02:35:55.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7815000000000001e-05 2020-06-12T02:35:55.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942974+0000", 2020-06-12T02:35:55.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1079999999999999e-06 2020-06-12T02:35:55.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942983+0000", 2020-06-12T02:35:55.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.198e-05 2020-06-12T02:35:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943045+0000", 2020-06-12T02:35:55.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015003600000000001 2020-06-12T02:35:55.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943195+0000", 2020-06-12T02:35:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012239308000000001 2020-06-12T02:35:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.955434+0000", 2020-06-12T02:35:55.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031130979999999999 2020-06-12T02:35:55.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.958547+0000", 2020-06-12T02:35:55.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021421489999999999 2020-06-12T02:35:55.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960689+0000", 2020-06-12T02:35:55.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7176999999999996e-05 2020-06-12T02:35:55.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960777+0000", 2020-06-12T02:35:55.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272 2020-06-12T02:35:55.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.643 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:524 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 3328058~167765] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:55.644 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:55.644 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.43819623, 2020-06-12T02:35:55.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478, 2020-06-12T02:35:55.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.645 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.645 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.645 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.646 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.646 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 524 2020-06-12T02:35:55.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:55.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:55.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027316900000000003 2020-06-12T02:35:55.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948595+0000", 2020-06-12T02:35:55.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4909999999999994e-06 2020-06-12T02:35:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948605+0000", 2020-06-12T02:35:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5495999999999999e-05 2020-06-12T02:35:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948620+0000", 2020-06-12T02:35:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9129999999999997e-06 2020-06-12T02:35:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948627+0000", 2020-06-12T02:35:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025216099999999999 2020-06-12T02:35:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948879+0000", 2020-06-12T02:35:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014658800000000001 2020-06-12T02:35:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949026+0000", 2020-06-12T02:35:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083404719999999998 2020-06-12T02:35:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.957366+0000", 2020-06-12T02:35:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029182449999999999 2020-06-12T02:35:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960284+0000", 2020-06-12T02:35:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069633399999999995 2020-06-12T02:35:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960981+0000", 2020-06-12T02:35:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0608999999999999e-05 2020-06-12T02:35:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961071+0000", 2020-06-12T02:35:55.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478 2020-06-12T02:35:55.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:525 1.2s0 1:4edac3c4:::smithi14213939-9:head [setxattr _header (56) in=7b,truncate 3495823] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:55.669 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.4378307960000001, 2020-06-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012698869999999999, 2020-06-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.671 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.671 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 525 2020-06-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:55.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6369e-05 2020-06-12T02:35:55.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948764+0000", 2020-06-12T02:35:55.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1419999999999993e-06 2020-06-12T02:35:55.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948772+0000", 2020-06-12T02:35:55.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3851e-05 2020-06-12T02:35:55.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948786+0000", 2020-06-12T02:35:55.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3289999999999999e-06 2020-06-12T02:35:55.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948792+0000", 2020-06-12T02:35:55.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059115199999999995 2020-06-12T02:35:55.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949383+0000", 2020-06-12T02:35:55.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011080499999999999 2020-06-12T02:35:55.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949494+0000", 2020-06-12T02:35:55.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086590039999999997 2020-06-12T02:35:55.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.958153+0000", 2020-06-12T02:35:55.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002973144 2020-06-12T02:35:55.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961126+0000", 2020-06-12T02:35:55.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013955 2020-06-12T02:35:55.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961266+0000", 2020-06-12T02:35:55.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120524 2020-06-12T02:35:55.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961386+0000", 2020-06-12T02:35:55.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012698869999999999 2020-06-12T02:35:55.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:526 1.2s0 1:4edac3c4:::smithi14213939-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e43)", 2020-06-12T02:35:55.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:55.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.4376740300000002, 2020-06-12T02:35:55.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001, 2020-06-12T02:35:55.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:55.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.697 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 526 2020-06-12T02:35:55.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.697 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:55.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:55.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6243999999999999e-05 2020-06-12T02:35:55.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948900+0000", 2020-06-12T02:35:55.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4939999999999997e-06 2020-06-12T02:35:55.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948908+0000", 2020-06-12T02:35:55.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3456e-05 2020-06-12T02:35:55.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948921+0000", 2020-06-12T02:35:55.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8409999999999996e-06 2020-06-12T02:35:55.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948927+0000", 2020-06-12T02:35:55.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0009970039999999999 2020-06-12T02:35:55.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949924+0000", 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4784999999999996e-05 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:55.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949999+0000", 2020-06-12T02:35:55.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012073782 2020-06-12T02:35:55.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962073+0000", 2020-06-12T02:35:55.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132726 2020-06-12T02:35:55.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962205+0000", 2020-06-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010140240000000001 2020-06-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.963219+0000", 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:538 1.2s0 1:40a24690:::smithi14213939-8:head [write 729437~527542] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:35:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4383042069999998, 2020-06-12T02:35:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001, 2020-06-12T02:35:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 538 2020-06-12T02:35:55.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.721 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:55.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:55.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031614799999999998 2020-06-12T02:35:55.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948530+0000", 2020-06-12T02:35:55.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6116e-05 2020-06-12T02:35:55.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948546+0000", 2020-06-12T02:35:55.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4805999999999999e-05 2020-06-12T02:35:55.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948571+0000", 2020-06-12T02:35:55.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4479e-05 2020-06-12T02:35:55.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948585+0000", 2020-06-12T02:35:55.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9798999999999998e-05 2020-06-12T02:35:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948685+0000", 2020-06-12T02:35:55.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018751 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948873+0000", 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056200729999999997 2020-06-12T02:35:55.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.954493+0000", 2020-06-12T02:35:55.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050674220000000002 2020-06-12T02:35:55.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959560+0000", 2020-06-12T02:35:55.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036640399999999999 2020-06-12T02:35:55.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963224+0000", 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111121 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963335+0000", 2020-06-12T02:35:55.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001 2020-06-12T02:35:55.732 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.732 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.733 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.733 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:539 1.2s0 1:40a24690:::smithi14213939-8:head [write 1925626~643351] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:35:55.733 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:55.734 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4279815500000002, 2020-06-12T02:35:55.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379, 2020-06-12T02:35:55.734 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:55.734 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:55.734 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:55.735 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:55.735 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:55.735 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 539 2020-06-12T02:35:55.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.735 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:55.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:55.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:55.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:55.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000305001 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:55.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958842+0000", 2020-06-12T02:35:55.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8190000000000003e-06 2020-06-12T02:35:55.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:55.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958851+0000", 2020-06-12T02:35:55.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2416999999999999e-05 2020-06-12T02:35:55.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958874+0000", 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4691999999999999e-05 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958888+0000", 2020-06-12T02:35:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018018600000000001 2020-06-12T02:35:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959069+0000", 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017349999999999999 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:55.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959242+0000", 2020-06-12T02:35:55.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091864670000000002 2020-06-12T02:35:55.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:55.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.968429+0000", 2020-06-12T02:35:55.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059461899999999996 2020-06-12T02:35:55.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:55.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974375+0000", 2020-06-12T02:35:55.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042622100000000001 2020-06-12T02:35:55.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:55.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974801+0000", 2020-06-12T02:35:55.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9296999999999996e-05 2020-06-12T02:35:55.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:55.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:55.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:55.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974890+0000", 2020-06-12T02:35:55.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379 2020-06-12T02:35:55.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.749 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:55.750 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:55.750 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:55.751 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:35:55.754 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:55.748+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:55.754 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:55.853 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:55.854+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:55.908 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:55.909 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:55.910 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:55.910 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:55.916 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:55.908+0000 7f4be5573700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:55.917 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:35:55.919 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:55.912+0000 7f4bdffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:55.938 INFO:tasks.rados.rados.0.smithi142.stdout:180: done (3 left) 2020-06-12T02:35:55.938 INFO:tasks.rados.rados.0.smithi142.stdout:181: done (2 left) 2020-06-12T02:35:55.938 INFO:tasks.rados.rados.0.smithi142.stdout:183: done (1 left) 2020-06-12T02:35:55.938 INFO:tasks.rados.rados.0.smithi142.stdout:184: done (0 left) 2020-06-12T02:35:55.939 INFO:tasks.rados.rados.0.smithi142.stdout:185: read oid 15 snap -1 2020-06-12T02:35:55.939 INFO:tasks.rados.rados.0.smithi142.stdout:185: expect deleted 2020-06-12T02:35:55.939 INFO:tasks.rados.rados.0.smithi142.stdout:186: rollback oid 30 current snap is 16 2020-06-12T02:35:55.939 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 30 to 12 2020-06-12T02:35:55.939 INFO:tasks.rados.rados.0.smithi142.stdout:187: snap_create 2020-06-12T02:35:55.941 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.6 to 1 (10000) 2020-06-12T02:35:55.950 INFO:tasks.rados.rados.0.smithi142.stdout:186: finishing rollback tid 0 to smithi14213939-30 2020-06-12T02:35:55.951 INFO:tasks.rados.rados.0.smithi142.stdout:186: finishing rollback tid 1 to smithi14213939-30 2020-06-12T02:35:55.951 INFO:tasks.rados.rados.0.smithi142.stdout:186: finishing rollback tid 2 to smithi14213939-30 2020-06-12T02:35:55.952 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 46 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-06-12T02:35:55.952 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:55.954 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 7 1 2020-06-12T02:35:55.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:55.954+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:55.975 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:56.003 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:56.024 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:56.046 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:56.054 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.054 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.059 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:56.052+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:56.072 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:56.073 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:35:56.100 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:56.122 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:35:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:56.092+0000 7f12b3bbd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:56.112+0000 7f12b295b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:56.128 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:35:56.162 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:56.158+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:56.215 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.216 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.226 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:35:56.228 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:56.216+0000 7f1e17a25700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:56.230 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:56.224+0000 7f1e167c3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:56.259 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:56.252+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:56.363 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:56.362+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:56.365 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.366 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.381 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:35:56.472 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:56.468+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:56.542 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.543 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.552 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:35:56.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:56.562+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:56.668 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:56.666+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:56.711 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.712 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.742 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:35:56.768 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:56.766+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:56.860 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.860 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.872 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:56.870+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:56.872 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:35:56.944 INFO:tasks.rados.rados.0.smithi142.stdout:185: done (2 left) 2020-06-12T02:35:56.944 INFO:tasks.rados.rados.0.smithi142.stdout:186: done (1 left) 2020-06-12T02:35:56.945 INFO:tasks.rados.rados.0.smithi142.stdout:187: done (0 left) 2020-06-12T02:35:56.945 INFO:tasks.rados.rados.0.smithi142.stdout:188: read oid 23 snap -1 2020-06-12T02:35:56.945 INFO:tasks.rados.rados.0.smithi142.stdout:188: expect deleted 2020-06-12T02:35:56.946 INFO:tasks.rados.rados.0.smithi142.stdout:189: snap_create 2020-06-12T02:35:56.948 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:35:56.953 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.7 to 1 (10000) 2020-06-12T02:35:56.961 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2020-06-12T02:35:56.961 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:56.973 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:56.974+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:56.987 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:56.987 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:56.999 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:35:57.053 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.047+0000 7f673da68700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.058 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.055+0000 7f673c806700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.074 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:57.073+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:57.148 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.149 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.158 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:35:57.207 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:57.205+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:57.226 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:57.235 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2020-06-12T02:35:56.936927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":151688034,"num_objects":63,"num_object_clones":18,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":5,"num_read":295,"num_read_kb":236862,"num_write":395,"num_write_kb":132360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8626332,"kb_used_data":237660,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746348388,"statfs":{"total":773094113280,"available":764260749312,"internally_reserved":8589934592,"allocated":243363840,"data_stored":278916926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19460994,"num_objects":-11,"num_object_clones":-9,"num_object_copies":-33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":1,"num_read":17,"num_read_kb":23201,"num_write":16,"num_write_kb":6348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.995514"},"pg_stats":[{"pgid":"1.f","version":"21'6","reported_seq":"102","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.923285+0000","last_change":"2020-06-12T02:35:54.925738+0000","last_active":"2020-06-12T02:35:54.923285+0000","last_peered":"2020-06-12T02:35:54.923285+0000","last_clean":"2020-06-12T02:35:54.923285+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:35:54.923285+0000","last_undegraded":"2020-06-12T02:35:54.923285+0000","last_fullsized":"2020-06-12T02:35:54.923285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5092455,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":7834,"num_write":8,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.e","version":"43'38","reported_seq":"130","reported_epoch":"46","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:52.976864+0000","last_change":"2020-06-12T02:35:52.976907+0000","last_active":"2020-06-12T02:35:52.976864+0000","last_peered":"2020-06-12T02:35:52.976864+0000","last_clean":"2020-06-12T02:35:52.976864+0000","last_became_active":"2020-06-12T02:35:25.071798+0000","last_became_peered":"2020-06-12T02:35:25.071798+0000","last_unstale":"2020-06-12T02:35:52.976864+0000","last_undegraded":"2020-06-12T02:35:52.976864+0000","last_fullsized":"2020-06-12T02:35:52.976864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":9866099,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":30096,"num_write":27,"num_write_kb":6221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"2"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.d","version":"48'99","reported_seq":"195","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.945235+0000","last_change":"2020-06-12T02:35:54.946300+0000","last_active":"2020-06-12T02:35:54.945235+0000","last_peered":"2020-06-12T02:35:54.945235+0000","last_clean":"2020-06-12T02:35:54.945235+0000","last_became_active":"2020-06-12T02:35:25.081562+0000","last_became_peered":"2020-06-12T02:35:25.081562+0000","last_unstale":"2020-06-12T02:35:54.945235+0000","last_undegraded":"2020-06-12T02:35:54.945235+0000","last_fullsized":"2020-06-12T02:35:54.945235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":99,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22295516,"num_objects":8,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":24934,"num_write":51,"num_write_kb":22594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.c","version":"46'23","reported_seq":"111","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.935009+0000","last_change":"2020-06-12T02:35:54.935621+0000","last_active":"2020-06-12T02:35:54.935009+0000","last_peered":"2020-06-12T02:35:54.935009+0000","last_clean":"2020-06-12T02:35:54.935009+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:35:54.935009+0000","last_undegraded":"2020-06-12T02:35:54.935009+0000","last_fullsized":"2020-06-12T02:35:54.935009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.b","version":"34'31","reported_seq":"123","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.951159+0000","last_change":"2020-06-12T02:35:52.952245+0000","last_active":"2020-06-12T02:35:52.951159+0000","last_peered":"2020-06-12T02:35:52.951159+0000","last_clean":"2020-06-12T02:35:52.951159+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:35:52.951159+0000","last_undegraded":"2020-06-12T02:35:52.951159+0000","last_fullsized":"2020-06-12T02:35:52.951159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5815156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":25865,"num_write":23,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"92","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.952919+0000","last_change":"2020-06-12T02:35:52.953334+0000","last_active":"2020-06-12T02:35:52.952919+0000","last_peered":"2020-06-12T02:35:52.952919+0000","last_clean":"2020-06-12T02:35:52.952919+0000","last_became_active":"2020-06-12T02:35:25.072055+0000","last_became_peered":"2020-06-12T02:35:25.072055+0000","last_unstale":"2020-06-12T02:35:52.952919+0000","last_undegraded":"2020-06-12T02:35:52.952919+0000","last_fullsized":"2020-06-12T02:35:52.952919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.9","version":"46'45","reported_seq":"126","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.975135+0000","last_change":"2020-06-12T02:35:52.976044+0000","last_active":"2020-06-12T02:35:52.975135+0000","last_peered":"2020-06-12T02:35:52.975135+0000","last_clean":"2020-06-12T02:35:52.975135+0000","last_became_active":"2020-06-12T02:35:25.070746+0000","last_became_peered":"2020-06-12T02:35:25.070746+0000","last_unstale":"2020-06-12T02:35:52.975135+0000","last_undegraded":"2020-06-12T02:35:52.975135+0000","last_fullsized":"2020-06-12T02:35:52.975135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10924418,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":10,"num_read_kb":5,"num_write":25,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.8","version":"34'21","reported_seq":"106","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.976183+0000","last_change":"2020-06-12T02:35:52.976613+0000","last_active":"2020-06-12T02:35:52.976183+0000","last_peered":"2020-06-12T02:35:52.976183+0000","last_clean":"2020-06-12T02:35:52.976183+0000","last_became_active":"2020-06-12T02:35:25.073650+0000","last_became_peered":"2020-06-12T02:35:25.073650+0000","last_unstale":"2020-06-12T02:35:52.976183+0000","last_undegraded":"2020-06-12T02:35:52.976183+0000","last_fullsized":"2020-06-12T02:35:52.976183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5663893,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":8033,"num_write":14,"num_write_kb":6175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.7","version":"46'91","reported_seq":"174","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.986704+0000","last_change":"2020-06-12T02:35:52.990345+0000","last_active":"2020-06-12T02:35:52.986704+0000","last_peered":"2020-06-12T02:35:52.986704+0000","last_clean":"2020-06-12T02:35:52.986704+0000","last_became_active":"2020-06-12T02:35:25.075901+0000","last_became_peered":"2020-06-12T02:35:25.075901+0000","last_unstale":"2020-06-12T02:35:52.986704+0000","last_undegraded":"2020-06-12T02:35:52.986704+0000","last_fullsized":"2020-06-12T02:35:52.986704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":91,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16114897,"num_objects":8,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":33,"num_read_kb":22274,"num_write":45,"num_write_kb":17204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.6","version":"34'26","reported_seq":"114","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.923978+0000","last_change":"2020-06-12T02:35:54.925311+0000","last_active":"2020-06-12T02:35:54.923978+0000","last_peered":"2020-06-12T02:35:54.923978+0000","last_clean":"2020-06-12T02:35:54.923978+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:35:54.923978+0000","last_undegraded":"2020-06-12T02:35:54.923978+0000","last_fullsized":"2020-06-12T02:35:54.923978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4672280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":13,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.1","version":"34'11","reported_seq":"110","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.925664+0000","last_change":"2020-06-12T02:35:54.926201+0000","last_active":"2020-06-12T02:35:54.925664+0000","last_peered":"2020-06-12T02:35:54.925664+0000","last_clean":"2020-06-12T02:35:54.925664+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:35:54.925664+0000","last_undegraded":"2020-06-12T02:35:54.925664+0000","last_fullsized":"2020-06-12T02:35:54.925664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2689087,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":23941,"num_write":5,"num_write_kb":3970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"80","reported_epoch":"46","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:52.990396+0000","last_change":"2020-06-12T02:35:52.990449+0000","last_active":"2020-06-12T02:35:52.990396+0000","last_peered":"2020-06-12T02:35:52.990396+0000","last_clean":"2020-06-12T02:35:52.990396+0000","last_became_active":"2020-06-12T02:35:25.069671+0000","last_became_peered":"2020-06-12T02:35:25.069671+0000","last_unstale":"2020-06-12T02:35:52.990396+0000","last_undegraded":"2020-06-12T02:35:52.990396+0000","last_fullsized":"2020-06-12T02:35:52.990396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"2"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.2","version":"48'117","reported_seq":"199","reported_epoch":"48","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:54.937438+0000","last_change":"2020-06-12T02:35:54.937438+0000","last_active":"2020-06-12T02:35:54.937438+0000","last_peered":"2020-06-12T02:35:54.937438+0000","last_clean":"2020-06-12T02:35:54.937438+0000","last_became_active":"2020-06-12T02:35:25.074852+0000","last_became_peered":"2020-06-12T02:35:25.074852+0000","last_unstale":"2020-06-12T02:35:54.937438+0000","last_undegraded":"2020-06-12T02:35:54.937438+0000","last_fullsized":"2020-06-12T02:35:54.937438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":20084276,"num_objects":8,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":6220,"num_write":64,"num_write_kb":20169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.3","version":"46'40","reported_seq":"138","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.956424+0000","last_change":"2020-06-12T02:35:52.957082+0000","last_active":"2020-06-12T02:35:52.956424+0000","last_peered":"2020-06-12T02:35:52.956424+0000","last_clean":"2020-06-12T02:35:52.956424+0000","last_became_active":"2020-06-12T02:35:25.070276+0000","last_became_peered":"2020-06-12T02:35:25.070276+0000","last_unstale":"2020-06-12T02:35:52.956424+0000","last_undegraded":"2020-06-12T02:35:52.956424+0000","last_fullsized":"2020-06-12T02:35:52.956424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":40,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14588278,"num_objects":7,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":31,"num_read_kb":29958,"num_write":31,"num_write_kb":7719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.4","version":"46'42","reported_seq":"151","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.933669+0000","last_change":"2020-06-12T02:35:54.934150+0000","last_active":"2020-06-12T02:35:54.933669+0000","last_peered":"2020-06-12T02:35:54.933669+0000","last_clean":"2020-06-12T02:35:54.933669+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:35:54.933669+0000","last_undegraded":"2020-06-12T02:35:54.933669+0000","last_fullsized":"2020-06-12T02:35:54.933669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13764768,"num_objects":5,"num_object_clones":1,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":44144,"num_write":30,"num_write_kb":7492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.5","version":"48'79","reported_seq":"174","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.933970+0000","last_change":"2020-06-12T02:35:54.934814+0000","last_active":"2020-06-12T02:35:54.933970+0000","last_peered":"2020-06-12T02:35:54.933970+0000","last_clean":"2020-06-12T02:35:54.933970+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:35:54.933970+0000","last_undegraded":"2020-06-12T02:35:54.933970+0000","last_fullsized":"2020-06-12T02:35:54.933970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17730350,"num_objects":6,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":6560,"num_write":47,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":151688034,"num_objects":63,"num_object_clones":18,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":5,"num_read":295,"num_read_kb":236862,"num_write":395,"num_write_kb":132360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":230326272,"data_stored":264642560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069640,"kb_used_data":21056,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93302200,"statfs":{"total":96636764160,"available":95541452800,"internally_reserved":1073741824,"allocated":21561344,"data_stored":22728717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2029999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1075756,"kb_used_data":27172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296084,"statfs":{"total":96636764160,"available":95535190016,"internally_reserved":1073741824,"allocated":27824128,"data_stored":30824735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4689999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8889999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.427}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1090960,"kb_used_data":42376,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280880,"statfs":{"total":96636764160,"available":95519621120,"internally_reserved":1073741824,"allocated":43393024,"data_stored":51503609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1720000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8210000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.105}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105396,"kb_used_data":56812,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93266444,"statfs":{"total":96636764160,"available":95504838656,"internally_reserved":1073741824,"allocated":58175488,"data_stored":70803961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7530000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.613}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1059492,"kb_used_data":10908,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93312348,"statfs":{"total":96636764160,"available":95551844352,"internally_reserved":1073741824,"allocated":11169792,"data_stored":10875385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9220000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0419999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1950000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072892,"kb_used_data":24308,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298948,"statfs":{"total":96636764160,"available":95538122752,"internally_reserved":1073741824,"allocated":24891392,"data_stored":29327373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.827}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.742}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4249999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088328,"kb_used_data":39744,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283512,"statfs":{"total":96636764160,"available":95522316288,"internally_reserved":1073741824,"allocated":40697856,"data_stored":46747661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.925}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8650000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1909999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7309999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1063868,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93307972,"statfs":{"total":96636764160,"available":95547363328,"internally_reserved":1073741824,"allocated":15650816,"data_stored":16105485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5089999999999999}]}]}]}} 2020-06-12T02:35:57.240 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:35:57.265 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.265 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.274 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:35:57.297 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:57.295+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:57.355 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.343+0000 7f9798f95700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.359 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.355+0000 7f979359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.378 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:57.375+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:57.426 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.426 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.435 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:35:57.479 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:57.475+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:35:57.519 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:35:57.528 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2020-06-12T02:35:56.936927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":151688034,"num_objects":63,"num_object_clones":18,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":5,"num_read":295,"num_read_kb":236862,"num_write":395,"num_write_kb":132360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8626332,"kb_used_data":237660,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746348388,"statfs":{"total":773094113280,"available":764260749312,"internally_reserved":8589934592,"allocated":243363840,"data_stored":278916926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19460994,"num_objects":-11,"num_object_clones":-9,"num_object_copies":-33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":1,"num_read":17,"num_read_kb":23201,"num_write":16,"num_write_kb":6348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.995514"},"pg_stats":[{"pgid":"1.f","version":"21'6","reported_seq":"102","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.923285+0000","last_change":"2020-06-12T02:35:54.925738+0000","last_active":"2020-06-12T02:35:54.923285+0000","last_peered":"2020-06-12T02:35:54.923285+0000","last_clean":"2020-06-12T02:35:54.923285+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:35:54.923285+0000","last_undegraded":"2020-06-12T02:35:54.923285+0000","last_fullsized":"2020-06-12T02:35:54.923285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5092455,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":7834,"num_write":8,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.e","version":"43'38","reported_seq":"130","reported_epoch":"46","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:52.976864+0000","last_change":"2020-06-12T02:35:52.976907+0000","last_active":"2020-06-12T02:35:52.976864+0000","last_peered":"2020-06-12T02:35:52.976864+0000","last_clean":"2020-06-12T02:35:52.976864+0000","last_became_active":"2020-06-12T02:35:25.071798+0000","last_became_peered":"2020-06-12T02:35:25.071798+0000","last_unstale":"2020-06-12T02:35:52.976864+0000","last_undegraded":"2020-06-12T02:35:52.976864+0000","last_fullsized":"2020-06-12T02:35:52.976864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":9866099,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":25,"num_read_kb":30096,"num_write":27,"num_write_kb":6221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"2"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.d","version":"48'99","reported_seq":"195","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.945235+0000","last_change":"2020-06-12T02:35:54.946300+0000","last_active":"2020-06-12T02:35:54.945235+0000","last_peered":"2020-06-12T02:35:54.945235+0000","last_clean":"2020-06-12T02:35:54.945235+0000","last_became_active":"2020-06-12T02:35:25.081562+0000","last_became_peered":"2020-06-12T02:35:25.081562+0000","last_unstale":"2020-06-12T02:35:54.945235+0000","last_undegraded":"2020-06-12T02:35:54.945235+0000","last_fullsized":"2020-06-12T02:35:54.945235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":99,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22295516,"num_objects":8,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":24934,"num_write":51,"num_write_kb":22594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,7],"acting":[2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.c","version":"46'23","reported_seq":"111","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.935009+0000","last_change":"2020-06-12T02:35:54.935621+0000","last_active":"2020-06-12T02:35:54.935009+0000","last_peered":"2020-06-12T02:35:54.935009+0000","last_clean":"2020-06-12T02:35:54.935009+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:35:54.935009+0000","last_undegraded":"2020-06-12T02:35:54.935009+0000","last_fullsized":"2020-06-12T02:35:54.935009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.b","version":"34'31","reported_seq":"123","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.951159+0000","last_change":"2020-06-12T02:35:52.952245+0000","last_active":"2020-06-12T02:35:52.951159+0000","last_peered":"2020-06-12T02:35:52.951159+0000","last_clean":"2020-06-12T02:35:52.951159+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:35:52.951159+0000","last_undegraded":"2020-06-12T02:35:52.951159+0000","last_fullsized":"2020-06-12T02:35:52.951159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5815156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":25865,"num_write":23,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"92","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.952919+0000","last_change":"2020-06-12T02:35:52.953334+0000","last_active":"2020-06-12T02:35:52.952919+0000","last_peered":"2020-06-12T02:35:52.952919+0000","last_clean":"2020-06-12T02:35:52.952919+0000","last_became_active":"2020-06-12T02:35:25.072055+0000","last_became_peered":"2020-06-12T02:35:25.072055+0000","last_unstale":"2020-06-12T02:35:52.952919+0000","last_undegraded":"2020-06-12T02:35:52.952919+0000","last_fullsized":"2020-06-12T02:35:52.952919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.9","version":"46'45","reported_seq":"126","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.975135+0000","last_change":"2020-06-12T02:35:52.976044+0000","last_active":"2020-06-12T02:35:52.975135+0000","last_peered":"2020-06-12T02:35:52.975135+0000","last_clean":"2020-06-12T02:35:52.975135+0000","last_became_active":"2020-06-12T02:35:25.070746+0000","last_became_peered":"2020-06-12T02:35:25.070746+0000","last_unstale":"2020-06-12T02:35:52.975135+0000","last_undegraded":"2020-06-12T02:35:52.975135+0000","last_fullsized":"2020-06-12T02:35:52.975135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":45,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10924418,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":10,"num_read_kb":5,"num_write":25,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.8","version":"34'21","reported_seq":"106","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.976183+0000","last_change":"2020-06-12T02:35:52.976613+0000","last_active":"2020-06-12T02:35:52.976183+0000","last_peered":"2020-06-12T02:35:52.976183+0000","last_clean":"2020-06-12T02:35:52.976183+0000","last_became_active":"2020-06-12T02:35:25.073650+0000","last_became_peered":"2020-06-12T02:35:25.073650+0000","last_unstale":"2020-06-12T02:35:52.976183+0000","last_undegraded":"2020-06-12T02:35:52.976183+0000","last_fullsized":"2020-06-12T02:35:52.976183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5663893,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":8033,"num_write":14,"num_write_kb":6175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.7","version":"46'91","reported_seq":"174","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.986704+0000","last_change":"2020-06-12T02:35:52.990345+0000","last_active":"2020-06-12T02:35:52.986704+0000","last_peered":"2020-06-12T02:35:52.986704+0000","last_clean":"2020-06-12T02:35:52.986704+0000","last_became_active":"2020-06-12T02:35:25.075901+0000","last_became_peered":"2020-06-12T02:35:25.075901+0000","last_unstale":"2020-06-12T02:35:52.986704+0000","last_undegraded":"2020-06-12T02:35:52.986704+0000","last_fullsized":"2020-06-12T02:35:52.986704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":91,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16114897,"num_objects":8,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":33,"num_read_kb":22274,"num_write":45,"num_write_kb":17204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.6","version":"34'26","reported_seq":"114","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.923978+0000","last_change":"2020-06-12T02:35:54.925311+0000","last_active":"2020-06-12T02:35:54.923978+0000","last_peered":"2020-06-12T02:35:54.923978+0000","last_clean":"2020-06-12T02:35:54.923978+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:35:54.923978+0000","last_undegraded":"2020-06-12T02:35:54.923978+0000","last_fullsized":"2020-06-12T02:35:54.923978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4672280,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":13,"num_write_kb":4340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.1","version":"34'11","reported_seq":"110","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.925664+0000","last_change":"2020-06-12T02:35:54.926201+0000","last_active":"2020-06-12T02:35:54.925664+0000","last_peered":"2020-06-12T02:35:54.925664+0000","last_clean":"2020-06-12T02:35:54.925664+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:35:54.925664+0000","last_undegraded":"2020-06-12T02:35:54.925664+0000","last_fullsized":"2020-06-12T02:35:54.925664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2689087,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":23941,"num_write":5,"num_write_kb":3970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"80","reported_epoch":"46","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:52.990396+0000","last_change":"2020-06-12T02:35:52.990449+0000","last_active":"2020-06-12T02:35:52.990396+0000","last_peered":"2020-06-12T02:35:52.990396+0000","last_clean":"2020-06-12T02:35:52.990396+0000","last_became_active":"2020-06-12T02:35:25.069671+0000","last_became_peered":"2020-06-12T02:35:25.069671+0000","last_unstale":"2020-06-12T02:35:52.990396+0000","last_undegraded":"2020-06-12T02:35:52.990396+0000","last_fullsized":"2020-06-12T02:35:52.990396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"b","length":"2"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.2","version":"48'117","reported_seq":"199","reported_epoch":"48","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:35:54.937438+0000","last_change":"2020-06-12T02:35:54.937438+0000","last_active":"2020-06-12T02:35:54.937438+0000","last_peered":"2020-06-12T02:35:54.937438+0000","last_clean":"2020-06-12T02:35:54.937438+0000","last_became_active":"2020-06-12T02:35:25.074852+0000","last_became_peered":"2020-06-12T02:35:25.074852+0000","last_unstale":"2020-06-12T02:35:54.937438+0000","last_undegraded":"2020-06-12T02:35:54.937438+0000","last_fullsized":"2020-06-12T02:35:54.937438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":20084276,"num_objects":8,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":6220,"num_write":64,"num_write_kb":20169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.3","version":"46'40","reported_seq":"138","reported_epoch":"46","state":"active+clean","last_fresh":"2020-06-12T02:35:52.956424+0000","last_change":"2020-06-12T02:35:52.957082+0000","last_active":"2020-06-12T02:35:52.956424+0000","last_peered":"2020-06-12T02:35:52.956424+0000","last_clean":"2020-06-12T02:35:52.956424+0000","last_became_active":"2020-06-12T02:35:25.070276+0000","last_became_peered":"2020-06-12T02:35:25.070276+0000","last_unstale":"2020-06-12T02:35:52.956424+0000","last_undegraded":"2020-06-12T02:35:52.956424+0000","last_fullsized":"2020-06-12T02:35:52.956424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":40,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14588278,"num_objects":7,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":31,"num_read_kb":29958,"num_write":31,"num_write_kb":7719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"3"},{"start":"f","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.4","version":"46'42","reported_seq":"151","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.933669+0000","last_change":"2020-06-12T02:35:54.934150+0000","last_active":"2020-06-12T02:35:54.933669+0000","last_peered":"2020-06-12T02:35:54.933669+0000","last_clean":"2020-06-12T02:35:54.933669+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:35:54.933669+0000","last_undegraded":"2020-06-12T02:35:54.933669+0000","last_fullsized":"2020-06-12T02:35:54.933669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13764768,"num_objects":5,"num_object_clones":1,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":44144,"num_write":30,"num_write_kb":7492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]},{"pgid":"1.5","version":"48'79","reported_seq":"174","reported_epoch":"48","state":"active+clean","last_fresh":"2020-06-12T02:35:54.933970+0000","last_change":"2020-06-12T02:35:54.934814+0000","last_active":"2020-06-12T02:35:54.933970+0000","last_peered":"2020-06-12T02:35:54.933970+0000","last_clean":"2020-06-12T02:35:54.933970+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:35:54.933970+0000","last_undegraded":"2020-06-12T02:35:54.933970+0000","last_fullsized":"2020-06-12T02:35:54.933970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17730350,"num_objects":6,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":6560,"num_write":47,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"1"},{"start":"11","length":"1"},{"start":"14","length":"1"},{"start":"18","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":151688034,"num_objects":63,"num_object_clones":18,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":5,"num_read":295,"num_read_kb":236862,"num_write":395,"num_write_kb":132360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":230326272,"data_stored":264642560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069640,"kb_used_data":21056,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93302200,"statfs":{"total":96636764160,"available":95541452800,"internally_reserved":1073741824,"allocated":21561344,"data_stored":22728717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2029999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1075756,"kb_used_data":27172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93296084,"statfs":{"total":96636764160,"available":95535190016,"internally_reserved":1073741824,"allocated":27824128,"data_stored":30824735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4689999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8889999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.427}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1090960,"kb_used_data":42376,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280880,"statfs":{"total":96636764160,"available":95519621120,"internally_reserved":1073741824,"allocated":43393024,"data_stored":51503609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1720000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8210000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5190000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.105}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1105396,"kb_used_data":56812,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93266444,"statfs":{"total":96636764160,"available":95504838656,"internally_reserved":1073741824,"allocated":58175488,"data_stored":70803961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7530000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.613}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1059492,"kb_used_data":10908,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93312348,"statfs":{"total":96636764160,"available":95551844352,"internally_reserved":1073741824,"allocated":11169792,"data_stored":10875385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9220000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0419999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1950000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072892,"kb_used_data":24308,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298948,"statfs":{"total":96636764160,"available":95538122752,"internally_reserved":1073741824,"allocated":24891392,"data_stored":29327373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.827}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5430000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.742}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4249999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088328,"kb_used_data":39744,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283512,"statfs":{"total":96636764160,"available":95522316288,"internally_reserved":1073741824,"allocated":40697856,"data_stored":46747661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.651}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.925}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8650000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1909999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7309999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1063868,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93307972,"statfs":{"total":96636764160,"available":95547363328,"internally_reserved":1073741824,"allocated":15650816,"data_stored":16105485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5089999999999999}]}]}]}} 2020-06-12T02:35:57.530 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2020-06-12T02:35:57.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:35:57.531 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:35:57.531 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 1 2020-06-12T02:35:57.558 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.559 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.566 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:35:57.627 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:57.619+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:57.667 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.668 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.678 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:35:57.687 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.675+0000 7f08961bb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.690 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:57.687+0000 7f0894f59700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:57.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:57.721+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:57.784 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:35:57.781+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:35:57.787 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.787 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.796 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:35:57.840 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:35:57.837+0000 7fab9fda4700 -1 mon.b@0(leader).osd e50 definitely_dead 0 2020-06-12T02:35:57.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:57.885+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:57.950 INFO:tasks.rados.rados.0.smithi142.stdout:188: done (1 left) 2020-06-12T02:35:57.951 INFO:tasks.rados.rados.0.smithi142.stdout:189: done (0 left) 2020-06-12T02:35:57.951 INFO:tasks.rados.rados.0.smithi142.stdout:190: rollback oid 30 current snap is 18 2020-06-12T02:35:57.951 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 30 to 10 2020-06-12T02:35:57.952 INFO:tasks.rados.rados.0.smithi142.stdout:191: snap_remove snap 14 2020-06-12T02:35:57.964 INFO:teuthology.orchestra.run.smithi142.stderr:marked out osd.1. 2020-06-12T02:35:57.972 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:57.972 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:57.981 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:35:58.017 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:35:58.015+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:35:58.089 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:58.085+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:58.123 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:58.124 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:58.132 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:35:58.143 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:35:58.189 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:35:58.187+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:35:58.252 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:58.247+0000 7f71b5b27700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:58.251+0000 7f71b48c5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:58.290 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:35:58.291 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:58.291 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:58.292 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:58.287+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:58.296 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:35:58.307 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:35:58.328 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:35:58.348 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:35:58.373 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:35:58.392 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:58.387+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:58.400 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:35:58.401 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:35:58.403 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:35:58.429 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:35:58.430 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:35:58.444 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:35:58.446 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.447 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.447 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.447 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.447 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.447 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.448 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.449 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:35:58.502 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:58.498+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:58.537 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:58.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:58.538 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:35:58.538 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:58.546 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:35:58.604 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:58.598+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:58.654 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:58.654 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:35:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:35:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:35:58.655 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:58.664 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:35:58.711 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:58.709+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:58.779 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:35:58.780 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:35:58.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:35:58.780 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:35:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:203 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.678675563999999, 2020-06-12T02:35:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564, 2020-06-12T02:35:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 203 2020-06-12T02:35:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097620+0000", 2020-06-12T02:35:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3640000000000006e-05 2020-06-12T02:35:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097693+0000", 2020-06-12T02:35:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5359999999999999e-05 2020-06-12T02:35:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:35:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6433999999999997e-05 2020-06-12T02:35:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097745+0000", 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0820000000000001e-05 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097766+0000", 2020-06-12T02:35:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012371999999999999 2020-06-12T02:35:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097890+0000", 2020-06-12T02:35:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:35:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097907+0000", 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053765519999999997 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103283+0000", 2020-06-12T02:35:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120228 2020-06-12T02:35:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103403+0000", 2020-06-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057519930000000004 2020-06-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.109155+0000", 2020-06-12T02:35:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011535564 2020-06-12T02:35:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:204 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.678403267, 2020-06-12T02:35:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001, 2020-06-12T02:35:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 204 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097892+0000", 2020-06-12T02:35:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1323999999999997e-05 2020-06-12T02:35:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097963+0000", 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3753e-05 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.097977+0000", 2020-06-12T02:35:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4084000000000001e-05 2020-06-12T02:35:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098011+0000", 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.436e-05 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098026+0000", 2020-06-12T02:35:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2340000000000001e-05 2020-06-12T02:35:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098108+0000", 2020-06-12T02:35:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2573e-05 2020-06-12T02:35:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098120+0000", 2020-06-12T02:35:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057105419999999999 2020-06-12T02:35:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103831+0000", 2020-06-12T02:35:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2423000000000006e-05 2020-06-12T02:35:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.103923+0000", 2020-06-12T02:35:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080684209999999992 2020-06-12T02:35:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.111992+0000", 2020-06-12T02:35:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014099820000000001 2020-06-12T02:35:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:205 1.4s0 1:255d7265:::smithi14213939-30:head [sparse-read 0~2487403] snapc 0=[] ondisk+read+known_if_redirected e23)", 2020-06-12T02:35:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.678123468999999, 2020-06-12T02:35:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999, 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 205 2020-06-12T02:35:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098172+0000", 2020-06-12T02:35:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.36e-05 2020-06-12T02:35:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098245+0000", 2020-06-12T02:35:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1090000000000001e-05 2020-06-12T02:35:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098257+0000", 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9026e-05 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098276+0000", 2020-06-12T02:35:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8769999999999999e-06 2020-06-12T02:35:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098284+0000", 2020-06-12T02:35:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011569300000000001 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098400+0000", 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3874e-05 2020-06-12T02:35:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.098414+0000", 2020-06-12T02:35:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0086850239999999995 2020-06-12T02:35:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107099+0000", 2020-06-12T02:35:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9898e-05 2020-06-12T02:35:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.107179+0000", 2020-06-12T02:35:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070512750000000001 2020-06-12T02:35:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.114230+0000", 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016058356999999999 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:306 1.4s0 1:2207f711:::smithi14213939-36:head [rollback 7] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.51069489, 2020-06-12T02:35:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002, 2020-06-12T02:35:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 306 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265600+0000", 2020-06-12T02:35:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3867999999999999e-05 2020-06-12T02:35:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265624+0000", 2020-06-12T02:35:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.374e-06 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265629+0000", 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.63e-06 2020-06-12T02:35:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265635+0000", 2020-06-12T02:35:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4470000000000002e-06 2020-06-12T02:35:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265639+0000", 2020-06-12T02:35:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034773959999999998 2020-06-12T02:35:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269116+0000", 2020-06-12T02:35:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3361000000000004e-05 2020-06-12T02:35:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269199+0000", 2020-06-12T02:35:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062354000000000001 2020-06-12T02:35:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.269823+0000", 2020-06-12T02:35:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034596140000000002 2020-06-12T02:35:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273283+0000", 2020-06-12T02:35:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011887429999999999 2020-06-12T02:35:58.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274471+0000", 2020-06-12T02:35:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6236999999999994e-05 2020-06-12T02:35:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.274558+0000", 2020-06-12T02:35:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089572100000000002 2020-06-12T02:35:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:307 1.4s0 1:2207f711:::smithi14213939-36:head [append 0~0] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:35:58.849 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:58.849 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.510631447000002, 2020-06-12T02:35:58.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858, 2020-06-12T02:35:58.850 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.850 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.851 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.851 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.851 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 307 2020-06-12T02:35:58.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.852 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:58.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.726e-05 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265691+0000", 2020-06-12T02:35:58.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.3119999999999998e-06 2020-06-12T02:35:58.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265694+0000", 2020-06-12T02:35:58.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0460000000000002e-06 2020-06-12T02:35:58.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265700+0000", 2020-06-12T02:35:58.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5019999999999999e-06 2020-06-12T02:35:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.265703+0000", 2020-06-12T02:35:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048970230000000003 2020-06-12T02:35:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270600+0000", 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5030000000000006e-05 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.270665+0000", 2020-06-12T02:35:58.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037581000000000002 2020-06-12T02:35:58.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.271041+0000", 2020-06-12T02:35:58.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022585970000000002 2020-06-12T02:35:58.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.273299+0000", 2020-06-12T02:35:58.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037265929999999998 2020-06-12T02:35:58.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277026+0000", 2020-06-12T02:35:58.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7684999999999997e-05 2020-06-12T02:35:58.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.277124+0000", 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011459858 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:413 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 460525~690852,stat] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.541134120000001, 2020-06-12T02:35:58.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001, 2020-06-12T02:35:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.868 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 413 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:58.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.235161+0000", 2020-06-12T02:35:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014047179999999999 2020-06-12T02:35:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236566+0000", 2020-06-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6436999999999999e-05 2020-06-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236582+0000", 2020-06-12T02:35:58.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0372999999999999e-05 2020-06-12T02:35:58.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236613+0000", 2020-06-12T02:35:58.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7439999999999999e-05 2020-06-12T02:35:58.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236630+0000", 2020-06-12T02:35:58.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013173699999999999 2020-06-12T02:35:58.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236762+0000", 2020-06-12T02:35:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022973399999999999 2020-06-12T02:35:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.236992+0000", 2020-06-12T02:35:58.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021509749999999998 2020-06-12T02:35:58.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.239143+0000", 2020-06-12T02:35:58.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032350040000000001 2020-06-12T02:35:58.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242378+0000", 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036755490000000002 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246053+0000", 2020-06-12T02:35:58.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012699400000000001 2020-06-12T02:35:58.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246180+0000", 2020-06-12T02:35:58.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011018961000000001 2020-06-12T02:35:58.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.882 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.883 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:414 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 1622620~730352] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:58.883 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:58.883 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.534082271000001, 2020-06-12T02:35:58.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473, 2020-06-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.885 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 414 2020-06-12T02:35:58.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.885 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:58.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.242213+0000", 2020-06-12T02:35:58.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014507610000000001 2020-06-12T02:35:58.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243664+0000", 2020-06-12T02:35:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0052999999999998e-05 2020-06-12T02:35:58.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243694+0000", 2020-06-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3764000000000002e-05 2020-06-12T02:35:58.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243748+0000", 2020-06-12T02:35:58.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3773000000000001e-05 2020-06-12T02:35:58.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243771+0000", 2020-06-12T02:35:58.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4173999999999997e-05 2020-06-12T02:35:58.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243856+0000", 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000125909 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:58.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.243981+0000", 2020-06-12T02:35:58.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025715690000000001 2020-06-12T02:35:58.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246553+0000", 2020-06-12T02:35:58.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5254000000000007e-05 2020-06-12T02:35:58.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.246648+0000", 2020-06-12T02:35:58.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001592483 2020-06-12T02:35:58.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248241+0000", 2020-06-12T02:35:58.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045813770000000002 2020-06-12T02:35:58.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252822+0000", 2020-06-12T02:35:58.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025664300000000002 2020-06-12T02:35:58.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255389+0000", 2020-06-12T02:35:58.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000133926 2020-06-12T02:35:58.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255523+0000", 2020-06-12T02:35:58.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013309473 2020-06-12T02:35:58.902 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.902 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.903 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:415 1.4s0 1:2b9499a4:::smithi14213939-35:head [write 3060489~200036] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.528982426000001, 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996, 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.904 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.905 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.905 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.905 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.905 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 415 2020-06-12T02:35:58.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.906 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:58.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247313+0000", 2020-06-12T02:35:58.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052327099999999996 2020-06-12T02:35:58.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247836+0000", 2020-06-12T02:35:58.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6460000000000001e-05 2020-06-12T02:35:58.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247863+0000", 2020-06-12T02:35:58.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6666999999999998e-05 2020-06-12T02:35:58.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247919+0000", 2020-06-12T02:35:58.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6555999999999999e-05 2020-06-12T02:35:58.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.247936+0000", 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018652619999999999 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249801+0000", 2020-06-12T02:35:58.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000228316 2020-06-12T02:35:58.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250029+0000", 2020-06-12T02:35:58.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014026869999999999 2020-06-12T02:35:58.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.251432+0000", 2020-06-12T02:35:58.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041290340000000002 2020-06-12T02:35:58.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255561+0000", 2020-06-12T02:35:58.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001052968 2020-06-12T02:35:58.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256614+0000", 2020-06-12T02:35:58.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3012999999999999e-05 2020-06-12T02:35:58.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256707+0000", 2020-06-12T02:35:58.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093942339999999996 2020-06-12T02:35:58.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.923 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.924 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:416 1.4s0 1:2b9499a4:::smithi14213939-35:head [setxattr _header (57) in=7b,truncate 3260525] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:35:58.924 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:58.925 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.528194565, 2020-06-12T02:35:58.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999, 2020-06-12T02:35:58.925 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.926 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:58.926 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.926 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.927 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.927 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 416 2020-06-12T02:35:58.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.927 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:58.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248101+0000", 2020-06-12T02:35:58.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017055999999999999 2020-06-12T02:35:58.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248271+0000", 2020-06-12T02:35:58.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5933999999999999e-05 2020-06-12T02:35:58.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248297+0000", 2020-06-12T02:35:58.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9759999999999998e-05 2020-06-12T02:35:58.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248347+0000", 2020-06-12T02:35:58.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4456e-05 2020-06-12T02:35:58.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248361+0000", 2020-06-12T02:35:58.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045179110000000003 2020-06-12T02:35:58.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.252879+0000", 2020-06-12T02:35:58.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021748199999999999 2020-06-12T02:35:58.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253097+0000", 2020-06-12T02:35:58.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000829862 2020-06-12T02:35:58.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:58.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.253927+0000", 2020-06-12T02:35:58.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028617040000000001 2020-06-12T02:35:58.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:58.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256788+0000", 2020-06-12T02:35:58.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020799640000000001 2020-06-12T02:35:58.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:58.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.258868+0000", 2020-06-12T02:35:58.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017190700000000001 2020-06-12T02:35:58.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259040+0000", 2020-06-12T02:35:58.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010939539999999999 2020-06-12T02:35:58.946 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.946 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.946 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.947 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:35:58.947 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:58.948 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.527839278, 2020-06-12T02:35:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:35:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.949 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.950 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.950 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:35:58.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.950 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:35:58.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:35:58.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:35:58.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:35:58.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:35:58.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:35:58.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:35:58.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:35:58.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:58.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:35:58.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:35:58.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:35:58.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:35:58.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:35:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:35:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.963 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:418 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:58.963 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:58.963 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.52743675, 2020-06-12T02:35:58.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468, 2020-06-12T02:35:58.963 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.964 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.964 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.964 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.964 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.965 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 418 2020-06-12T02:35:58.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.966 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:58.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248859+0000", 2020-06-12T02:35:58.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022298000000000001 2020-06-12T02:35:58.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249082+0000", 2020-06-12T02:35:58.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.931e-05 2020-06-12T02:35:58.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249101+0000", 2020-06-12T02:35:58.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9820000000000002e-05 2020-06-12T02:35:58.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249141+0000", 2020-06-12T02:35:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3679999999999999e-05 2020-06-12T02:35:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249154+0000", 2020-06-12T02:35:58.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064441919999999996 2020-06-12T02:35:58.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255599+0000", 2020-06-12T02:35:58.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011178100000000001 2020-06-12T02:35:58.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255710+0000", 2020-06-12T02:35:58.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071867049999999998 2020-06-12T02:35:58.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.262897+0000", 2020-06-12T02:35:58.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014038468 2020-06-12T02:35:58.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.975 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.976 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:419 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~2453789,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:58.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:58.977 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.526963586999999, 2020-06-12T02:35:58.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999, 2020-06-12T02:35:58.977 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.977 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.978 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.979 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 419 2020-06-12T02:35:58.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.979 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249332+0000", 2020-06-12T02:35:58.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000268977 2020-06-12T02:35:58.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:58.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249601+0000", 2020-06-12T02:35:58.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8689999999999999e-05 2020-06-12T02:35:58.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:58.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249619+0000", 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9376999999999999e-05 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249659+0000", 2020-06-12T02:35:58.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.821e-05 2020-06-12T02:35:58.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:58.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249677+0000", 2020-06-12T02:35:58.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064908220000000003 2020-06-12T02:35:58.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:58.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256168+0000", 2020-06-12T02:35:58.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4083000000000001e-05 2020-06-12T02:35:58.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:58.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.256252+0000", 2020-06-12T02:35:58.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084599500000000008 2020-06-12T02:35:58.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:58.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.264712+0000", 2020-06-12T02:35:58.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015380108999999999 2020-06-12T02:35:58.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.994 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:58.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:58.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.994 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:35:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.526422225999999, 2020-06-12T02:35:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:35:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:58.996 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:58.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:58.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:58.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:58.997 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:35:58.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.997 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:58.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:58.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:58.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:35:58.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:35:59.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:35:59.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:35:59.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:35:59.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:35:59.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:35:59.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:35:59.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:35:59.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:35:59.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:35:59.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:35:59.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:35:59.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.008 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:465 1.4s0 1:2b9499a4:::smithi14213939-35:head [rollback c] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:59.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:59.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.845604659999999, 2020-06-12T02:35:59.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994, 2020-06-12T02:35:59.008 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 465 2020-06-12T02:35:59.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.010 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:59.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930691+0000", 2020-06-12T02:35:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9047e-05 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930740+0000", 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5460000000000003e-06 2020-06-12T02:35:59.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930747+0000", 2020-06-12T02:35:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3519999999999999e-05 2020-06-12T02:35:59.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930761+0000", 2020-06-12T02:35:59.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6219999999999997e-06 2020-06-12T02:35:59.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930766+0000", 2020-06-12T02:35:59.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027740130000000001 2020-06-12T02:35:59.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933540+0000", 2020-06-12T02:35:59.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000194954 2020-06-12T02:35:59.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.933735+0000", 2020-06-12T02:35:59.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00094835199999999996 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.934684+0000", 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020709050000000001 2020-06-12T02:35:59.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936755+0000", 2020-06-12T02:35:59.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029704919999999999 2020-06-12T02:35:59.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:59.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939725+0000", 2020-06-12T02:35:59.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2645999999999994e-05 2020-06-12T02:35:59.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939808+0000", 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091170969999999994 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.021 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:466 1.4s0 1:2b9499a4:::smithi14213939-35:head [append 0~0] snapc 13=[13,11,c,a] ondisk+write+known_if_redirected e39)", 2020-06-12T02:35:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:59.023 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 12.845482241999999, 2020-06-12T02:35:59.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632, 2020-06-12T02:35:59.023 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.023 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 466 2020-06-12T02:35:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930813+0000", 2020-06-12T02:35:59.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.761e-05 2020-06-12T02:35:59.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930861+0000", 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2320000000000004e-06 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930868+0000", 2020-06-12T02:35:59.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3369e-05 2020-06-12T02:35:59.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930881+0000", 2020-06-12T02:35:59.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4280000000000004e-06 2020-06-12T02:35:59.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.930887+0000", 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048704559999999996 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935757+0000", 2020-06-12T02:35:59.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012276 2020-06-12T02:35:59.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.935880+0000", 2020-06-12T02:35:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052191100000000001 2020-06-12T02:35:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.936402+0000", 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028551010000000001 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.939257+0000", 2020-06-12T02:35:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030580550000000001 2020-06-12T02:35:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942315+0000", 2020-06-12T02:35:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4709999999999995e-05 2020-06-12T02:35:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:45.942380+0000", 2020-06-12T02:35:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011566632 2020-06-12T02:35:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:535 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~2588245,checksum] snapc 0=[] ondisk+read+known_if_redirected e43)", 2020-06-12T02:35:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 8.7346481499999999, 2020-06-12T02:35:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076, 2020-06-12T02:35:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:35:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 535 2020-06-12T02:35:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041647+0000", 2020-06-12T02:35:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00019748300000000001 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041845+0000", 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7210999999999998e-05 2020-06-12T02:35:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041862+0000", 2020-06-12T02:35:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9805999999999999e-05 2020-06-12T02:35:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041892+0000", 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7217000000000001e-05 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.041909+0000", 2020-06-12T02:35:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00051008499999999997 2020-06-12T02:35:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042419+0000", 2020-06-12T02:35:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011063 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.042530+0000", 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0091386439999999996 2020-06-12T02:35:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:50.051668+0000", 2020-06-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010021076 2020-06-12T02:35:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.ds2 47/18 ECSubWrite(tid=235, reqid=client.4555.0:547, at_version=47'93, trim_to=0'0, roll_forward_to=46'91))", 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.7984202529999997, 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092340830000000006, 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:35:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.977875+0000", 2020-06-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001654109 2020-06-12T02:35:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979529+0000", 2020-06-12T02:35:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7809000000000003e-05 2020-06-12T02:35:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979577+0000", 2020-06-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4306e-05 2020-06-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979611+0000", 2020-06-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6069000000000001e-05 2020-06-12T02:35:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979627+0000", 2020-06-12T02:35:59.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000173676 2020-06-12T02:35:59.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979801+0000", 2020-06-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5009999999999999e-05 2020-06-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.979836+0000", 2020-06-12T02:35:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071243290000000004 2020-06-12T02:35:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.986960+0000", 2020-06-12T02:35:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000148775 2020-06-12T02:35:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:53.987109+0000", 2020-06-12T02:35:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092340830000000006 2020-06-12T02:35:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:558 1.4s0 1:255d7265:::smithi14213939-30:head [append 0~0] snapc 1d=[1d,1b,16,13] ondisk+write+known_if_redirected e49)", 2020-06-12T02:35:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:55.940965+0000", 2020-06-12T02:35:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.8353301339999999, 2020-06-12T02:35:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011936558, 2020-06-12T02:35:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 558 2020-06-12T02:35:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.940965+0000", 2020-06-12T02:35:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.940965+0000", 2020-06-12T02:35:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4902999999999998e-05 2020-06-12T02:35:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941040+0000", 2020-06-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5211999999999999e-05 2020-06-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941055+0000", 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2713999999999999e-05 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941088+0000", 2020-06-12T02:35:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7544e-05 2020-06-12T02:35:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941106+0000", 2020-06-12T02:35:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013030499999999999 2020-06-12T02:35:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941236+0000", 2020-06-12T02:35:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1596000000000001e-05 2020-06-12T02:35:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:35:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941257+0000", 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003797389 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.945055+0000", 2020-06-12T02:35:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021640900000000001 2020-06-12T02:35:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.945271+0000", 2020-06-12T02:35:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0015256320000000001 2020-06-12T02:35:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.946797+0000", 2020-06-12T02:35:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057642739999999998 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.952561+0000", 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018544300000000001 2020-06-12T02:35:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.952747+0000", 2020-06-12T02:35:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015513699999999999 2020-06-12T02:35:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.952902+0000", 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011936558 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:559 1.4s0 1:255d7265:::smithi14213939-30:head [rollback 16] snapc 1d=[1d,1b,16,13] ondisk+write+known_if_redirected e49)", 2020-06-12T02:35:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:55.941193+0000", 2020-06-12T02:35:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.835102354, 2020-06-12T02:35:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012899656000000001, 2020-06-12T02:35:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 559 2020-06-12T02:35:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941193+0000", 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941193+0000", 2020-06-12T02:35:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1470999999999994e-05 2020-06-12T02:35:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941264+0000", 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5950000000000005e-06 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941274+0000", 2020-06-12T02:35:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7927999999999998e-05 2020-06-12T02:35:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941292+0000", 2020-06-12T02:35:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2259999999999999e-06 2020-06-12T02:35:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941299+0000", 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0746000000000002e-05 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941380+0000", 2020-06-12T02:35:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3071000000000001e-05 2020-06-12T02:35:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941393+0000", 2020-06-12T02:35:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076825799999999996 2020-06-12T02:35:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.949076+0000", 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140524 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.949216+0000", 2020-06-12T02:35:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010035409999999999 2020-06-12T02:35:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.950220+0000", 2020-06-12T02:35:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0026889489999999999 2020-06-12T02:35:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.952909+0000", 2020-06-12T02:35:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001085662 2020-06-12T02:35:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.953994+0000", 2020-06-12T02:35:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8363000000000007e-05 2020-06-12T02:35:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.954093+0000", 2020-06-12T02:35:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012899656000000001 2020-06-12T02:35:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:560 1.4s0 1:255d7265:::smithi14213939-30:head [append 0~0] snapc 1d=[1d,1b,16,13] ondisk+write+known_if_redirected e49)", 2020-06-12T02:35:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:55.941422+0000", 2020-06-12T02:35:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 2.834873365, 2020-06-12T02:35:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012985651000000001, 2020-06-12T02:35:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:35:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:35:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:35:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 560 2020-06-12T02:35:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:35:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:35:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941422+0000", 2020-06-12T02:35:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:35:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:35:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941422+0000", 2020-06-12T02:35:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017740200000000001 2020-06-12T02:35:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:35:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941599+0000", 2020-06-12T02:35:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3356000000000001e-05 2020-06-12T02:35:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:35:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941613+0000", 2020-06-12T02:35:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4771000000000002e-05 2020-06-12T02:35:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:35:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941657+0000", 2020-06-12T02:35:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9117e-05 2020-06-12T02:35:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941677+0000", 2020-06-12T02:35:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013052499999999999 2020-06-12T02:35:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941807+0000", 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0905999999999999e-05 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:35:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.941828+0000", 2020-06-12T02:35:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095576840000000003 2020-06-12T02:35:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.951386+0000", 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014732499999999999 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:35:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.951533+0000", 2020-06-12T02:35:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00055943300000000002 2020-06-12T02:35:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.952092+0000", 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001187451 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.953280+0000", 2020-06-12T02:35:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001064642 2020-06-12T02:35:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.954345+0000", 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3039000000000004e-05 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:35:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:35:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:55.954408+0000", 2020-06-12T02:35:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012985651000000001 2020-06-12T02:35:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:35:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:35:59.120 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:35:59.121 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:35:59.122 INFO:tasks.rados.rados.0.smithi142.stdout:191: done (1 left) 2020-06-12T02:35:59.123 INFO:tasks.rados.rados.0.smithi142.stdout:192: read oid 37 snap -1 2020-06-12T02:35:59.123 INFO:tasks.rados.rados.0.smithi142.stdout:192: expect (ObjNum 49 snap 0 seq_num 49) 2020-06-12T02:35:59.123 INFO:tasks.rados.rados.0.smithi142.stdout:193: read oid 46 snap -1 2020-06-12T02:35:59.123 INFO:tasks.rados.rados.0.smithi142.stdout:193: expect deleted 2020-06-12T02:35:59.124 INFO:tasks.rados.rados.0.smithi142.stdout:194: snap_create 2020-06-12T02:35:59.124 INFO:tasks.rados.rados.0.smithi142.stdout:190: finishing rollback tid 0 to smithi14213939-30 2020-06-12T02:35:59.124 INFO:tasks.rados.rados.0.smithi142.stdout:190: finishing rollback tid 1 to smithi14213939-30 2020-06-12T02:35:59.124 INFO:tasks.rados.rados.0.smithi142.stdout:190: finishing rollback tid 2 to smithi14213939-30 2020-06-12T02:35:59.124 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 50 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-06-12T02:35:59.125 INFO:tasks.rados.rados.0.smithi142.stdout:192: expect (ObjNum 49 snap 0 seq_num 49) 2020-06-12T02:35:59.125 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:35:59.116+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:35:59.126 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:35:59.222 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:35:59.218+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:35:59.236 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:59.226+0000 7f27acb04700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:59.241 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:59.241 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:59.241 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:35:59.242 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:59.242 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:35:59.234+0000 7f27acb04700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:35:59.252 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:35:59.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:59.324+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:59.404 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:35:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:35:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:35:59.406 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:59.411 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:35:59.462 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:59.458+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:59.535 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:35:59.536 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:35:59.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:35:59.536 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:35:59.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:59.537 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:59.537 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.422118862000001, 2020-06-12T02:35:59.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:35:59.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:35:59.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.539 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:59.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:35:59.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:35:59.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:35:59.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:35:59.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:35:59.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:35:59.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:35:59.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:35:59.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:35:59.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:35:59.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:35:59.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:35:59.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:35:59.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:35:59.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:35:59.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:35:59.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:59.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.421948494999999, 2020-06-12T02:35:59.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:35:59.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.554 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:59.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:35:59.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:59.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:35:59.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:35:59.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:35:59.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:35:59.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:35:59.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:35:59.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:35:59.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:35:59.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:35:59.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:35:59.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:35:59.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:35:59.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:35:59.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:35:59.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:35:59.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:35:59.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:35:59.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:59.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:35:59.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:35:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:35:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:35:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:35:59.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:35:59.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:35:59.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:35:59.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.574 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:208 1.2s0 1:40342bec:::smithi14213939-47:head [write 440350~460568] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:59.574 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:59.574 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.410428265, 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998, 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.575 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.576 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 208 2020-06-12T02:35:59.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.576 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:59.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:35:59.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000287497 2020-06-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109447+0000", 2020-06-12T02:35:59.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6830000000000002e-06 2020-06-12T02:35:59.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109453+0000", 2020-06-12T02:35:59.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6283e-05 2020-06-12T02:35:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109470+0000", 2020-06-12T02:35:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0479999999999998e-06 2020-06-12T02:35:59.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109475+0000", 2020-06-12T02:35:59.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6121e-05 2020-06-12T02:35:59.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109531+0000", 2020-06-12T02:35:59.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114108 2020-06-12T02:35:59.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109645+0000", 2020-06-12T02:35:59.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035523009999999999 2020-06-12T02:35:59.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.113197+0000", 2020-06-12T02:35:59.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013270552 2020-06-12T02:35:59.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126468+0000", 2020-06-12T02:35:59.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023953399999999999 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126707+0000", 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013569499999999999 2020-06-12T02:35:59.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126843+0000", 2020-06-12T02:35:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998 2020-06-12T02:35:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:59.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:59.597 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.403810468, 2020-06-12T02:35:59.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:35:59.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.598 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:59.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:35:59.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:35:59.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:35:59.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:35:59.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:35:59.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:35:59.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:35:59.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:35:59.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:35:59.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:35:59.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:35:59.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:35:59.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:35:59.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:35:59.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:35:59.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:35:59.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:35:59.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:35:59.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:35:59.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:35:59.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:35:59.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.623 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:59.624 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:59.624 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.397873584999999, 2020-06-12T02:35:59.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:35:59.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.625 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.625 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.625 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.625 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:35:59.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.626 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:59.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:35:59.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:35:59.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:35:59.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:35:59.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:35:59.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:35:59.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:35:59.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:35:59.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:35:59.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:35:59.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:35:59.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:35:59.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:35:59.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:35:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:35:59.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:35:59.638 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.638 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.638 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.639 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:35:59.639 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:59.639 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.397364514, 2020-06-12T02:35:59.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:35:59.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:35:59.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.641 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:59.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:35:59.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:35:59.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:35:59.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:35:59.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:35:59.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:35:59.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:35:59.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:35:59.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:35:59.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:35:59.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:35:59.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:35:59.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:35:59.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:35:59.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:35:59.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:35:59.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.653 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:35:59.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.397206248, 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:35:59.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.655 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:59.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:35:59.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:35:59.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:35:59.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:35:59.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:35:59.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:35:59.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:35:59.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:35:59.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:35:59.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:35:59.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:35:59.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:35:59.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:35:59.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:35:59.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:35:59.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:35:59.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:298 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:35:59.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:59.668 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.342188673999999, 2020-06-12T02:35:59.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982, 2020-06-12T02:35:59.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 298 2020-06-12T02:35:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.669 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:59.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2509999999999995e-05 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177471+0000", 2020-06-12T02:35:59.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5789999999999993e-06 2020-06-12T02:35:59.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177481+0000", 2020-06-12T02:35:59.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:35:59.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177499+0000", 2020-06-12T02:35:59.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0701e-05 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177509+0000", 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057272240000000004 2020-06-12T02:35:59.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183237+0000", 2020-06-12T02:35:59.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018898499999999999 2020-06-12T02:35:59.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183426+0000", 2020-06-12T02:35:59.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00076048100000000003 2020-06-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.184186+0000", 2020-06-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037303620000000001 2020-06-12T02:35:59.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.187916+0000", 2020-06-12T02:35:59.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032542600000000001 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191171+0000", 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5078999999999999e-05 2020-06-12T02:35:59.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191226+0000", 2020-06-12T02:35:59.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982 2020-06-12T02:35:59.681 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.682 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:320 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~2117649] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.231216438000001, 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0127136, 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:59.683 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 320 2020-06-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288371+0000", 2020-06-12T02:35:59.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9022e-05 2020-06-12T02:35:59.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288410+0000", 2020-06-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6389999999999997e-06 2020-06-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288416+0000", 2020-06-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0268999999999999e-05 2020-06-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288426+0000", 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4349999999999999e-06 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.288430+0000", 2020-06-12T02:35:59.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044584389999999998 2020-06-12T02:35:59.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.292889+0000", 2020-06-12T02:35:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012272300000000001 2020-06-12T02:35:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.293012+0000", 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080730730000000001 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301085+0000", 2020-06-12T02:35:59.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0127136 2020-06-12T02:35:59.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.322809446000001, 2020-06-12T02:35:59.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:35:59.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:59.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:35:59.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:35:59.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:35:59.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:35:59.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:35:59.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:35:59.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:35:59.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:35:59.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:35:59.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:35:59.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.711 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:451 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 2941380~419987] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:59.711 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:59.711 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.316450243, 2020-06-12T02:35:59.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001, 2020-06-12T02:35:59.712 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.712 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.713 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 451 2020-06-12T02:35:59.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.713 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000289315 2020-06-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203427+0000", 2020-06-12T02:35:59.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3359999999999995e-06 2020-06-12T02:35:59.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203435+0000", 2020-06-12T02:35:59.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9905999999999999e-05 2020-06-12T02:35:59.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203455+0000", 2020-06-12T02:35:59.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2639999999999997e-06 2020-06-12T02:35:59.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203464+0000", 2020-06-12T02:35:59.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046779599999999998 2020-06-12T02:35:59.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203932+0000", 2020-06-12T02:35:59.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1891999999999994e-05 2020-06-12T02:35:59.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204024+0000", 2020-06-12T02:35:59.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069815440000000001 2020-06-12T02:35:59.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.211005+0000", 2020-06-12T02:35:59.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036673360000000002 2020-06-12T02:35:59.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214673+0000", 2020-06-12T02:35:59.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077744160000000001 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222447+0000", 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129228 2020-06-12T02:35:59.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222576+0000", 2020-06-12T02:35:59.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001 2020-06-12T02:35:59.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.727 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:452 1.2s0 1:4fe4d12b:::smithi14213939-34:head [setxattr _header (57) in=7b,truncate 3361367] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:35:59.728 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:59.728 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.316000561999999, 2020-06-12T02:35:59.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001, 2020-06-12T02:35:59.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.729 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 452 2020-06-12T02:35:59.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.730 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:59.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:35:59.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107166 2020-06-12T02:35:59.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203694+0000", 2020-06-12T02:35:59.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2969999999999992e-06 2020-06-12T02:35:59.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203703+0000", 2020-06-12T02:35:59.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7147e-05 2020-06-12T02:35:59.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203721+0000", 2020-06-12T02:35:59.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4060000000000002e-06 2020-06-12T02:35:59.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203727+0000", 2020-06-12T02:35:59.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557648 2020-06-12T02:35:59.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204285+0000", 2020-06-12T02:35:59.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013640700000000001 2020-06-12T02:35:59.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204421+0000", 2020-06-12T02:35:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080134209999999997 2020-06-12T02:35:59.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212434+0000", 2020-06-12T02:35:59.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002242675 2020-06-12T02:35:59.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214677+0000", 2020-06-12T02:35:59.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080765639999999996 2020-06-12T02:35:59.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222754+0000", 2020-06-12T02:35:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016176999999999999 2020-06-12T02:35:59.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222915+0000", 2020-06-12T02:35:59.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.746 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.315798623999999, 2020-06-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:59.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.748 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:35:59.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.749 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:59.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:35:59.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:35:59.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:35:59.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:35:59.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:35:59.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:35:59.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:35:59.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:35:59.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:35:59.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:35:59.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:35:59.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:35:59.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:59.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:35:59.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:35:59.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:35:59.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:35:59.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:35:59.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:35:59.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:35:59.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:35:59.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.760 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.761 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:522 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 695823~777044] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:59.761 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:59.761 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5863146809999993, 2020-06-12T02:35:59.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001, 2020-06-12T02:35:59.762 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.762 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.763 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.763 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 522 2020-06-12T02:35:59.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.763 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:59.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:35:59.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056703400000000001 2020-06-12T02:35:59.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933840+0000", 2020-06-12T02:35:59.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0903e-05 2020-06-12T02:35:59.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933851+0000", 2020-06-12T02:35:59.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6198e-05 2020-06-12T02:35:59.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933867+0000", 2020-06-12T02:35:59.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:35:59.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933875+0000", 2020-06-12T02:35:59.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9525999999999997e-05 2020-06-12T02:35:59.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933955+0000", 2020-06-12T02:35:59.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0988000000000001e-05 2020-06-12T02:35:59.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:35:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933966+0000", 2020-06-12T02:35:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036756929999999998 2020-06-12T02:35:59.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937641+0000", 2020-06-12T02:35:59.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013941800000000001 2020-06-12T02:35:59.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937781+0000", 2020-06-12T02:35:59.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074804579999999997 2020-06-12T02:35:59.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.945261+0000", 2020-06-12T02:35:59.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044656610000000001 2020-06-12T02:35:59.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949727+0000", 2020-06-12T02:35:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036480600000000002 2020-06-12T02:35:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950092+0000", 2020-06-12T02:35:59.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105678 2020-06-12T02:35:59.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950197+0000", 2020-06-12T02:35:59.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001 2020-06-12T02:35:59.777 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.778 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:523 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 1925015~639682] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:59.779 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:59.779 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5769661250000002, 2020-06-12T02:35:59.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272, 2020-06-12T02:35:59.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.780 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 523 2020-06-12T02:35:59.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:59.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:35:59.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032343600000000003 2020-06-12T02:35:59.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942945+0000", 2020-06-12T02:35:59.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1165000000000001e-05 2020-06-12T02:35:59.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942956+0000", 2020-06-12T02:35:59.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7815000000000001e-05 2020-06-12T02:35:59.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942974+0000", 2020-06-12T02:35:59.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1079999999999999e-06 2020-06-12T02:35:59.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942983+0000", 2020-06-12T02:35:59.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.198e-05 2020-06-12T02:35:59.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943045+0000", 2020-06-12T02:35:59.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015003600000000001 2020-06-12T02:35:59.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943195+0000", 2020-06-12T02:35:59.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012239308000000001 2020-06-12T02:35:59.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.955434+0000", 2020-06-12T02:35:59.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031130979999999999 2020-06-12T02:35:59.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.958547+0000", 2020-06-12T02:35:59.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021421489999999999 2020-06-12T02:35:59.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960689+0000", 2020-06-12T02:35:59.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7176999999999996e-05 2020-06-12T02:35:59.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960777+0000", 2020-06-12T02:35:59.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272 2020-06-12T02:35:59.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.794 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:524 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 3328058~167765] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:59.794 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:59.794 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5712656119999995, 2020-06-12T02:35:59.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478, 2020-06-12T02:35:59.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.796 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.796 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 524 2020-06-12T02:35:59.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.796 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:59.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:35:59.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027316900000000003 2020-06-12T02:35:59.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948595+0000", 2020-06-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4909999999999994e-06 2020-06-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948605+0000", 2020-06-12T02:35:59.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5495999999999999e-05 2020-06-12T02:35:59.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948620+0000", 2020-06-12T02:35:59.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9129999999999997e-06 2020-06-12T02:35:59.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948627+0000", 2020-06-12T02:35:59.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025216099999999999 2020-06-12T02:35:59.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948879+0000", 2020-06-12T02:35:59.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014658800000000001 2020-06-12T02:35:59.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949026+0000", 2020-06-12T02:35:59.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083404719999999998 2020-06-12T02:35:59.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.957366+0000", 2020-06-12T02:35:59.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029182449999999999 2020-06-12T02:35:59.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960284+0000", 2020-06-12T02:35:59.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069633399999999995 2020-06-12T02:35:59.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960981+0000", 2020-06-12T02:35:59.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0608999999999999e-05 2020-06-12T02:35:59.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961071+0000", 2020-06-12T02:35:59.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478 2020-06-12T02:35:59.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.808 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.809 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:525 1.2s0 1:4edac3c4:::smithi14213939-9:head [setxattr _header (56) in=7b,truncate 3495823] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:35:59.809 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:59.810 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5709001780000005, 2020-06-12T02:35:59.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012698869999999999, 2020-06-12T02:35:59.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.810 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.811 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 525 2020-06-12T02:35:59.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.811 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:59.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948687+0000", 2020-06-12T02:35:59.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6369e-05 2020-06-12T02:35:59.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948764+0000", 2020-06-12T02:35:59.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1419999999999993e-06 2020-06-12T02:35:59.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948772+0000", 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3851e-05 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948786+0000", 2020-06-12T02:35:59.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3289999999999999e-06 2020-06-12T02:35:59.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948792+0000", 2020-06-12T02:35:59.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059115199999999995 2020-06-12T02:35:59.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949383+0000", 2020-06-12T02:35:59.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011080499999999999 2020-06-12T02:35:59.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949494+0000", 2020-06-12T02:35:59.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086590039999999997 2020-06-12T02:35:59.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.958153+0000", 2020-06-12T02:35:59.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002973144 2020-06-12T02:35:59.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961126+0000", 2020-06-12T02:35:59.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013955 2020-06-12T02:35:59.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961266+0000", 2020-06-12T02:35:59.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120524 2020-06-12T02:35:59.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961386+0000", 2020-06-12T02:35:59.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012698869999999999 2020-06-12T02:35:59.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:526 1.2s0 1:4edac3c4:::smithi14213939-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e43)", 2020-06-12T02:35:59.829 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:59.829 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5707434120000006, 2020-06-12T02:35:59.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001, 2020-06-12T02:35:59.829 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.830 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:35:59.830 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.830 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.831 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.831 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 526 2020-06-12T02:35:59.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.831 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:59.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:35:59.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6243999999999999e-05 2020-06-12T02:35:59.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948900+0000", 2020-06-12T02:35:59.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4939999999999997e-06 2020-06-12T02:35:59.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948908+0000", 2020-06-12T02:35:59.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3456e-05 2020-06-12T02:35:59.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948921+0000", 2020-06-12T02:35:59.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8409999999999996e-06 2020-06-12T02:35:59.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948927+0000", 2020-06-12T02:35:59.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0009970039999999999 2020-06-12T02:35:59.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949924+0000", 2020-06-12T02:35:59.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4784999999999996e-05 2020-06-12T02:35:59.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:35:59.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949999+0000", 2020-06-12T02:35:59.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012073782 2020-06-12T02:35:59.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962073+0000", 2020-06-12T02:35:59.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132726 2020-06-12T02:35:59.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962205+0000", 2020-06-12T02:35:59.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010140240000000001 2020-06-12T02:35:59.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.963219+0000", 2020-06-12T02:35:59.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001 2020-06-12T02:35:59.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.846 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.847 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:538 1.2s0 1:40a24690:::smithi14213939-8:head [write 729437~527542] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:35:59.848 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:59.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5713735890000002, 2020-06-12T02:35:59.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001, 2020-06-12T02:35:59.848 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.849 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 538 2020-06-12T02:35:59.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.850 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:59.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:35:59.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031614799999999998 2020-06-12T02:35:59.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948530+0000", 2020-06-12T02:35:59.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6116e-05 2020-06-12T02:35:59.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948546+0000", 2020-06-12T02:35:59.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4805999999999999e-05 2020-06-12T02:35:59.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948571+0000", 2020-06-12T02:35:59.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4479e-05 2020-06-12T02:35:59.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948585+0000", 2020-06-12T02:35:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9798999999999998e-05 2020-06-12T02:35:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948685+0000", 2020-06-12T02:35:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018751 2020-06-12T02:35:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948873+0000", 2020-06-12T02:35:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056200729999999997 2020-06-12T02:35:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.954493+0000", 2020-06-12T02:35:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050674220000000002 2020-06-12T02:35:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959560+0000", 2020-06-12T02:35:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036640399999999999 2020-06-12T02:35:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963224+0000", 2020-06-12T02:35:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111121 2020-06-12T02:35:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963335+0000", 2020-06-12T02:35:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001 2020-06-12T02:35:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:539 1.2s0 1:40a24690:::smithi14213939-8:head [write 1925626~643351] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:35:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5610509320000006, 2020-06-12T02:35:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379, 2020-06-12T02:35:59.870 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:35:59.870 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:35:59.870 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 539 2020-06-12T02:35:59.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.872 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:35:59.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:35:59.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:59.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:35:59.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000305001 2020-06-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:35:59.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958842+0000", 2020-06-12T02:35:59.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8190000000000003e-06 2020-06-12T02:35:59.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:35:59.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958851+0000", 2020-06-12T02:35:59.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2416999999999999e-05 2020-06-12T02:35:59.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:35:59.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958874+0000", 2020-06-12T02:35:59.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4691999999999999e-05 2020-06-12T02:35:59.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:35:59.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958888+0000", 2020-06-12T02:35:59.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018018600000000001 2020-06-12T02:35:59.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:35:59.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959069+0000", 2020-06-12T02:35:59.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017349999999999999 2020-06-12T02:35:59.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:35:59.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959242+0000", 2020-06-12T02:35:59.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091864670000000002 2020-06-12T02:35:59.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:35:59.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.968429+0000", 2020-06-12T02:35:59.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059461899999999996 2020-06-12T02:35:59.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974375+0000", 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042622100000000001 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:35:59.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974801+0000", 2020-06-12T02:35:59.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9296999999999996e-05 2020-06-12T02:35:59.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:35:59.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:35:59.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974890+0000", 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:35:59.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:35:59.886 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:35:59.886 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:35:59.530+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:35:59.887 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:35:59.888 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:35:59.888+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:35:59.933 INFO:tasks.rados.rados.0.smithi142.stdout:190: done (3 left) 2020-06-12T02:35:59.933 INFO:tasks.rados.rados.0.smithi142.stdout:192: done (2 left) 2020-06-12T02:35:59.934 INFO:tasks.rados.rados.0.smithi142.stdout:193: done (1 left) 2020-06-12T02:35:59.934 INFO:tasks.rados.rados.0.smithi142.stdout:194: done (0 left) 2020-06-12T02:35:59.935 INFO:tasks.rados.rados.0.smithi142.stdout:195: rollback oid 49 current snap is 19 2020-06-12T02:35:59.935 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 49 to 15 2020-06-12T02:35:59.935 INFO:tasks.rados.rados.0.smithi142.stdout:196: write oid 31 current snap is 19 2020-06-12T02:35:59.935 INFO:tasks.rados.rados.0.smithi142.stdout:196: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2020-06-12T02:35:59.945 INFO:tasks.rados.rados.0.smithi142.stdout:196: writing smithi14213939-31 from 763051 to 1557444 tid 1 2020-06-12T02:35:59.952 INFO:tasks.rados.rados.0.smithi142.stdout:196: writing smithi14213939-31 from 2158943 to 2805963 tid 2 2020-06-12T02:35:59.954 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:35:59.956 INFO:tasks.rados.rados.0.smithi142.stdout:196: writing smithi14213939-31 from 3437750 to 3563051 tid 3 2020-06-12T02:35:59.957 INFO:tasks.rados.rados.0.smithi142.stdout:197: delete oid 50 current snap is 19 2020-06-12T02:35:59.957 INFO:tasks.rados.rados.0.smithi142.stdout:195: finishing rollback tid 1 to smithi14213939-49 2020-06-12T02:35:59.957 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 49 v 0 (ObjNum -443258848 snap 21999 seq_num 0) dirty dne 2020-06-12T02:35:59.962 INFO:tasks.rados.rados.0.smithi142.stdout:196: finishing write tid 1 to smithi14213939-31 2020-06-12T02:35:59.964 INFO:tasks.rados.rados.0.smithi142.stdout:195: done (2 left) 2020-06-12T02:35:59.965 INFO:tasks.rados.rados.0.smithi142.stdout:197: done (1 left) 2020-06-12T02:35:59.966 INFO:tasks.rados.rados.0.smithi142.stdout:198: rollback oid 47 current snap is 19 2020-06-12T02:35:59.966 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 47 to 18 2020-06-12T02:35:59.967 INFO:tasks.rados.rados.0.smithi142.stdout:199: rollback oid 35 current snap is 19 2020-06-12T02:35:59.967 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 35 to 10 2020-06-12T02:35:59.967 INFO:tasks.rados.rados.0.smithi142.stdout:200: write oid 48 current snap is 19 2020-06-12T02:35:59.967 INFO:tasks.rados.rados.0.smithi142.stdout:200: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2020-06-12T02:35:59.973 INFO:tasks.rados.rados.0.smithi142.stdout:200: writing smithi14213939-48 from 796665 to 1341556 tid 1 2020-06-12T02:35:59.980 INFO:tasks.rados.rados.0.smithi142.stdout:200: writing smithi14213939-48 from 1759554 to 2410243 tid 2 2020-06-12T02:35:59.989 INFO:tasks.rados.rados.0.smithi142.stdout:200: writing smithi14213939-48 from 2976243 to 3596665 tid 3 2020-06-12T02:35:59.989 INFO:tasks.rados.rados.0.smithi142.stdout:199: finishing rollback tid 0 to smithi14213939-35 2020-06-12T02:35:59.989 INFO:tasks.rados.rados.0.smithi142.stdout:199: finishing rollback tid 1 to smithi14213939-35 2020-06-12T02:35:59.990 INFO:tasks.rados.rados.0.smithi142.stdout:199: finishing rollback tid 2 to smithi14213939-35 2020-06-12T02:35:59.990 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 56 (ObjNum 75 snap 10 seq_num 75) dirty exists 2020-06-12T02:35:59.990 INFO:tasks.rados.rados.0.smithi142.stdout:196: finishing write tid 2 to smithi14213939-31 2020-06-12T02:35:59.990 INFO:tasks.rados.rados.0.smithi142.stdout:196: finishing write tid 3 to smithi14213939-31 2020-06-12T02:35:59.990 INFO:tasks.rados.rados.0.smithi142.stdout:198: finishing rollback tid 0 to smithi14213939-47 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:196: finishing write tid 5 to smithi14213939-31 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:200: finishing write tid 1 to smithi14213939-48 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:196: finishing write tid 6 to smithi14213939-31 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 84 (ObjNum 93 snap 19 seq_num 93) dirty exists 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:196: left oid 31 (ObjNum 93 snap 19 seq_num 93) 2020-06-12T02:35:59.991 INFO:tasks.rados.rados.0.smithi142.stdout:196: done (3 left) 2020-06-12T02:35:59.992 INFO:tasks.rados.rados.0.smithi142.stdout:199: done (2 left) 2020-06-12T02:35:59.992 INFO:tasks.rados.rados.0.smithi142.stdout:201: write oid 18 current snap is 19 2020-06-12T02:35:59.992 INFO:tasks.rados.rados.0.smithi142.stdout:201: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2020-06-12T02:35:59.993 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:35:59.988+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:35:59.995 INFO:tasks.rados.rados.0.smithi142.stdout:201: writing smithi14213939-18 from 413472 to 1033612 tid 1 2020-06-12T02:36:00.004 INFO:tasks.rados.rados.0.smithi142.stdout:201: writing smithi14213939-18 from 1818036 to 2328736 tid 2 2020-06-12T02:36:00.012 INFO:tasks.rados.rados.0.smithi142.stdout:201: writing smithi14213939-18 from 3120019 to 3613472 tid 3 2020-06-12T02:36:00.012 INFO:tasks.rados.rados.0.smithi142.stdout:202: read oid 20 snap -1 2020-06-12T02:36:00.013 INFO:tasks.rados.rados.0.smithi142.stdout:202: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:36:00.013 INFO:tasks.rados.rados.0.smithi142.stdout:200: finishing write tid 2 to smithi14213939-48 2020-06-12T02:36:00.013 INFO:tasks.rados.rados.0.smithi142.stdout:200: finishing write tid 3 to smithi14213939-48 2020-06-12T02:36:00.014 INFO:tasks.rados.rados.0.smithi142.stdout:200: finishing write tid 5 to smithi14213939-48 2020-06-12T02:36:00.014 INFO:tasks.rados.rados.0.smithi142.stdout:200: finishing write tid 6 to smithi14213939-48 2020-06-12T02:36:00.014 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 16 (ObjNum 95 snap 19 seq_num 95) dirty exists 2020-06-12T02:36:00.015 INFO:tasks.rados.rados.0.smithi142.stdout:200: left oid 48 (ObjNum 95 snap 19 seq_num 95) 2020-06-12T02:36:00.015 INFO:tasks.rados.rados.0.smithi142.stdout:201: finishing write tid 1 to smithi14213939-18 2020-06-12T02:36:00.015 INFO:tasks.rados.rados.0.smithi142.stdout:200: done (3 left) 2020-06-12T02:36:00.015 INFO:tasks.rados.rados.0.smithi142.stdout:203: write (excl) oid 43 current snap is 19 2020-06-12T02:36:00.015 INFO:tasks.rados.rados.0.smithi142.stdout:203: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2020-06-12T02:36:00.019 INFO:tasks.rados.rados.0.smithi142.stdout:203: writing smithi14213939-43 from 430279 to 1125668 tid 1 2020-06-12T02:36:00.029 INFO:tasks.rados.rados.0.smithi142.stdout:203: writing smithi14213939-43 from 1876518 to 2530876 tid 2 2020-06-12T02:36:00.036 INFO:tasks.rados.rados.0.smithi142.stdout:203: writing smithi14213939-43 from 3031089 to 3567886 tid 3 2020-06-12T02:36:00.036 INFO:tasks.rados.rados.0.smithi142.stdout:204: snap_remove snap 17 2020-06-12T02:36:00.045 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:00.046 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:00.046 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:00.046 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:00.058 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:00.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:00.088+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:00.192 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:00.192+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:00.207 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:00.208 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:00.208 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:00.209 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:00.209 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:00.225 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:00.294 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:00.292+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:00.333 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:00.334 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:00.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:00.334 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:00.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.335 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:00.335 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:00.335 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.607532679999998, 2020-06-12T02:36:00.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:36:00.335 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:36:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:00.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:36:00.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:36:00.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:36:00.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:36:00.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:36:00.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:36:00.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:36:00.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:36:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:36:00.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:36:00.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:36:00.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:36:00.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:36:00.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:36:00.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:36:00.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:36:00.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:36:00.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:36:00.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:36:00.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:36:00.403 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:281 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:00.405 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:00.405 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.177995085999999, 2020-06-12T02:36:00.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096, 2020-06-12T02:36:00.405 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.405 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 281 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.406 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:00.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:00.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186672 2020-06-12T02:36:00.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149082+0000", 2020-06-12T02:36:00.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2646e-05 2020-06-12T02:36:00.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149105+0000", 2020-06-12T02:36:00.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3996999999999999e-05 2020-06-12T02:36:00.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149149+0000", 2020-06-12T02:36:00.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7149000000000001e-05 2020-06-12T02:36:00.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149166+0000", 2020-06-12T02:36:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2340000000000003e-05 2020-06-12T02:36:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149228+0000", 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5540000000000003e-06 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149235+0000", 2020-06-12T02:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046072830000000002 2020-06-12T02:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153842+0000", 2020-06-12T02:36:00.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109907 2020-06-12T02:36:00.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153952+0000", 2020-06-12T02:36:00.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087530520000000007 2020-06-12T02:36:00.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.162705+0000", 2020-06-12T02:36:00.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096 2020-06-12T02:36:00.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:00.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:00.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.177553428, 2020-06-12T02:36:00.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:36:00.430 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.430 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.431 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:36:00.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.432 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:00.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:36:00.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:36:00.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:36:00.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:36:00.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:36:00.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:36:00.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:00.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:36:00.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:36:00.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:36:00.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:36:00.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:36:00.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:36:00.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:36:00.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:36:00.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.442 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.443 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:00.443 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:00.444 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.061590262999999, 2020-06-12T02:36:00.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:36:00.444 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.444 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:00.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:00.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:36:00.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:36:00.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:36:00.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:36:00.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:36:00.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:36:00.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:36:00.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:36:00.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:36:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:36:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:36:00.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:36:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:36:00.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.457 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.457 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.061213261999999, 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.458 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.459 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.459 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.459 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:36:00.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:00.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:00.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:36:00.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:36:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:36:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:36:00.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:36:00.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:36:00.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:36:00.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:36:00.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:36:00.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:36:00.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:36:00.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:00.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:36:00.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:36:00.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:36:00.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:36:00.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:36:00.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:36:00.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:36:00.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:36:00.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:36:00.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:36:00.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.476 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.477 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:00.477 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.060803727, 2020-06-12T02:36:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:36:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:00.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:00.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:36:00.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:36:00.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:36:00.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:36:00.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:36:00.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:36:00.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:36:00.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:36:00.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:36:00.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:36:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:36:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:36:00.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:36:00.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:36:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:36:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:36:00.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:36:00.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.492 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.495 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:00.495 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:00.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.060411395999999, 2020-06-12T02:36:00.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:36:00.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.496 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.496 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:00.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:00.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:36:00.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:36:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:36:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:36:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:36:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:36:00.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:36:00.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:00.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:36:00.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:36:00.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:36:00.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:36:00.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:36:00.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:36:00.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:36:00.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:36:00.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.509 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.510 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.510 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:00.510 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.043476968, 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:36:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:00.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:36:00.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:36:00.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:36:00.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:36:00.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:36:00.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:36:00.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:36:00.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:36:00.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:36:00.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:36:00.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.524 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.524 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:00.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:00.525 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.037482368999999, 2020-06-12T02:36:00.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:36:00.525 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.525 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:36:00.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:00.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:36:00.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:36:00.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:36:00.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:36:00.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:36:00.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:36:00.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:36:00.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:36:00.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:36:00.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:36:00.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:36:00.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:36:00.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:36:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:36:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:36:00.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:36:00.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:36:00.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:36:00.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:36:00.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:36:00.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:00.543 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:00.543 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.036345794999999, 2020-06-12T02:36:00.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:36:00.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.544 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.545 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.545 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:36:00.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.545 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:00.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:00.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:36:00.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:36:00.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:00.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:36:00.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:36:00.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:36:00.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:36:00.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:36:00.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:36:00.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:36:00.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:36:00.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:36:00.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:36:00.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:36:00.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:36:00.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:36:00.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:36:00.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:36:00.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:36:00.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:36:00.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:36:00.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.559 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.560 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:00.561 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:00.561 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.036163697999999, 2020-06-12T02:36:00.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:36:00.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:36:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:00.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:00.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:36:00.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:36:00.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:36:00.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:36:00.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:36:00.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:36:00.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:36:00.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:36:00.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:36:00.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:36:00.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:36:00.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:36:00.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:36:00.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:36:00.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:36:00.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:36:00.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:36:00.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:36:00.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:36:00.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.578 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.579 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:336 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:00.579 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:00.579 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.389433637, 2020-06-12T02:36:00.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001, 2020-06-12T02:36:00.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.580 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.580 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.580 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.581 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.581 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 336 2020-06-12T02:36:00.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.581 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:00.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:00.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218168 2020-06-12T02:36:00.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937675+0000", 2020-06-12T02:36:00.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6641000000000001e-05 2020-06-12T02:36:00.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937702+0000", 2020-06-12T02:36:00.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.93e-05 2020-06-12T02:36:00.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937741+0000", 2020-06-12T02:36:00.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7470999999999999e-05 2020-06-12T02:36:00.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937759+0000", 2020-06-12T02:36:00.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026446970000000001 2020-06-12T02:36:00.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940403+0000", 2020-06-12T02:36:00.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034423 2020-06-12T02:36:00.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940748+0000", 2020-06-12T02:36:00.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032312690000000002 2020-06-12T02:36:00.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.943979+0000", 2020-06-12T02:36:00.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112213 2020-06-12T02:36:00.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944091+0000", 2020-06-12T02:36:00.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079256210000000007 2020-06-12T02:36:00.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.952017+0000", 2020-06-12T02:36:00.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001 2020-06-12T02:36:00.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:00.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:00.597 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.388978376000001, 2020-06-12T02:36:00.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:36:00.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:36:00.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.599 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:00.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:00.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:36:00.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:36:00.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:36:00.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:36:00.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:36:00.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:36:00.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:36:00.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:36:00.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:36:00.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:36:00.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:36:00.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:36:00.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:36:00.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:36:00.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:36:00.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:36:00.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:36:00.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:36:00.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:36:00.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.614 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.615 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:00.615 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:00.615 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.388665987, 2020-06-12T02:36:00.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:36:00.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.616 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.616 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.616 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.616 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:36:00.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.617 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:00.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:00.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:36:00.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:36:00.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:36:00.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:36:00.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:36:00.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:36:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:36:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:36:00.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:36:00.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:36:00.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:36:00.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:36:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:36:00.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:36:00.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:36:00.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:36:00.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:36:00.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:36:00.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:36:00.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.629 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:461 1.es0 1:7b491eff:::smithi14213939-42:head [rollback c] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:00.636 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.123339849000001, 2020-06-12T02:36:00.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436, 2020-06-12T02:36:00.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.637 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 461 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:00.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:00.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6435999999999997e-05 2020-06-12T02:36:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203637+0000", 2020-06-12T02:36:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9480000000000003e-06 2020-06-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203647+0000", 2020-06-12T02:36:00.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8502e-05 2020-06-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203666+0000", 2020-06-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8129999999999998e-06 2020-06-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203673+0000", 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096826799999999999 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204641+0000", 2020-06-12T02:36:00.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119819 2020-06-12T02:36:00.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204761+0000", 2020-06-12T02:36:00.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064195699999999997 2020-06-12T02:36:00.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.205403+0000", 2020-06-12T02:36:00.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072440109999999999 2020-06-12T02:36:00.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212647+0000", 2020-06-12T02:36:00.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053321380000000002 2020-06-12T02:36:00.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.217979+0000", 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4543999999999995e-05 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218073+0000", 2020-06-12T02:36:00.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436 2020-06-12T02:36:00.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.652 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:462 1.es0 1:7b491eff:::smithi14213939-42:head [append 0~0] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:00.652 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:00.652 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.123146042, 2020-06-12T02:36:00.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904, 2020-06-12T02:36:00.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.654 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 462 2020-06-12T02:36:00.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.654 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:00.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1038999999999995e-05 2020-06-12T02:36:00.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203816+0000", 2020-06-12T02:36:00.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2599999999999994e-06 2020-06-12T02:36:00.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203825+0000", 2020-06-12T02:36:00.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8184000000000001e-05 2020-06-12T02:36:00.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203843+0000", 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4880000000000004e-06 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203850+0000", 2020-06-12T02:36:00.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022970600000000001 2020-06-12T02:36:00.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206147+0000", 2020-06-12T02:36:00.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000178705 2020-06-12T02:36:00.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206325+0000", 2020-06-12T02:36:00.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00081980599999999996 2020-06-12T02:36:00.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.207145+0000", 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010946226 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218091+0000", 2020-06-12T02:36:00.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016788799999999999 2020-06-12T02:36:00.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218259+0000", 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9247999999999996e-05 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218359+0000", 2020-06-12T02:36:00.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904 2020-06-12T02:36:00.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:512 1.as0 1:583b628a:::smithi14213939-40:head [sparse-read 0~2386561] snapc 0=[] ondisk+read+known_if_redirected e42)", 2020-06-12T02:36:00.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:00.667 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.073238698999999, 2020-06-12T02:36:00.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001, 2020-06-12T02:36:00.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2020-06-12T02:36:00.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.669 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:00.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:00.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9982999999999999e-05 2020-06-12T02:36:00.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253702+0000", 2020-06-12T02:36:00.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2009999999999996e-06 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253708+0000", 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1005000000000001e-05 2020-06-12T02:36:00.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253719+0000", 2020-06-12T02:36:00.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9659999999999998e-06 2020-06-12T02:36:00.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253723+0000", 2020-06-12T02:36:00.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027125069999999999 2020-06-12T02:36:00.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256436+0000", 2020-06-12T02:36:00.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010001300000000001 2020-06-12T02:36:00.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256536+0000", 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010807363 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.267343+0000", 2020-06-12T02:36:00.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001 2020-06-12T02:36:00.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.677 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.678 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:00.678 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:00.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.3770973949999998, 2020-06-12T02:36:00.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:36:00.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.679 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:00.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:36:00.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:36:00.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:36:00.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:36:00.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:36:00.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:36:00.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:00.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:36:00.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:36:00.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:36:00.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:36:00.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:36:00.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:36:00.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:36:00.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:36:00.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:36:00.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:36:00.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:00.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:00.695 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.3767579369999998, 2020-06-12T02:36:00.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:36:00.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:00.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:00.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:36:00.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:36:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:36:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:36:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:36:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:36:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:36:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:36:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:36:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:36:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:36:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:36:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.3764614919999998, 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:36:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:36:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:36:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:36:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:36:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:36:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:36:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:00.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:36:00.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:36:00.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:00.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:36:00.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:36:00.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:00.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:36:00.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:36:00.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:36:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:36:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:36:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:36:00.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:00.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:00.727 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:00.727 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:00.729 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:00.728+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:00.730 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:00.832 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:00.828+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:00.894 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:00.886+0000 7fac24f94700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:00.898 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:00.898 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:00.898 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:00.898 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:00.899 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:00.894+0000 7fac24f94700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:00.906 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:00.931 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:00.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:00.928+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:00.959 INFO:tasks.rados.rados.0.smithi142.stdout:204: done (4 left) 2020-06-12T02:36:00.959 INFO:tasks.rados.rados.0.smithi142.stdout:205: write oid 14 current snap is 19 2020-06-12T02:36:00.959 INFO:tasks.rados.rados.0.smithi142.stdout:205: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2020-06-12T02:36:00.960 INFO:tasks.rados.rados.0.smithi142.stdout:205: writing smithi14213939-14 from 447086 to 1217724 tid 1 2020-06-12T02:36:00.963 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:00.964 INFO:tasks.rados.rados.0.smithi142.stdout:205: writing smithi14213939-14 from 1935000 to 2733016 tid 2 2020-06-12T02:36:00.970 INFO:tasks.rados.rados.0.smithi142.stdout:205: writing smithi14213939-14 from 3458512 to 3647086 tid 3 2020-06-12T02:36:00.970 INFO:tasks.rados.rados.0.smithi142.stdout:206: snap_create 2020-06-12T02:36:00.970 INFO:tasks.rados.rados.0.smithi142.stdout:202: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:36:00.981 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:01.001 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:01.018 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.019 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.022 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:01.028 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:01.045 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:01.046 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:01.038+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:01.049 INFO:tasks.rados.rados.0.smithi142.stdout:203: finishing write tid 1 to smithi14213939-43 2020-06-12T02:36:01.050 INFO:tasks.rados.rados.0.smithi142.stdout:203: finishing write tid 2 to smithi14213939-43 2020-06-12T02:36:01.050 INFO:tasks.rados.rados.0.smithi142.stdout:203: finishing write tid 3 to smithi14213939-43 2020-06-12T02:36:01.050 INFO:tasks.rados.rados.0.smithi142.stdout:203: finishing write tid 5 to smithi14213939-43 2020-06-12T02:36:01.050 INFO:tasks.rados.rados.0.smithi142.stdout:203: finishing write tid 6 to smithi14213939-43 2020-06-12T02:36:01.050 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 43 v 36 (ObjNum 97 snap 19 seq_num 97) dirty exists 2020-06-12T02:36:01.051 INFO:tasks.rados.rados.0.smithi142.stdout:203: left oid 43 (ObjNum 97 snap 19 seq_num 97) 2020-06-12T02:36:01.051 INFO:tasks.rados.rados.0.smithi142.stdout:198: finishing rollback tid 1 to smithi14213939-47 2020-06-12T02:36:01.051 INFO:tasks.rados.rados.0.smithi142.stdout:198: finishing rollback tid 2 to smithi14213939-47 2020-06-12T02:36:01.051 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 123 (ObjNum 78 snap 10 seq_num 78) dirty exists 2020-06-12T02:36:01.051 INFO:tasks.rados.rados.0.smithi142.stdout:201: finishing write tid 2 to smithi14213939-18 2020-06-12T02:36:01.052 INFO:tasks.rados.rados.0.smithi142.stdout:201: finishing write tid 3 to smithi14213939-18 2020-06-12T02:36:01.052 INFO:tasks.rados.rados.0.smithi142.stdout:201: finishing write tid 5 to smithi14213939-18 2020-06-12T02:36:01.052 INFO:tasks.rados.rados.0.smithi142.stdout:201: finishing write tid 6 to smithi14213939-18 2020-06-12T02:36:01.052 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 18 v 89 (ObjNum 96 snap 19 seq_num 96) dirty exists 2020-06-12T02:36:01.052 INFO:tasks.rados.rados.0.smithi142.stdout:201: left oid 18 (ObjNum 96 snap 19 seq_num 96) 2020-06-12T02:36:01.066 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:01.091 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:01.092 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.092 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.092 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.094 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.094 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.094 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.094 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.094 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:01.154 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:01.142+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:01.155 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.155 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.167 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:01.262 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:01.258+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:01.330 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.331 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.339 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:01.334+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:01.339 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:01.454 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:01.438+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:01.498 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.499 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.508 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:01.550 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:01.546+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:01.644 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:01.638+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:01.661 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.661 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.671 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:01.745 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:01.742+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:01.783 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.783 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.792 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:01.846 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:01.842+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:01.907 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:01.908 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:01.921 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:01.949 INFO:tasks.rados.rados.0.smithi142.stdout:198: done (5 left) 2020-06-12T02:36:01.949 INFO:tasks.rados.rados.0.smithi142.stdout:201: done (4 left) 2020-06-12T02:36:01.949 INFO:tasks.rados.rados.0.smithi142.stdout:202: done (3 left) 2020-06-12T02:36:01.950 INFO:tasks.rados.rados.0.smithi142.stdout:203: done (2 left) 2020-06-12T02:36:01.950 INFO:tasks.rados.rados.0.smithi142.stdout:206: done (1 left) 2020-06-12T02:36:01.950 INFO:tasks.rados.rados.0.smithi142.stdout:207: read oid 31 snap -1 2020-06-12T02:36:01.950 INFO:tasks.rados.rados.0.smithi142.stdout:207: expect (ObjNum 93 snap 19 seq_num 93) 2020-06-12T02:36:01.951 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:01.942+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:01.965 INFO:tasks.rados.rados.0.smithi142.stdout:208: write oid 13 current snap is 20 2020-06-12T02:36:01.966 INFO:tasks.rados.rados.0.smithi142.stdout:208: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2020-06-12T02:36:01.967 INFO:tasks.rados.rados.0.smithi142.stdout:208: writing smithi14213939-13 from 463893 to 1026133 tid 1 2020-06-12T02:36:01.967 INFO:tasks.rados.rados.0.smithi142.stdout:208: writing smithi14213939-13 from 1593482 to 2251509 tid 2 2020-06-12T02:36:01.971 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:36:01.974 INFO:tasks.rados.rados.0.smithi142.stdout:208: writing smithi14213939-13 from 2685935 to 3245276 tid 3 2020-06-12T02:36:01.974 INFO:tasks.rados.rados.0.smithi142.stdout:209: write (excl) oid 41 current snap is 20 2020-06-12T02:36:01.974 INFO:tasks.rados.rados.0.smithi142.stdout:209: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2020-06-12T02:36:01.981 INFO:tasks.rados.rados.0.smithi142.stdout:209: writing smithi14213939-41 from 480700 to 1118189 tid 1 2020-06-12T02:36:01.988 INFO:tasks.rados.rados.0.smithi142.stdout:209: writing smithi14213939-41 from 1651964 to 2053649 tid 2 2020-06-12T02:36:01.997 INFO:tasks.rados.rados.0.smithi142.stdout:209: writing smithi14213939-41 from 2713358 to 3483971 tid 3 2020-06-12T02:36:01.998 INFO:tasks.rados.rados.0.smithi142.stdout:210: rollback oid 43 current snap is 20 2020-06-12T02:36:01.998 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 43 to 19 2020-06-12T02:36:01.998 INFO:tasks.rados.rados.0.smithi142.stdout:207: expect (ObjNum 93 snap 19 seq_num 93) 2020-06-12T02:36:02.042 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.043 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.048 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:02.042+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:02.051 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:02.081 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:02.070+0000 7fd71d198700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:02.087 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:02.078+0000 7fd71c997700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:02.149 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:02.146+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:02.157 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.157 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.168 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:02.188 INFO:tasks.rados.rados.0.smithi142.stdout:208: finishing write tid 1 to smithi14213939-13 2020-06-12T02:36:02.188 INFO:tasks.rados.rados.0.smithi142.stdout:205: finishing write tid 1 to smithi14213939-14 2020-06-12T02:36:02.188 INFO:tasks.rados.rados.0.smithi142.stdout:205: finishing write tid 2 to smithi14213939-14 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:205: finishing write tid 3 to smithi14213939-14 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:205: finishing write tid 5 to smithi14213939-14 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:208: finishing write tid 2 to smithi14213939-13 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:205: finishing write tid 6 to smithi14213939-14 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 14 v 105 (ObjNum 98 snap 19 seq_num 98) dirty exists 2020-06-12T02:36:02.189 INFO:tasks.rados.rados.0.smithi142.stdout:205: left oid 14 (ObjNum 98 snap 19 seq_num 98) 2020-06-12T02:36:02.190 INFO:tasks.rados.rados.0.smithi142.stdout:208: finishing write tid 3 to smithi14213939-13 2020-06-12T02:36:02.190 INFO:tasks.rados.rados.0.smithi142.stdout:208: finishing write tid 5 to smithi14213939-13 2020-06-12T02:36:02.190 INFO:tasks.rados.rados.0.smithi142.stdout:208: finishing write tid 6 to smithi14213939-13 2020-06-12T02:36:02.190 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 31 (ObjNum 99 snap 20 seq_num 99) dirty exists 2020-06-12T02:36:02.190 INFO:tasks.rados.rados.0.smithi142.stdout:208: left oid 13 (ObjNum 99 snap 20 seq_num 99) 2020-06-12T02:36:02.191 INFO:tasks.rados.rados.0.smithi142.stdout:209: finishing write tid 1 to smithi14213939-41 2020-06-12T02:36:02.191 INFO:tasks.rados.rados.0.smithi142.stdout:210: finishing rollback tid 0 to smithi14213939-43 2020-06-12T02:36:02.191 INFO:tasks.rados.rados.0.smithi142.stdout:210: finishing rollback tid 1 to smithi14213939-43 2020-06-12T02:36:02.191 INFO:tasks.rados.rados.0.smithi142.stdout:209: finishing write tid 2 to smithi14213939-41 2020-06-12T02:36:02.191 INFO:tasks.rados.rados.0.smithi142.stdout:209: finishing write tid 3 to smithi14213939-41 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:209: finishing write tid 5 to smithi14213939-41 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:210: finishing rollback tid 2 to smithi14213939-43 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 43 v 42 (ObjNum 97 snap 19 seq_num 97) dirty exists 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:209: finishing write tid 6 to smithi14213939-41 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 41 v 11 (ObjNum 100 snap 20 seq_num 100) dirty exists 2020-06-12T02:36:02.192 INFO:tasks.rados.rados.0.smithi142.stdout:209: left oid 41 (ObjNum 100 snap 20 seq_num 100) 2020-06-12T02:36:02.193 INFO:tasks.rados.rados.0.smithi142.stdout:205: done (4 left) 2020-06-12T02:36:02.194 INFO:tasks.rados.rados.0.smithi142.stdout:207: done (3 left) 2020-06-12T02:36:02.194 INFO:tasks.rados.rados.0.smithi142.stdout:208: done (2 left) 2020-06-12T02:36:02.194 INFO:tasks.rados.rados.0.smithi142.stdout:209: done (1 left) 2020-06-12T02:36:02.195 INFO:tasks.rados.rados.0.smithi142.stdout:210: done (0 left) 2020-06-12T02:36:02.195 INFO:tasks.rados.rados.0.smithi142.stdout:211: snap_create 2020-06-12T02:36:02.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:02.247+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:02.284 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.284 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.293 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:02.351 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:02.346+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:02.446 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.447 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:02.447+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:02.456 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:02.552 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:02.546+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:02.608 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.608 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.618 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:02.653 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:02.646+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:02.725 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.725 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.734 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:02.785 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:02.783+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:02.850 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:02.850 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:02.855 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:02.850+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:02.861 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:02.956 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:02.950+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:02.963 INFO:tasks.rados.rados.0.smithi142.stdout:211: done (0 left) 2020-06-12T02:36:02.964 INFO:tasks.rados.rados.0.smithi142.stdout:212: write (excl) oid 6 current snap is 21 2020-06-12T02:36:02.964 INFO:tasks.rados.rados.0.smithi142.stdout:212: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2020-06-12T02:36:02.965 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:36:02.973 INFO:tasks.rados.rados.0.smithi142.stdout:212: writing smithi14213939-6 from 497507 to 1210245 tid 1 2020-06-12T02:36:02.976 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:36:02.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:36:02.977 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2020-06-12T02:36:02.977 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd test-reweight-by-utilization 110 1.0 2020-06-12T02:36:02.981 INFO:tasks.rados.rados.0.smithi142.stdout:212: writing smithi14213939-6 from 1710446 to 2372142 tid 2 2020-06-12T02:36:02.989 INFO:tasks.rados.rados.0.smithi142.stdout:212: writing smithi14213939-6 from 3140781 to 3697507 tid 3 2020-06-12T02:36:02.990 INFO:tasks.rados.rados.0.smithi142.stdout:213: rollback oid 36 current snap is 21 2020-06-12T02:36:02.990 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 36 to 18 2020-06-12T02:36:02.990 INFO:tasks.rados.rados.0.smithi142.stdout:214: read oid 24 snap 12 2020-06-12T02:36:02.991 INFO:tasks.rados.rados.0.smithi142.stdout:214: expect (ObjNum 76 snap 10 seq_num 76) 2020-06-12T02:36:02.991 INFO:tasks.rados.rados.0.smithi142.stdout:215: delete oid 46 current snap is 21 2020-06-12T02:36:02.991 INFO:tasks.rados.rados.0.smithi142.stdout:212: finishing write tid 1 to smithi14213939-6 2020-06-12T02:36:03.001 INFO:tasks.rados.rados.0.smithi142.stdout:213: finishing rollback tid 0 to smithi14213939-36 2020-06-12T02:36:03.002 INFO:tasks.rados.rados.0.smithi142.stdout:213: finishing rollback tid 1 to smithi14213939-36 2020-06-12T02:36:03.004 INFO:tasks.rados.rados.0.smithi142.stdout:212: finishing write tid 2 to smithi14213939-6 2020-06-12T02:36:03.005 INFO:tasks.rados.rados.0.smithi142.stdout:212: finishing write tid 3 to smithi14213939-6 2020-06-12T02:36:03.005 INFO:tasks.rados.rados.0.smithi142.stdout:213: finishing rollback tid 2 to smithi14213939-36 2020-06-12T02:36:03.006 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 64 (ObjNum 35 snap 0 seq_num 35) dirty exists 2020-06-12T02:36:03.023 INFO:tasks.rados.rados.0.smithi142.stdout:212: finishing write tid 5 to smithi14213939-6 2020-06-12T02:36:03.023 INFO:tasks.rados.rados.0.smithi142.stdout:212: finishing write tid 6 to smithi14213939-6 2020-06-12T02:36:03.023 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 112 (ObjNum 101 snap 21 seq_num 101) dirty exists 2020-06-12T02:36:03.023 INFO:tasks.rados.rados.0.smithi142.stdout:212: left oid 6 (ObjNum 101 snap 21 seq_num 101) 2020-06-12T02:36:03.024 INFO:tasks.rados.rados.0.smithi142.stdout:214: expect (ObjNum 76 snap 10 seq_num 76) 2020-06-12T02:36:03.027 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:03.027 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:03.036 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:03.081 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:03.078+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:03.106 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:03.109 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.086+0000 7fafcf053700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.110 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.098+0000 7fafcf053700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.134 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:03.134 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:03.144 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:03.178 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:03.158+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:03.179 INFO:tasks.rados.rados.0.smithi142.stdout:212: done (3 left) 2020-06-12T02:36:03.179 INFO:tasks.rados.rados.0.smithi142.stdout:213: done (2 left) 2020-06-12T02:36:03.179 INFO:tasks.rados.rados.0.smithi142.stdout:214: done (1 left) 2020-06-12T02:36:03.180 INFO:tasks.rados.rados.0.smithi142.stdout:215: done (0 left) 2020-06-12T02:36:03.180 INFO:tasks.rados.rados.0.smithi142.stdout:216: snap_create 2020-06-12T02:36:03.222 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.214+0000 7feea2de7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.224 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.218+0000 7feea2de7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.255 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:03.259 INFO:teuthology.orchestra.run.smithi142.stdout:moved 0 / 48 (0%) 2020-06-12T02:36:03.260 INFO:teuthology.orchestra.run.smithi142.stdout:avg 6.85714 2020-06-12T02:36:03.260 INFO:teuthology.orchestra.run.smithi142.stdout:stddev 1.35526 -> 1.35526 (expected baseline 2.42437) 2020-06-12T02:36:03.260 INFO:teuthology.orchestra.run.smithi142.stdout:min osd.7 with 5 -> 5 pgs (0.729167 -> 0.729167 * mean) 2020-06-12T02:36:03.260 INFO:teuthology.orchestra.run.smithi142.stdout:max osd.4 with 9 -> 9 pgs (1.3125 -> 1.3125 * mean) 2020-06-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi142.stdout:oload 110 2020-06-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi142.stdout:max_change 1 2020-06-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi142.stdout:max_change_osds 4 2020-06-12T02:36:03.261 INFO:teuthology.orchestra.run.smithi142.stdout:average_utilization 0.0114 2020-06-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi142.stdout:overload_utilization 0.0125 2020-06-12T02:36:03.262 INFO:teuthology.orchestra.run.smithi142.stderr:no change 2020-06-12T02:36:03.263 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:03.258+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:03.273 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-06-12T02:36:03.273 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd test-reweight-by-utilization 1000 3.0 2020-06-12T02:36:03.276 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:03.307 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:03.307 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:03.307 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:03.308 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:03.341 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:03.363 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:03.358+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:03.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:03.404 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:03.408 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.394+0000 7fbddb9f1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.406+0000 7fbdda78f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.420 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:03.420 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:03.421 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:03.421 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:03.430 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:03.434 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:03.466 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:03.458+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:03.471 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:03.537 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:03.538 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:03.538 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:03.538 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:03.538 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:03.547 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:03.566 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:03.562+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi142.stdout:moved 0 / 48 (0%) 2020-06-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi142.stdout:avg 6.85714 2020-06-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi142.stdout:stddev 1.35526 -> 1.35526 (expected baseline 2.42437) 2020-06-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi142.stdout:min osd.7 with 5 -> 5 pgs (0.729167 -> 0.729167 * mean) 2020-06-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi142.stdout:max osd.4 with 9 -> 9 pgs (1.3125 -> 1.3125 * mean) 2020-06-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:03.578 INFO:teuthology.orchestra.run.smithi142.stdout:oload 1000 2020-06-12T02:36:03.578 INFO:teuthology.orchestra.run.smithi142.stdout:max_change 3 2020-06-12T02:36:03.578 INFO:teuthology.orchestra.run.smithi142.stdout:max_change_osds 4 2020-06-12T02:36:03.578 INFO:teuthology.orchestra.run.smithi142.stdout:average_utilization 0.0114 2020-06-12T02:36:03.579 INFO:teuthology.orchestra.run.smithi142.stdout:overload_utilization 0.1140 2020-06-12T02:36:03.579 INFO:teuthology.orchestra.run.smithi142.stderr:no change 2020-06-12T02:36:03.589 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-06-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd test-reweight-by-utilization 1000 3.0 2020-06-12T02:36:03.665 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:03.666 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:03.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:03.666 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:03.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.666 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:03.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:03.667 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.553706535000003, 2020-06-12T02:36:03.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:36:03.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.667 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.668 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:03.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:03.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:36:03.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:36:03.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:36:03.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:36:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:36:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:36:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:36:03.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:36:03.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:36:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:36:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:36:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:36:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:36:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:36:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:36:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:36:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:36:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:36:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:36:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:36:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:36:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.553536168000001, 2020-06-12T02:36:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:36:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:36:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:36:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:36:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:36:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:36:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:36:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:36:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:36:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:36:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:36:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:36:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:36:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:36:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:36:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:36:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:36:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:36:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:36:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:36:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:36:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:36:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:36:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:208 1.2s0 1:40342bec:::smithi14213939-47:head [write 440350~460568] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:36:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.542015937999999, 2020-06-12T02:36:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998, 2020-06-12T02:36:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 208 2020-06-12T02:36:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:36:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109159+0000", 2020-06-12T02:36:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000287497 2020-06-12T02:36:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109447+0000", 2020-06-12T02:36:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6830000000000002e-06 2020-06-12T02:36:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109453+0000", 2020-06-12T02:36:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6283e-05 2020-06-12T02:36:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109470+0000", 2020-06-12T02:36:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0479999999999998e-06 2020-06-12T02:36:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109475+0000", 2020-06-12T02:36:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6121e-05 2020-06-12T02:36:03.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109531+0000", 2020-06-12T02:36:03.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114108 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.109645+0000", 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035523009999999999 2020-06-12T02:36:03.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.113197+0000", 2020-06-12T02:36:03.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013270552 2020-06-12T02:36:03.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126468+0000", 2020-06-12T02:36:03.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023953399999999999 2020-06-12T02:36:03.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126707+0000", 2020-06-12T02:36:03.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013569499999999999 2020-06-12T02:36:03.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126843+0000", 2020-06-12T02:36:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017683821999999998 2020-06-12T02:36:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.535398141000002, 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:36:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:36:03.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:36:03.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:36:03.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:36:03.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:36:03.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:36:03.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:36:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:36:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:36:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:36:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:36:03.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:36:03.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:36:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:36:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:36:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:36:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.529461257999998, 2020-06-12T02:36:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:36:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:36:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:36:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:36:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:36:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:36:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:36:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:36:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:36:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:36:03.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:36:03.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:36:03.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:36:03.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:36:03.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:36:03.757 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.757 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.757 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.528952187000002, 2020-06-12T02:36:03.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:36:03.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.759 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:36:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:36:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:36:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:36:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:36:03.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:36:03.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:36:03.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:36:03.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:36:03.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:36:03.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:36:03.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:36:03.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:36:03.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:36:03.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:36:03.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:36:03.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:36:03.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:36:03.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:36:03.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:36:03.777 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.777 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.777 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.528793921000002, 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.779 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:36:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:36:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:36:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:36:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:36:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:36:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:36:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:36:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:36:03.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:36:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:36:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:36:03.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:36:03.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:36:03.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:36:03.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.792 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:298 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:03.792 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:36:03.792 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.473776347000001, 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982, 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.794 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 298 2020-06-12T02:36:03.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.794 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:36:03.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177399+0000", 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2509999999999995e-05 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177471+0000", 2020-06-12T02:36:03.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5789999999999993e-06 2020-06-12T02:36:03.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177481+0000", 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7801000000000001e-05 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177499+0000", 2020-06-12T02:36:03.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0701e-05 2020-06-12T02:36:03.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.177509+0000", 2020-06-12T02:36:03.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057272240000000004 2020-06-12T02:36:03.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183237+0000", 2020-06-12T02:36:03.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018898499999999999 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.183426+0000", 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00076048100000000003 2020-06-12T02:36:03.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.184186+0000", 2020-06-12T02:36:03.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037303620000000001 2020-06-12T02:36:03.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.187916+0000", 2020-06-12T02:36:03.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032542600000000001 2020-06-12T02:36:03.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191171+0000", 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5078999999999999e-05 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.191226+0000", 2020-06-12T02:36:03.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013826982 2020-06-12T02:36:03.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:03.806 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.454397118999999, 2020-06-12T02:36:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:36:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:03.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:36:03.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:36:03.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:36:03.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:36:03.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:36:03.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:36:03.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:36:03.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:36:03.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:36:03.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:36:03.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:36:03.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:36:03.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.820 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:451 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 2941380~419987] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:03.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:36:03.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.448037916000001, 2020-06-12T02:36:03.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001, 2020-06-12T02:36:03.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.822 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 451 2020-06-12T02:36:03.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203137+0000", 2020-06-12T02:36:03.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000289315 2020-06-12T02:36:03.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203427+0000", 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3359999999999995e-06 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203435+0000", 2020-06-12T02:36:03.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9905999999999999e-05 2020-06-12T02:36:03.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203455+0000", 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2639999999999997e-06 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203464+0000", 2020-06-12T02:36:03.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046779599999999998 2020-06-12T02:36:03.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203932+0000", 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1891999999999994e-05 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204024+0000", 2020-06-12T02:36:03.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069815440000000001 2020-06-12T02:36:03.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.211005+0000", 2020-06-12T02:36:03.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036673360000000002 2020-06-12T02:36:03.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214673+0000", 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077744160000000001 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222447+0000", 2020-06-12T02:36:03.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129228 2020-06-12T02:36:03.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222576+0000", 2020-06-12T02:36:03.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019439033000000001 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.834 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:452 1.2s0 1:4fe4d12b:::smithi14213939-34:head [setxattr _header (57) in=7b,truncate 3361367] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:03.835 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:36:03.835 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.447588235000001, 2020-06-12T02:36:03.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001, 2020-06-12T02:36:03.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 452 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.836 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:36:03.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203587+0000", 2020-06-12T02:36:03.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107166 2020-06-12T02:36:03.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203694+0000", 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2969999999999992e-06 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203703+0000", 2020-06-12T02:36:03.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7147e-05 2020-06-12T02:36:03.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203721+0000", 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4060000000000002e-06 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203727+0000", 2020-06-12T02:36:03.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557648 2020-06-12T02:36:03.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204285+0000", 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013640700000000001 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204421+0000", 2020-06-12T02:36:03.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080134209999999997 2020-06-12T02:36:03.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212434+0000", 2020-06-12T02:36:03.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002242675 2020-06-12T02:36:03.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.214677+0000", 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080765639999999996 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222754+0000", 2020-06-12T02:36:03.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016176999999999999 2020-06-12T02:36:03.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.222915+0000", 2020-06-12T02:36:03.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019328501000000001 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.848 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:36:03.849 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:03.849 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.447386297000001, 2020-06-12T02:36:03.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:36:03.849 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.849 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:03.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:36:03.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:03.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:36:03.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:36:03.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:36:03.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:36:03.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:36:03.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:36:03.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:36:03.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:36:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:36:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:36:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:36:03.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.861 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.862 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:522 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 695823~777044] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:36:03.862 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:36:03.862 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.717902354, 2020-06-12T02:36:03.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001, 2020-06-12T02:36:03.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 522 2020-06-12T02:36:03.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.864 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:36:03.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933273+0000", 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056703400000000001 2020-06-12T02:36:03.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933840+0000", 2020-06-12T02:36:03.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0903e-05 2020-06-12T02:36:03.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933851+0000", 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6198e-05 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933867+0000", 2020-06-12T02:36:03.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:03.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933875+0000", 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9525999999999997e-05 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933955+0000", 2020-06-12T02:36:03.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0988000000000001e-05 2020-06-12T02:36:03.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:03.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.933966+0000", 2020-06-12T02:36:03.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036756929999999998 2020-06-12T02:36:03.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937641+0000", 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013941800000000001 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.937781+0000", 2020-06-12T02:36:03.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074804579999999997 2020-06-12T02:36:03.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.945261+0000", 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044656610000000001 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949727+0000", 2020-06-12T02:36:03.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036480600000000002 2020-06-12T02:36:03.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950092+0000", 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105678 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.950197+0000", 2020-06-12T02:36:03.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016924416000000001 2020-06-12T02:36:03.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.877 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:523 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 1925015~639682] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:36:03.878 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.708553798000001, 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272, 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.880 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.880 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 523 2020-06-12T02:36:03.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.880 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:36:03.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942621+0000", 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032343600000000003 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942945+0000", 2020-06-12T02:36:03.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1165000000000001e-05 2020-06-12T02:36:03.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942956+0000", 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7815000000000001e-05 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942974+0000", 2020-06-12T02:36:03.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1079999999999999e-06 2020-06-12T02:36:03.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.942983+0000", 2020-06-12T02:36:03.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.198e-05 2020-06-12T02:36:03.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943045+0000", 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015003600000000001 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.943195+0000", 2020-06-12T02:36:03.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012239308000000001 2020-06-12T02:36:03.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.955434+0000", 2020-06-12T02:36:03.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031130979999999999 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.958547+0000", 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021421489999999999 2020-06-12T02:36:03.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960689+0000", 2020-06-12T02:36:03.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7176999999999996e-05 2020-06-12T02:36:03.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960777+0000", 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018155272 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.891 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.892 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:524 1.2s0 1:4edac3c4:::smithi14213939-9:head [write 3328058~167765] snapc 16=[16,13,11,a] ondisk+write+known_if_redirected e43)", 2020-06-12T02:36:03.892 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:36:03.893 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.702853285, 2020-06-12T02:36:03.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478, 2020-06-12T02:36:03.893 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.893 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 524 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:36:03.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948322+0000", 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027316900000000003 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948595+0000", 2020-06-12T02:36:03.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4909999999999994e-06 2020-06-12T02:36:03.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948605+0000", 2020-06-12T02:36:03.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5495999999999999e-05 2020-06-12T02:36:03.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948620+0000", 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9129999999999997e-06 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948627+0000", 2020-06-12T02:36:03.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025216099999999999 2020-06-12T02:36:03.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948879+0000", 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014658800000000001 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949026+0000", 2020-06-12T02:36:03.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083404719999999998 2020-06-12T02:36:03.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.957366+0000", 2020-06-12T02:36:03.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029182449999999999 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960284+0000", 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069633399999999995 2020-06-12T02:36:03.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.960981+0000", 2020-06-12T02:36:03.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0608999999999999e-05 2020-06-12T02:36:03.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.961071+0000", 2020-06-12T02:36:03.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012749478 2020-06-12T02:36:03.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:526 1.2s0 1:4edac3c4:::smithi14213939-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e43)", 2020-06-12T02:36:03.906 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:36:03.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.702331085000001, 2020-06-12T02:36:03.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001, 2020-06-12T02:36:03.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:03.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.908 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 526 2020-06-12T02:36:03.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:36:03.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948844+0000", 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6243999999999999e-05 2020-06-12T02:36:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948900+0000", 2020-06-12T02:36:03.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4939999999999997e-06 2020-06-12T02:36:03.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948908+0000", 2020-06-12T02:36:03.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3456e-05 2020-06-12T02:36:03.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948921+0000", 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8409999999999996e-06 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.948927+0000", 2020-06-12T02:36:03.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0009970039999999999 2020-06-12T02:36:03.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949924+0000", 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4784999999999996e-05 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.949999+0000", 2020-06-12T02:36:03.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012073782 2020-06-12T02:36:03.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962073+0000", 2020-06-12T02:36:03.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132726 2020-06-12T02:36:03.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.962205+0000", 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010140240000000001 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.963219+0000", 2020-06-12T02:36:03.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014375356000000001 2020-06-12T02:36:03.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.919 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:538 1.2s0 1:40a24690:::smithi14213939-8:head [write 729437~527542] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.702961262000001, 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001, 2020-06-12T02:36:03.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.921 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.921 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.921 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.921 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.921 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 538 2020-06-12T02:36:03.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.922 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948214+0000", 2020-06-12T02:36:03.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031614799999999998 2020-06-12T02:36:03.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948530+0000", 2020-06-12T02:36:03.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6116e-05 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948546+0000", 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4805999999999999e-05 2020-06-12T02:36:03.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948571+0000", 2020-06-12T02:36:03.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4479e-05 2020-06-12T02:36:03.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948585+0000", 2020-06-12T02:36:03.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9798999999999998e-05 2020-06-12T02:36:03.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948685+0000", 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018751 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.948873+0000", 2020-06-12T02:36:03.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056200729999999997 2020-06-12T02:36:03.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.954493+0000", 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050674220000000002 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959560+0000", 2020-06-12T02:36:03.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036640399999999999 2020-06-12T02:36:03.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963224+0000", 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111121 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.963335+0000", 2020-06-12T02:36:03.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015121514000000001 2020-06-12T02:36:03.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.933 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.934 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:539 1.2s0 1:40a24690:::smithi14213939-8:head [write 1925626~643351] snapc 18=[18,16,13,11,a] ondisk+write+known_if_redirected e44)", 2020-06-12T02:36:03.934 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:36:03.934 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.692638605000001, 2020-06-12T02:36:03.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379, 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.935 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 539 2020-06-12T02:36:03.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.936 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958537+0000", 2020-06-12T02:36:03.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000305001 2020-06-12T02:36:03.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958842+0000", 2020-06-12T02:36:03.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8190000000000003e-06 2020-06-12T02:36:03.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958851+0000", 2020-06-12T02:36:03.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2416999999999999e-05 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958874+0000", 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4691999999999999e-05 2020-06-12T02:36:03.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.958888+0000", 2020-06-12T02:36:03.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018018600000000001 2020-06-12T02:36:03.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959069+0000", 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017349999999999999 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.959242+0000", 2020-06-12T02:36:03.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091864670000000002 2020-06-12T02:36:03.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.968429+0000", 2020-06-12T02:36:03.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059461899999999996 2020-06-12T02:36:03.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974375+0000", 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042622100000000001 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974801+0000", 2020-06-12T02:36:03.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9296999999999996e-05 2020-06-12T02:36:03.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:50.974890+0000", 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01635379 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.948 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:03.948 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:03.948 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6875997539999998, 2020-06-12T02:36:03.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:36:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:03.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:36:03.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:36:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:36:03.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:36:03.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:36:03.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:36:03.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:36:03.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:36:03.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:03.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:36:03.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:36:03.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:36:03.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:36:03.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:36:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:36:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:36:03.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:36:03.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:36:03.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:36:03.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:36:03.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6874721579999998, 2020-06-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:03.967 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.968 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:03.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:03.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:03.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:03.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:03.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:03.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:36:03.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:03.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:36:03.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:36:03.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:03.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:36:03.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:36:03.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:03.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:36:03.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:36:03.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:36:03.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:36:03.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:03.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:36:03.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:36:03.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:03.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:36:03.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:36:03.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:03.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:36:03.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:36:03.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:03.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:03.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:03.984 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:03.985 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:03.987 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.730+0000 7f4f8c9af700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.987 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:03.746+0000 7f4f8759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:03.987 INFO:teuthology.orchestra.run.smithi142.stderr:no change 2020-06-12T02:36:03.987 INFO:teuthology.orchestra.run.smithi142.stdout:moved 0 / 48 (0%) 2020-06-12T02:36:03.988 INFO:teuthology.orchestra.run.smithi142.stdout:avg 6.85714 2020-06-12T02:36:03.988 INFO:teuthology.orchestra.run.smithi142.stdout:stddev 1.35526 -> 1.35526 (expected baseline 2.42437) 2020-06-12T02:36:03.988 INFO:teuthology.orchestra.run.smithi142.stdout:min osd.7 with 5 -> 5 pgs (0.729167 -> 0.729167 * mean) 2020-06-12T02:36:03.988 INFO:teuthology.orchestra.run.smithi142.stdout:max osd.4 with 9 -> 9 pgs (1.3125 -> 1.3125 * mean) 2020-06-12T02:36:03.988 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:oload 1000 2020-06-12T02:36:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:max_change 3 2020-06-12T02:36:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:max_change_osds 4 2020-06-12T02:36:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:average_utilization 0.0114 2020-06-12T02:36:03.989 INFO:teuthology.orchestra.run.smithi142.stdout:overload_utilization 0.1140 2020-06-12T02:36:03.990 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2020-06-12T02:36:03.990 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd test-reweight-by-utilization 1000 0.05 2020-06-12T02:36:03.991 INFO:tasks.rados.rados.0.smithi142.stdout:216: done (0 left) 2020-06-12T02:36:03.991 INFO:tasks.rados.rados.0.smithi142.stdout:217: read oid 46 snap -1 2020-06-12T02:36:03.991 INFO:tasks.rados.rados.0.smithi142.stdout:217: expect deleted 2020-06-12T02:36:03.991 INFO:tasks.rados.rados.0.smithi142.stdout:218: copy_from oid 44 from oid 34 current snap is 22 2020-06-12T02:36:03.991 INFO:tasks.rados.rados.0.smithi142.stdout:219: rollback oid 28 current snap is 22 2020-06-12T02:36:03.992 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 28 to 20 2020-06-12T02:36:03.992 INFO:tasks.rados.rados.0.smithi142.stdout:220: read oid 31 snap -1 2020-06-12T02:36:03.992 INFO:tasks.rados.rados.0.smithi142.stdout:220: expect (ObjNum 93 snap 19 seq_num 93) 2020-06-12T02:36:03.992 INFO:tasks.rados.rados.0.smithi142.stdout:221: delete oid 16 current snap is 22 2020-06-12T02:36:03.994 INFO:tasks.rados.rados.0.smithi142.stdout:220: expect (ObjNum 93 snap 19 seq_num 93) 2020-06-12T02:36:03.994 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:03.986+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:04.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:04.086+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:04.092 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:04.082+0000 7f0f40d78700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:04.099 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:04.090+0000 7f0f40d78700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:04.099 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:04.100 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:04.107 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:04.190 INFO:tasks.rados.rados.0.smithi142.stdout:219: finishing rollback tid 0 to smithi14213939-28 2020-06-12T02:36:04.190 INFO:tasks.rados.rados.0.smithi142.stdout:219: finishing rollback tid 1 to smithi14213939-28 2020-06-12T02:36:04.190 INFO:tasks.rados.rados.0.smithi142.stdout:219: finishing rollback tid 2 to smithi14213939-28 2020-06-12T02:36:04.192 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 28 v 68 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:36:04.192 INFO:tasks.rados.rados.0.smithi142.stdout:218: finishing copy_from to smithi14213939-44 2020-06-12T02:36:04.192 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 44 v 3 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:36:04.192 INFO:tasks.rados.rados.0.smithi142.stdout:218: finishing copy_from racing read to smithi14213939-44 2020-06-12T02:36:04.193 INFO:tasks.rados.rados.0.smithi142.stdout:217: done (4 left) 2020-06-12T02:36:04.193 INFO:tasks.rados.rados.0.smithi142.stdout:218: done (3 left) 2020-06-12T02:36:04.193 INFO:tasks.rados.rados.0.smithi142.stdout:219: done (2 left) 2020-06-12T02:36:04.193 INFO:tasks.rados.rados.0.smithi142.stdout:220: done (1 left) 2020-06-12T02:36:04.194 INFO:tasks.rados.rados.0.smithi142.stdout:221: done (0 left) 2020-06-12T02:36:04.194 INFO:tasks.rados.rados.0.smithi142.stdout:222: write oid 22 current snap is 22 2020-06-12T02:36:04.194 INFO:tasks.rados.rados.0.smithi142.stdout:222: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2020-06-12T02:36:04.194 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:04.186+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:04.195 INFO:tasks.rados.rados.0.smithi142.stdout:222: writing smithi14213939-22 from 547928 to 1086413 tid 1 2020-06-12T02:36:04.202 INFO:tasks.rados.rados.0.smithi142.stdout:222: writing smithi14213939-22 from 1769539 to 2178562 tid 2 2020-06-12T02:36:04.223 INFO:tasks.rados.rados.0.smithi142.stdout:222: writing smithi14213939-22 from 2706697 to 3238751 tid 3 2020-06-12T02:36:04.223 INFO:tasks.rados.rados.0.smithi142.stdout:222: finishing write tid 1 to smithi14213939-22 2020-06-12T02:36:04.223 INFO:tasks.rados.rados.0.smithi142.stdout:223: read oid 19 snap -1 2020-06-12T02:36:04.224 INFO:tasks.rados.rados.0.smithi142.stdout:223: expect (ObjNum 82 snap 12 seq_num 82) 2020-06-12T02:36:04.224 INFO:tasks.rados.rados.0.smithi142.stdout:224: snap_create 2020-06-12T02:36:04.224 INFO:tasks.rados.rados.0.smithi142.stdout:222: finishing write tid 2 to smithi14213939-22 2020-06-12T02:36:04.224 INFO:tasks.rados.rados.0.smithi142.stdout:222: finishing write tid 3 to smithi14213939-22 2020-06-12T02:36:04.224 INFO:tasks.rados.rados.0.smithi142.stdout:222: finishing write tid 5 to smithi14213939-22 2020-06-12T02:36:04.225 INFO:tasks.rados.rados.0.smithi142.stdout:223: expect (ObjNum 82 snap 12 seq_num 82) 2020-06-12T02:36:04.227 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:04.227 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:04.235 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:04.259 INFO:teuthology.orchestra.run.smithi142.stdout:moved 0 / 48 (0%) 2020-06-12T02:36:04.259 INFO:teuthology.orchestra.run.smithi142.stdout:avg 6.85714 2020-06-12T02:36:04.259 INFO:teuthology.orchestra.run.smithi142.stdout:stddev 1.35526 -> 1.35526 (expected baseline 2.42437) 2020-06-12T02:36:04.260 INFO:teuthology.orchestra.run.smithi142.stdout:min osd.7 with 5 -> 5 pgs (0.729167 -> 0.729167 * mean) 2020-06-12T02:36:04.260 INFO:teuthology.orchestra.run.smithi142.stdout:max osd.4 with 9 -> 9 pgs (1.3125 -> 1.3125 * mean) 2020-06-12T02:36:04.260 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:04.260 INFO:teuthology.orchestra.run.smithi142.stdout:oload 1000 2020-06-12T02:36:04.260 INFO:teuthology.orchestra.run.smithi142.stdout:max_change 0.05 2020-06-12T02:36:04.261 INFO:teuthology.orchestra.run.smithi142.stdout:max_change_osds 4 2020-06-12T02:36:04.261 INFO:teuthology.orchestra.run.smithi142.stdout:average_utilization 0.0114 2020-06-12T02:36:04.261 INFO:teuthology.orchestra.run.smithi142.stdout:overload_utilization 0.1142 2020-06-12T02:36:04.263 INFO:teuthology.orchestra.run.smithi142.stderr:no change 2020-06-12T02:36:04.273 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2020-06-12T02:36:04.274 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight-by-utilization 110 0.05 2020-06-12T02:36:04.318 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:04.314+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:04.367 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.642918039999998, 2020-06-12T02:36:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:36:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:36:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:36:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:36:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:36:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:36:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:36:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:36:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:36:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:36:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:36:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:36:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:36:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:36:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:36:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:36:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:281 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 30.213380445999999, 2020-06-12T02:36:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096, 2020-06-12T02:36:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 281 2020-06-12T02:36:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186672 2020-06-12T02:36:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149082+0000", 2020-06-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2646e-05 2020-06-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149105+0000", 2020-06-12T02:36:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3996999999999999e-05 2020-06-12T02:36:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149149+0000", 2020-06-12T02:36:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7149000000000001e-05 2020-06-12T02:36:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149166+0000", 2020-06-12T02:36:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2340000000000003e-05 2020-06-12T02:36:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149228+0000", 2020-06-12T02:36:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5540000000000003e-06 2020-06-12T02:36:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149235+0000", 2020-06-12T02:36:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046072830000000002 2020-06-12T02:36:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153842+0000", 2020-06-12T02:36:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109907 2020-06-12T02:36:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153952+0000", 2020-06-12T02:36:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087530520000000007 2020-06-12T02:36:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.162705+0000", 2020-06-12T02:36:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096 2020-06-12T02:36:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 30.212938787999999, 2020-06-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:36:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:36:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:36:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:36:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:36:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:36:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:36:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:36:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:36:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:36:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:36:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:36:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:36:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:36:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:36:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:36:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.096975622999999, 2020-06-12T02:36:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:36:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:36:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:36:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:36:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:36:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:36:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:36:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.096598621999998, 2020-06-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:36:04.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:36:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:36:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:36:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:36:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:36:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:36:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:36:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:36:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:36:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:36:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:36:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:36:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:36:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:36:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.096189086999999, 2020-06-12T02:36:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:36:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:36:04.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.465 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:36:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:36:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:36:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:36:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:36:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:36:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:36:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:36:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:36:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:36:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:36:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:36:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:36:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:36:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:36:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:36:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:36:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:36:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:36:04.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:36:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.095796755999999, 2020-06-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:36:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:36:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:36:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:36:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:36:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:36:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:36:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:36:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:36:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:36:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:36:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:36:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:36:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:36:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:36:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:36:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:36:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:36:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:36:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:36:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:36:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:36:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:36:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:36:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.078862328, 2020-06-12T02:36:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:36:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:36:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:36:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:36:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:36:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:36:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:36:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:36:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:36:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:36:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:36:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:36:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:36:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:36:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:36:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:36:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:36:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.072867728999999, 2020-06-12T02:36:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:36:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:36:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:36:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:36:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:36:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:36:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:36:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:36:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:36:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:36:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:36:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:36:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:36:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:36:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:36:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:36:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:36:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:36:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:36:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:36:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:36:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.071731154999998, 2020-06-12T02:36:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:36:04.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:36:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:36:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:36:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:36:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:36:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:36:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:36:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:36:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.071549057999999, 2020-06-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:36:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:36:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:36:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:36:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:36:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:36:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:36:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:36:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:36:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:36:04.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:36:04.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:36:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:36:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:336 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.424818996999999, 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001, 2020-06-12T02:36:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 336 2020-06-12T02:36:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218168 2020-06-12T02:36:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937675+0000", 2020-06-12T02:36:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6641000000000001e-05 2020-06-12T02:36:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937702+0000", 2020-06-12T02:36:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.93e-05 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937741+0000", 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7470999999999999e-05 2020-06-12T02:36:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937759+0000", 2020-06-12T02:36:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026446970000000001 2020-06-12T02:36:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940403+0000", 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034423 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940748+0000", 2020-06-12T02:36:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032312690000000002 2020-06-12T02:36:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.943979+0000", 2020-06-12T02:36:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112213 2020-06-12T02:36:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944091+0000", 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079256210000000007 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.952017+0000", 2020-06-12T02:36:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001 2020-06-12T02:36:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.424363736, 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:36:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:36:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:36:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:36:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:36:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:36:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:36:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:36:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:36:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:36:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:36:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:36:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:36:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.424051346999999, 2020-06-12T02:36:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:36:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:36:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:36:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:36:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:36:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:36:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:36:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:36:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:36:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:36:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:36:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:36:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:36:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:36:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:36:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:36:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:36:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:461 1.es0 1:7b491eff:::smithi14213939-42:head [rollback c] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.158725209, 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436, 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 461 2020-06-12T02:36:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6435999999999997e-05 2020-06-12T02:36:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203637+0000", 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9480000000000003e-06 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203647+0000", 2020-06-12T02:36:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8502e-05 2020-06-12T02:36:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203666+0000", 2020-06-12T02:36:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8129999999999998e-06 2020-06-12T02:36:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203673+0000", 2020-06-12T02:36:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096826799999999999 2020-06-12T02:36:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204641+0000", 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119819 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204761+0000", 2020-06-12T02:36:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064195699999999997 2020-06-12T02:36:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.205403+0000", 2020-06-12T02:36:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072440109999999999 2020-06-12T02:36:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212647+0000", 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053321380000000002 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.217979+0000", 2020-06-12T02:36:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4543999999999995e-05 2020-06-12T02:36:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218073+0000", 2020-06-12T02:36:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436 2020-06-12T02:36:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:462 1.es0 1:7b491eff:::smithi14213939-42:head [append 0~0] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.158531402000001, 2020-06-12T02:36:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904, 2020-06-12T02:36:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 462 2020-06-12T02:36:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1038999999999995e-05 2020-06-12T02:36:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203816+0000", 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2599999999999994e-06 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203825+0000", 2020-06-12T02:36:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8184000000000001e-05 2020-06-12T02:36:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203843+0000", 2020-06-12T02:36:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4880000000000004e-06 2020-06-12T02:36:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203850+0000", 2020-06-12T02:36:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022970600000000001 2020-06-12T02:36:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206147+0000", 2020-06-12T02:36:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000178705 2020-06-12T02:36:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206325+0000", 2020-06-12T02:36:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00081980599999999996 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.207145+0000", 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010946226 2020-06-12T02:36:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218091+0000", 2020-06-12T02:36:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016788799999999999 2020-06-12T02:36:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218259+0000", 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9247999999999996e-05 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218359+0000", 2020-06-12T02:36:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904 2020-06-12T02:36:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:512 1.as0 1:583b628a:::smithi14213939-40:head [sparse-read 0~2386561] snapc 0=[] ondisk+read+known_if_redirected e42)", 2020-06-12T02:36:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.108624059, 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001, 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2020-06-12T02:36:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9982999999999999e-05 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253702+0000", 2020-06-12T02:36:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2009999999999996e-06 2020-06-12T02:36:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253708+0000", 2020-06-12T02:36:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1005000000000001e-05 2020-06-12T02:36:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253719+0000", 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9659999999999998e-06 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253723+0000", 2020-06-12T02:36:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027125069999999999 2020-06-12T02:36:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256436+0000", 2020-06-12T02:36:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010001300000000001 2020-06-12T02:36:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256536+0000", 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010807363 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.267343+0000", 2020-06-12T02:36:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001 2020-06-12T02:36:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.412482754999999, 2020-06-12T02:36:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:36:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:36:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:36:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:36:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:36:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:36:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:36:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:36:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:36:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.412143297, 2020-06-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:36:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:36:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:36:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:36:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:36:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:36:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.411846852, 2020-06-12T02:36:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:36:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:36:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:36:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:36:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:36:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:36:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:36:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:36:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:36:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:36:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:36:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:36:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:36:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:36:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:36:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:36:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:04.705 INFO:tasks.rados.rados.0.smithi142.stdout:222: finishing write tid 6 to smithi14213939-22 2020-06-12T02:36:04.705 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 22 v 52 (ObjNum 104 snap 22 seq_num 104) dirty exists 2020-06-12T02:36:04.705 INFO:tasks.rados.rados.0.smithi142.stdout:222: left oid 22 (ObjNum 104 snap 22 seq_num 104) 2020-06-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:04.414+0000 7f0b6db33700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:04.426+0000 7f0b6db33700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi142.stderr:no change 2020-06-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi142.stdout:moved 0 / 48 (0%) 2020-06-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi142.stdout:avg 6.85714 2020-06-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi142.stdout:stddev 1.35526 -> 1.35526 (expected baseline 2.42437) 2020-06-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi142.stdout:min osd.7 with 5 -> 5 pgs (0.729167 -> 0.729167 * mean) 2020-06-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi142.stdout:max osd.4 with 9 -> 9 pgs (1.3125 -> 1.3125 * mean) 2020-06-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi142.stdout:oload 110 2020-06-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi142.stdout:max_change 0.05 2020-06-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi142.stdout:max_change_osds 4 2020-06-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi142.stdout:average_utilization 0.0114 2020-06-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi142.stdout:overload_utilization 0.0126 2020-06-12T02:36:04.709 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:04.698+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:04.806 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:04.798+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:04.825 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:04.826 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:04.826 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:04.826 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:04.838 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:04.905 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:04.898+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:04.933 INFO:tasks.rados.rados.0.smithi142.stdout:222: done (2 left) 2020-06-12T02:36:04.933 INFO:tasks.rados.rados.0.smithi142.stdout:223: done (1 left) 2020-06-12T02:36:04.933 INFO:tasks.rados.rados.0.smithi142.stdout:224: done (0 left) 2020-06-12T02:36:04.933 INFO:tasks.rados.rados.0.smithi142.stdout:225: snap_remove snap 10 2020-06-12T02:36:04.980 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:36:04.992 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:04.993 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:05.001 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:05.051 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:05.042+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:05.087 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:05.074+0000 7fa48cffc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:05.098 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:05.086+0000 7fa48759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:05.106 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:05.102+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:05.161 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.998494887, 2020-06-12T02:36:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.998183384000001, 2020-06-12T02:36:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.200 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:422 1.ds0 1:b8c47ae9:::smithi14213939-24:head [write 1681102~474010] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:36:05.200 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:05.200 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.895414243000001, 2020-06-12T02:36:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619, 2020-06-12T02:36:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 422 2020-06-12T02:36:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00060803099999999998 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260649+0000", 2020-06-12T02:36:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5483999999999999e-05 2020-06-12T02:36:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260674+0000", 2020-06-12T02:36:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4036000000000003e-05 2020-06-12T02:36:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260718+0000", 2020-06-12T02:36:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8003999999999999e-05 2020-06-12T02:36:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260736+0000", 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063788600000000005 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261374+0000", 2020-06-12T02:36:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153311 2020-06-12T02:36:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261527+0000", 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011428038 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272955+0000", 2020-06-12T02:36:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118906 2020-06-12T02:36:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273074+0000", 2020-06-12T02:36:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037998620000000002 2020-06-12T02:36:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276874+0000", 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065599220000000001 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283434+0000", 2020-06-12T02:36:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128603 2020-06-12T02:36:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283563+0000", 2020-06-12T02:36:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120536 2020-06-12T02:36:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283683+0000", 2020-06-12T02:36:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619 2020-06-12T02:36:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:425 1.ds0 1:b8c47ae9:::smithi14213939-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:36:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.887766027000001, 2020-06-12T02:36:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999, 2020-06-12T02:36:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 425 2020-06-12T02:36:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3261999999999999e-05 2020-06-12T02:36:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267712+0000", 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.472e-06 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267715+0000", 2020-06-12T02:36:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6889999999999998e-06 2020-06-12T02:36:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267722+0000", 2020-06-12T02:36:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.616e-06 2020-06-12T02:36:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267725+0000", 2020-06-12T02:36:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00083742500000000004 2020-06-12T02:36:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.268562+0000", 2020-06-12T02:36:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024361180000000001 2020-06-12T02:36:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.270998+0000", 2020-06-12T02:36:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039727 2020-06-12T02:36:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.274971+0000", 2020-06-12T02:36:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0976000000000004e-05 2020-06-12T02:36:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.275062+0000", 2020-06-12T02:36:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011605994 2020-06-12T02:36:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286668+0000", 2020-06-12T02:36:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000157675 2020-06-12T02:36:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286826+0000", 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073582880000000002 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294184+0000", 2020-06-12T02:36:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999 2020-06-12T02:36:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:444 1.5s0 1:a8df2b52:::smithi14213939-27:head [write 544560~783450] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.225617749000001, 2020-06-12T02:36:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001, 2020-06-12T02:36:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 444 2020-06-12T02:36:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041368699999999998 2020-06-12T02:36:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930251+0000", 2020-06-12T02:36:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0767999999999999e-05 2020-06-12T02:36:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930261+0000", 2020-06-12T02:36:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6778000000000001e-05 2020-06-12T02:36:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930278+0000", 2020-06-12T02:36:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0348e-05 2020-06-12T02:36:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930289+0000", 2020-06-12T02:36:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100268 2020-06-12T02:36:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930389+0000", 2020-06-12T02:36:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2133000000000001e-05 2020-06-12T02:36:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930401+0000", 2020-06-12T02:36:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003798161 2020-06-12T02:36:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934199+0000", 2020-06-12T02:36:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000124413 2020-06-12T02:36:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934324+0000", 2020-06-12T02:36:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001950249 2020-06-12T02:36:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.936274+0000", 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086764879999999996 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.944950+0000", 2020-06-12T02:36:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071019539999999997 2020-06-12T02:36:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952052+0000", 2020-06-12T02:36:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012448599999999999 2020-06-12T02:36:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952177+0000", 2020-06-12T02:36:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001 2020-06-12T02:36:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.205932817000001, 2020-06-12T02:36:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.205416138, 2020-06-12T02:36:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2029097039999996, 2020-06-12T02:36:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2027297079999997, 2020-06-12T02:36:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2025946159999998, 2020-06-12T02:36:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:573 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2024203519999999, 2020-06-12T02:36:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281, 2020-06-12T02:36:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 573 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0703000000000003e-05 2020-06-12T02:36:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953115+0000", 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.96e-06 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953123+0000", 2020-06-12T02:36:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3210000000000001e-05 2020-06-12T02:36:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953136+0000", 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8659999999999997e-06 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953141+0000", 2020-06-12T02:36:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00054970300000000002 2020-06-12T02:36:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953691+0000", 2020-06-12T02:36:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6529999999999994e-06 2020-06-12T02:36:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953698+0000", 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040487869999999999 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957747+0000", 2020-06-12T02:36:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7700000000000003e-07 2020-06-12T02:36:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957748+0000", 2020-06-12T02:36:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015554228 2020-06-12T02:36:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973302+0000", 2020-06-12T02:36:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020247700000000001 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973505+0000", 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047224210000000001 2020-06-12T02:36:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978227+0000", 2020-06-12T02:36:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015839599999999999 2020-06-12T02:36:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978386+0000", 2020-06-12T02:36:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281 2020-06-12T02:36:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:574 1.ds0 1:bb6dbdab:::smithi14213939-46:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2022700549999996, 2020-06-12T02:36:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998, 2020-06-12T02:36:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 574 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5772999999999997e-05 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953230+0000", 2020-06-12T02:36:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6329999999999996e-06 2020-06-12T02:36:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953238+0000", 2020-06-12T02:36:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3053e-05 2020-06-12T02:36:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953251+0000", 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1039999999999998e-06 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953256+0000", 2020-06-12T02:36:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046425299999999997 2020-06-12T02:36:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953721+0000", 2020-06-12T02:36:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5349999999999999e-06 2020-06-12T02:36:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953728+0000", 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040455209999999998 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957774+0000", 2020-06-12T02:36:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0550000000000001e-06 2020-06-12T02:36:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957775+0000", 2020-06-12T02:36:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015755697999999999 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973530+0000", 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2848e-05 2020-06-12T02:36:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973573+0000", 2020-06-12T02:36:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048625020000000003 2020-06-12T02:36:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978436+0000", 2020-06-12T02:36:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012710299999999999 2020-06-12T02:36:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978563+0000", 2020-06-12T02:36:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998 2020-06-12T02:36:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:575 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.2021458809999999, 2020-06-12T02:36:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999, 2020-06-12T02:36:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 575 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8362000000000006e-05 2020-06-12T02:36:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953387+0000", 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5710000000000003e-06 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953394+0000", 2020-06-12T02:36:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3081999999999999e-05 2020-06-12T02:36:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953407+0000", 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953412+0000", 2020-06-12T02:36:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000338394 2020-06-12T02:36:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953751+0000", 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1470000000000001e-06 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953759+0000", 2020-06-12T02:36:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040449010000000001 2020-06-12T02:36:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957804+0000", 2020-06-12T02:36:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7770000000000001e-06 2020-06-12T02:36:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957806+0000", 2020-06-12T02:36:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015827687999999999 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973633+0000", 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3745999999999998e-05 2020-06-12T02:36:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973667+0000", 2020-06-12T02:36:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049250680000000003 2020-06-12T02:36:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978592+0000", 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3843000000000005e-05 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978656+0000", 2020-06-12T02:36:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999 2020-06-12T02:36:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:579 1.5s0 1:aa8c60b3:::smithi14213939-31:head [write 2158943~647020] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2044419189999997, 2020-06-12T02:36:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001, 2020-06-12T02:36:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 579 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032091999999999998 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951334+0000", 2020-06-12T02:36:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0485e-05 2020-06-12T02:36:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951344+0000", 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0214999999999999e-05 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951364+0000", 2020-06-12T02:36:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7785e-05 2020-06-12T02:36:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951382+0000", 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1069999999999996e-05 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951443+0000", 2020-06-12T02:36:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015391999999999999 2020-06-12T02:36:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951597+0000", 2020-06-12T02:36:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014059853000000001 2020-06-12T02:36:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.965657+0000", 2020-06-12T02:36:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003128432 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968786+0000", 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042710819999999998 2020-06-12T02:36:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973057+0000", 2020-06-12T02:36:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024853800000000002 2020-06-12T02:36:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973305+0000", 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:581 1.5s0 1:aa8c60b3:::smithi14213939-31:head [setxattr _header (57) in=7b,truncate 3563051] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:05.404 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1995739729999997, 2020-06-12T02:36:05.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999, 2020-06-12T02:36:05.404 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.404 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.404 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 581 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1825999999999998e-05 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955973+0000", 2020-06-12T02:36:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1440000000000003e-06 2020-06-12T02:36:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955981+0000", 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2928000000000001e-05 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955994+0000", 2020-06-12T02:36:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6300000000000003e-06 2020-06-12T02:36:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955999+0000", 2020-06-12T02:36:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040354799999999999 2020-06-12T02:36:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956403+0000", 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010726300000000001 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956510+0000", 2020-06-12T02:36:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011669656 2020-06-12T02:36:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968180+0000", 2020-06-12T02:36:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024867209999999999 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.970666+0000", 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072037769999999998 2020-06-12T02:36:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977870+0000", 2020-06-12T02:36:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106267 2020-06-12T02:36:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977977+0000", 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:582 1.5s0 1:aa8c60b3:::smithi14213939-31:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1993968720000003, 2020-06-12T02:36:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962, 2020-06-12T02:36:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 582 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7505e-05 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956105+0000", 2020-06-12T02:36:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.311e-06 2020-06-12T02:36:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956113+0000", 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3230999999999999e-05 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956126+0000", 2020-06-12T02:36:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:36:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956131+0000", 2020-06-12T02:36:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00057600900000000005 2020-06-12T02:36:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956707+0000", 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000126515 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956833+0000", 2020-06-12T02:36:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021768708000000001 2020-06-12T02:36:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978602+0000", 2020-06-12T02:36:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012831499999999999 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978730+0000", 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017164490000000001 2020-06-12T02:36:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.980447+0000", 2020-06-12T02:36:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962 2020-06-12T02:36:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1530043450000003, 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1449575550000004, 2020-06-12T02:36:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1446121910000002, 2020-06-12T02:36:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.1444806380000001, 2020-06-12T02:36:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:05.490 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:05.492 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:05.492 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:05.485+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:05.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:05.585+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:05.638+0000 7fe4e7709700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:05.647 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:05.648 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:05.646+0000 7fe4e64a7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:05.658 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:05.681 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:05.692 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:05.685+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:05.702 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:05.721 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:05.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:05.762 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:05.762 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:05.768 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:05.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:05.785+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:05.894 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:05.885+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:05.918 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:05.919 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:05.928 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:05.958 INFO:tasks.rados.rados.0.smithi142.stdout:225: done (0 left) 2020-06-12T02:36:05.958 INFO:tasks.rados.rados.0.smithi142.stdout:226: rollback oid 47 current snap is 23 2020-06-12T02:36:05.958 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 47 to 19 2020-06-12T02:36:05.959 INFO:tasks.rados.rados.0.smithi142.stdout:227: read oid 2 snap -1 2020-06-12T02:36:05.959 INFO:tasks.rados.rados.0.smithi142.stdout:227: expect (ObjNum 53 snap 3 seq_num 53) 2020-06-12T02:36:05.959 INFO:tasks.rados.rados.0.smithi142.stdout:228: write (excl) oid 36 current snap is 23 2020-06-12T02:36:05.959 INFO:tasks.rados.rados.0.smithi142.stdout:228: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2020-06-12T02:36:05.959 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:05.950+0000 7f922d310700 -1 osd.3 pg_epoch: 59 pg[1.9s0( v 59'53 (0'0,59'53] local-lis/les=51/52 n=6 ec=18/18 lis/c=51/51 les/c/f=52/52/0 sis=51) [3,4,5]p3(0) r=0 lpr=51 luod=48'51 crt=48'51 lcod 48'51 mlcod 0'0 active+clean+snaptrim trimq=[13~1] ps=[1b~1,1f~1]] removing snap head 2020-06-12T02:36:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:36:05.960 INFO:tasks.rados.rados.0.smithi142.stdout:228: writing smithi14213939-36 from 564735 to 1178469 tid 1 2020-06-12T02:36:05.969 INFO:tasks.rados.rados.0.smithi142.stdout:228: writing smithi14213939-36 from 1828021 to 2497055 tid 2 2020-06-12T02:36:05.981 INFO:tasks.rados.rados.0.smithi142.stdout:228: writing smithi14213939-36 from 3134120 to 3764735 tid 3 2020-06-12T02:36:05.982 INFO:tasks.rados.rados.0.smithi142.stdout:226: finishing rollback tid 0 to smithi14213939-47 2020-06-12T02:36:05.982 INFO:tasks.rados.rados.0.smithi142.stdout:229: rollback oid 23 current snap is 23 2020-06-12T02:36:05.982 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 23 to 15 2020-06-12T02:36:05.982 INFO:tasks.rados.rados.0.smithi142.stdout:230: write (excl) oid 28 current snap is 23 2020-06-12T02:36:05.983 INFO:tasks.rados.rados.0.smithi142.stdout:230: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2020-06-12T02:36:05.989 INFO:tasks.rados.rados.0.smithi142.stdout:230: writing smithi14213939-28 from 581542 to 1270525 tid 1 2020-06-12T02:36:05.990 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:05.998 INFO:tasks.rados.rados.0.smithi142.stdout:230: writing smithi14213939-28 from 1886503 to 2299195 tid 2 2020-06-12T02:36:05.999 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:05.993+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:06.000 INFO:tasks.rados.rados.0.smithi142.stdout:230: writing smithi14213939-28 from 2761543 to 3432494 tid 3 2020-06-12T02:36:06.001 INFO:tasks.rados.rados.0.smithi142.stdout:231: copy_from oid 37 from oid 33 current snap is 23 2020-06-12T02:36:06.001 INFO:tasks.rados.rados.0.smithi142.stdout:226: finishing rollback tid 1 to smithi14213939-47 2020-06-12T02:36:06.001 INFO:tasks.rados.rados.0.smithi142.stdout:226: finishing rollback tid 2 to smithi14213939-47 2020-06-12T02:36:06.002 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 133 (ObjNum 78 snap 10 seq_num 78) dirty exists 2020-06-12T02:36:06.002 INFO:tasks.rados.rados.0.smithi142.stdout:227: expect (ObjNum 53 snap 3 seq_num 53) 2020-06-12T02:36:06.015 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:06.042 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:06.058 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:06.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.059 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.061 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:06.064 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.064 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.075 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:06.119 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:06.113+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:06.130 INFO:tasks.rados.rados.0.smithi142.stdout:229: finishing rollback tid 1 to smithi14213939-23 2020-06-12T02:36:06.131 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 23 v 0 (ObjNum -442323392 snap 21999 seq_num 3556791944) dirty dne 2020-06-12T02:36:06.131 INFO:tasks.rados.rados.0.smithi142.stdout:228: finishing write tid 1 to smithi14213939-36 2020-06-12T02:36:06.131 INFO:tasks.rados.rados.0.smithi142.stdout:226: done (5 left) 2020-06-12T02:36:06.132 INFO:tasks.rados.rados.0.smithi142.stdout:227: done (4 left) 2020-06-12T02:36:06.132 INFO:tasks.rados.rados.0.smithi142.stdout:229: done (3 left) 2020-06-12T02:36:06.132 INFO:tasks.rados.rados.0.smithi142.stdout:232: write (excl) oid 26 current snap is 23 2020-06-12T02:36:06.133 INFO:tasks.rados.rados.0.smithi142.stdout:232: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2020-06-12T02:36:06.137 INFO:tasks.rados.rados.0.smithi142.stdout:232: writing smithi14213939-26 from 598349 to 1078934 tid 1 2020-06-12T02:36:06.147 INFO:tasks.rados.rados.0.smithi142.stdout:232: writing smithi14213939-26 from 1544985 to 2217688 tid 2 2020-06-12T02:36:06.153 INFO:tasks.rados.rados.0.smithi142.stdout:232: writing smithi14213939-26 from 2905319 to 3387542 tid 3 2020-06-12T02:36:06.153 INFO:tasks.rados.rados.0.smithi142.stdout:233: write oid 31 current snap is 23 2020-06-12T02:36:06.153 INFO:tasks.rados.rados.0.smithi142.stdout:233: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2020-06-12T02:36:06.159 INFO:tasks.rados.rados.0.smithi142.stdout:233: writing smithi14213939-31 from 615156 to 1170990 tid 1 2020-06-12T02:36:06.169 INFO:tasks.rados.rados.0.smithi142.stdout:233: writing smithi14213939-31 from 1603467 to 2019828 tid 2 2020-06-12T02:36:06.176 INFO:tasks.rados.rados.0.smithi142.stdout:233: writing smithi14213939-31 from 2816389 to 3509884 tid 3 2020-06-12T02:36:06.176 INFO:tasks.rados.rados.0.smithi142.stdout:234: snap_remove snap 18 2020-06-12T02:36:06.201 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:06.194+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:06.233 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.233 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.242 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:06.302 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:06.298+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:06.339 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.340 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.349 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:06.403 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:06.398+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:06.457 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.457 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.468 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:06.515 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:06.509+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:06.572 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.573 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.583 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:06.627 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:06.621+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:06.705 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:06.702+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:06.739 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.747 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.750 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:06.807 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:06.802+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:06.847 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.847 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.856 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:06.908 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:06.902+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:06.976 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:06.991 INFO:tasks.rados.rados.0.smithi142.stdout:234: done (5 left) 2020-06-12T02:36:06.991 INFO:tasks.rados.rados.0.smithi142.stdout:235: copy_from oid 46 from oid 41 current snap is 23 2020-06-12T02:36:06.991 INFO:tasks.rados.rados.0.smithi142.stdout:230: finishing write tid 1 to smithi14213939-28 2020-06-12T02:36:06.991 INFO:tasks.rados.rados.0.smithi142.stdout:228: finishing write tid 2 to smithi14213939-36 2020-06-12T02:36:06.992 INFO:tasks.rados.rados.0.smithi142.stdout:228: finishing write tid 3 to smithi14213939-36 2020-06-12T02:36:06.992 INFO:tasks.rados.rados.0.smithi142.stdout:228: finishing write tid 5 to smithi14213939-36 2020-06-12T02:36:06.992 INFO:tasks.rados.rados.0.smithi142.stdout:230: finishing write tid 2 to smithi14213939-28 2020-06-12T02:36:06.992 INFO:tasks.rados.rados.0.smithi142.stdout:228: finishing write tid 6 to smithi14213939-36 2020-06-12T02:36:06.992 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 83 (ObjNum 105 snap 23 seq_num 105) dirty exists 2020-06-12T02:36:06.993 INFO:tasks.rados.rados.0.smithi142.stdout:228: left oid 36 (ObjNum 105 snap 23 seq_num 105) 2020-06-12T02:36:06.993 INFO:tasks.rados.rados.0.smithi142.stdout:230: finishing write tid 3 to smithi14213939-28 2020-06-12T02:36:06.997 INFO:tasks.rados.rados.0.smithi142.stdout:230: finishing write tid 5 to smithi14213939-28 2020-06-12T02:36:06.997 INFO:tasks.rados.rados.0.smithi142.stdout:231: finishing copy_from to smithi14213939-37 2020-06-12T02:36:06.997 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 37 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:36:06.997 INFO:tasks.rados.rados.0.smithi142.stdout:230: finishing write tid 6 to smithi14213939-28 2020-06-12T02:36:06.998 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 28 v 86 (ObjNum 106 snap 23 seq_num 106) dirty exists 2020-06-12T02:36:06.998 INFO:tasks.rados.rados.0.smithi142.stdout:230: left oid 28 (ObjNum 106 snap 23 seq_num 106) 2020-06-12T02:36:06.998 INFO:tasks.rados.rados.0.smithi142.stdout:231: finishing copy_from racing read to smithi14213939-37 2020-06-12T02:36:06.998 INFO:tasks.rados.rados.0.smithi142.stdout:232: finishing write tid 1 to smithi14213939-26 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:232: finishing write tid 2 to smithi14213939-26 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:232: finishing write tid 3 to smithi14213939-26 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:232: finishing write tid 5 to smithi14213939-26 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:232: finishing write tid 6 to smithi14213939-26 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 26 v 18 (ObjNum 107 snap 23 seq_num 107) dirty exists 2020-06-12T02:36:06.999 INFO:tasks.rados.rados.0.smithi142.stdout:232: left oid 26 (ObjNum 107 snap 23 seq_num 107) 2020-06-12T02:36:07.000 INFO:tasks.rados.rados.0.smithi142.stdout:233: finishing write tid 1 to smithi14213939-31 2020-06-12T02:36:07.000 INFO:tasks.rados.rados.0.smithi142.stdout:233: finishing write tid 2 to smithi14213939-31 2020-06-12T02:36:07.000 INFO:tasks.rados.rados.0.smithi142.stdout:233: finishing write tid 3 to smithi14213939-31 2020-06-12T02:36:07.000 INFO:tasks.rados.rados.0.smithi142.stdout:233: finishing write tid 5 to smithi14213939-31 2020-06-12T02:36:07.000 INFO:tasks.rados.rados.0.smithi142.stdout:233: finishing write tid 6 to smithi14213939-31 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 104 (ObjNum 108 snap 23 seq_num 108) dirty exists 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:233: left oid 31 (ObjNum 108 snap 23 seq_num 108) 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:228: done (5 left) 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:230: done (4 left) 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:231: done (3 left) 2020-06-12T02:36:07.001 INFO:tasks.rados.rados.0.smithi142.stdout:232: done (2 left) 2020-06-12T02:36:07.002 INFO:tasks.rados.rados.0.smithi142.stdout:233: done (1 left) 2020-06-12T02:36:07.002 INFO:tasks.rados.rados.0.smithi142.stdout:236: write oid 25 current snap is 23 2020-06-12T02:36:07.002 INFO:tasks.rados.rados.0.smithi142.stdout:236: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2020-06-12T02:36:07.003 INFO:tasks.rados.rados.0.smithi142.stdout:236: writing smithi14213939-25 from 631963 to 1263046 tid 1 2020-06-12T02:36:07.013 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:07.002+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:07.014 INFO:tasks.rados.rados.0.smithi142.stdout:236: writing smithi14213939-25 from 2061949 to 2621968 tid 2 2020-06-12T02:36:07.023 INFO:tasks.rados.rados.0.smithi142.stdout:236: writing smithi14213939-25 from 3243812 to 3748579 tid 3 2020-06-12T02:36:07.023 INFO:tasks.rados.rados.0.smithi142.stdout:237: delete oid 44 current snap is 23 2020-06-12T02:36:07.023 INFO:tasks.rados.rados.0.smithi142.stdout:236: finishing write tid 1 to smithi14213939-25 2020-06-12T02:36:07.026 INFO:tasks.rados.rados.0.smithi142.stdout:237: done (2 left) 2020-06-12T02:36:07.027 INFO:tasks.rados.rados.0.smithi142.stdout:238: write (excl) oid 3 current snap is 23 2020-06-12T02:36:07.027 INFO:tasks.rados.rados.0.smithi142.stdout:238: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2020-06-12T02:36:07.037 INFO:tasks.rados.rados.0.smithi142.stdout:238: writing smithi14213939-3 from 665577 to 1447158 tid 1 2020-06-12T02:36:07.046 INFO:tasks.rados.rados.0.smithi142.stdout:238: writing smithi14213939-3 from 2062560 to 2626248 tid 2 2020-06-12T02:36:07.056 INFO:tasks.rados.rados.0.smithi142.stdout:238: writing smithi14213939-3 from 3182305 to 3825969 tid 3 2020-06-12T02:36:07.056 INFO:tasks.rados.rados.0.smithi142.stdout:239: snap_create 2020-06-12T02:36:07.056 INFO:tasks.rados.rados.0.smithi142.stdout:235: finishing copy_from to smithi14213939-46 2020-06-12T02:36:07.057 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 46 v 11 (ObjNum 100 snap 20 seq_num 100) dirty exists 2020-06-12T02:36:07.057 INFO:tasks.rados.rados.0.smithi142.stdout:235: finishing copy_from racing read to smithi14213939-46 2020-06-12T02:36:07.057 INFO:tasks.rados.rados.0.smithi142.stdout:236: finishing write tid 2 to smithi14213939-25 2020-06-12T02:36:07.057 INFO:tasks.rados.rados.0.smithi142.stdout:236: finishing write tid 3 to smithi14213939-25 2020-06-12T02:36:07.057 INFO:tasks.rados.rados.0.smithi142.stdout:236: finishing write tid 5 to smithi14213939-25 2020-06-12T02:36:07.058 INFO:tasks.rados.rados.0.smithi142.stdout:236: finishing write tid 6 to smithi14213939-25 2020-06-12T02:36:07.058 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 25 v 57 (ObjNum 109 snap 23 seq_num 109) dirty exists 2020-06-12T02:36:07.058 INFO:tasks.rados.rados.0.smithi142.stdout:236: left oid 25 (ObjNum 109 snap 23 seq_num 109) 2020-06-12T02:36:07.058 INFO:tasks.rados.rados.0.smithi142.stdout:238: finishing write tid 1 to smithi14213939-3 2020-06-12T02:36:07.058 INFO:tasks.rados.rados.0.smithi142.stdout:238: finishing write tid 2 to smithi14213939-3 2020-06-12T02:36:07.059 INFO:tasks.rados.rados.0.smithi142.stdout:238: finishing write tid 3 to smithi14213939-3 2020-06-12T02:36:07.065 INFO:tasks.rados.rados.0.smithi142.stdout:238: finishing write tid 5 to smithi14213939-3 2020-06-12T02:36:07.069 INFO:tasks.rados.rados.0.smithi142.stdout:238: finishing write tid 6 to smithi14213939-3 2020-06-12T02:36:07.069 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 3 v 62 (ObjNum 111 snap 23 seq_num 111) dirty exists 2020-06-12T02:36:07.070 INFO:tasks.rados.rados.0.smithi142.stdout:238: left oid 3 (ObjNum 111 snap 23 seq_num 111) 2020-06-12T02:36:07.089 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.090 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.098 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:07.118 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:07.110+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:07.211 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.211 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.214 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:07.220 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:07.209+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:07.320 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:07.314+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:07.326 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.326 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.336 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:07.423 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:07.417+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:07.450 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.450 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.453 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:07.524 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:07.518+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:07.572 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.573 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.583 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:07.625 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:07.622+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:07.725 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:07.722+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:07.740 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.740 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.749 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:07.842 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:07.838+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:07.904 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:07.904 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:07.913 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:07.927 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:07.921+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:07.972 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:36:08.006 INFO:tasks.rados.rados.0.smithi142.stdout:235: done (3 left) 2020-06-12T02:36:08.006 INFO:tasks.rados.rados.0.smithi142.stdout:236: done (2 left) 2020-06-12T02:36:08.006 INFO:tasks.rados.rados.0.smithi142.stdout:238: done (1 left) 2020-06-12T02:36:08.006 INFO:tasks.rados.rados.0.smithi142.stdout:239: done (0 left) 2020-06-12T02:36:08.007 INFO:tasks.rados.rados.0.smithi142.stdout:240: copy_from oid 4 from oid 35 current snap is 24 2020-06-12T02:36:08.007 INFO:tasks.rados.rados.0.smithi142.stdout:241: read oid 37 snap 16 2020-06-12T02:36:08.007 INFO:tasks.rados.rados.0.smithi142.stdout:241: expect (ObjNum 49 snap 0 seq_num 49) 2020-06-12T02:36:08.007 INFO:tasks.rados.rados.0.smithi142.stdout:242: write oid 45 current snap is 24 2020-06-12T02:36:08.007 INFO:tasks.rados.rados.0.smithi142.stdout:242: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2020-06-12T02:36:08.015 INFO:tasks.rados.rados.0.smithi142.stdout:242: writing smithi14213939-45 from 682384 to 1139214 tid 1 2020-06-12T02:36:08.023 INFO:tasks.rados.rados.0.smithi142.stdout:242: writing smithi14213939-45 from 1721042 to 2144741 tid 2 2020-06-12T02:36:08.027 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:08.022+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:08.029 INFO:tasks.rados.rados.0.smithi142.stdout:242: writing smithi14213939-45 from 2809728 to 3264664 tid 3 2020-06-12T02:36:08.033 INFO:tasks.rados.rados.0.smithi142.stdout:242: writing smithi14213939-45 from 3731357 to 3882384 tid 4 2020-06-12T02:36:08.033 INFO:tasks.rados.rados.0.smithi142.stdout:243: snap_remove snap 23 2020-06-12T02:36:08.077 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:08.098 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:08.098 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:08.107 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:08.138 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:08.126+0000 7f878c36b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:08.139 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:08.134+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:08.142 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:08.138+0000 7f878c36b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:08.198 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:08.190+0000 7f0233981700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:08.202 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:08.198+0000 7f023271f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:08.232 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:08.222+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:08.235 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:08.247 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:08.248 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:08.254 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:08.257 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:08.279 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:08.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:08.329 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:08.330 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:08.326+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:08.380 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:08.382 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.659371497999999, 2020-06-12T02:36:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:36:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:36:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:36:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:36:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:36:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:36:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:36:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:36:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:36:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:36:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:36:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:36:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:36:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:36:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:36:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:36:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:36:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:36:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:36:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:36:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:36:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:36:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:36:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:281 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.229833904000003, 2020-06-12T02:36:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096, 2020-06-12T02:36:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 281 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.148896+0000", 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186672 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149082+0000", 2020-06-12T02:36:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2646e-05 2020-06-12T02:36:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149105+0000", 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3996999999999999e-05 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149149+0000", 2020-06-12T02:36:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7149000000000001e-05 2020-06-12T02:36:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149166+0000", 2020-06-12T02:36:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2340000000000003e-05 2020-06-12T02:36:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149228+0000", 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5540000000000003e-06 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149235+0000", 2020-06-12T02:36:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046072830000000002 2020-06-12T02:36:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153842+0000", 2020-06-12T02:36:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109907 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.153952+0000", 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087530520000000007 2020-06-12T02:36:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.162705+0000", 2020-06-12T02:36:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0138096 2020-06-12T02:36:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.229392246000003, 2020-06-12T02:36:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:36:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:36:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:36:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:36:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:36:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:36:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:36:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:36:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:36:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:36:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:36:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:36:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:36:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:36:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:36:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:36:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:36:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:36:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.113429081, 2020-06-12T02:36:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:36:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:36:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:36:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:36:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:36:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:36:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:36:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:36:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:36:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:36:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:36:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:36:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:36:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.113052080000003, 2020-06-12T02:36:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:36:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:36:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:36:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:36:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:36:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:36:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:36:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:36:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:36:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:36:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:36:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:36:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:36:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:36:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:36:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:36:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:08.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.112642545, 2020-06-12T02:36:08.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:36:08.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.480 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:36:08.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:36:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:36:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:36:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:36:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:36:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:36:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:36:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:36:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:36:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:36:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:36:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:36:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:36:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:36:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:36:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:36:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:36:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:36:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:36:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.112250213999999, 2020-06-12T02:36:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:36:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:36:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:36:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:36:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:36:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:36:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:36:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:36:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:36:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:36:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:36:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:36:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:36:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:36:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:36:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:36:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:36:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:36:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:36:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:36:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:36:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:36:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:36:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.095315786, 2020-06-12T02:36:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:36:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:36:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:36:08.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:36:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:36:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:36:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:36:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:36:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:36:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:36:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:36:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:36:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:36:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:36:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:36:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:36:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:36:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:36:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:36:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:36:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:36:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.089321187000003, 2020-06-12T02:36:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:36:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:36:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:36:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:36:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:36:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:36:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:36:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:36:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:36:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:36:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:36:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:36:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:36:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.088184613000003, 2020-06-12T02:36:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:36:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:36:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:36:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:36:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:36:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:36:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:36:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:36:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:36:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:36:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:36:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:36:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:36:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:36:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:36:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:36:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:36:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:36:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:36:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.088002516000003, 2020-06-12T02:36:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:36:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:36:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:36:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:36:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:36:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:36:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:36:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:36:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:36:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:36:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:36:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:36:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:36:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:36:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:336 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.441272455, 2020-06-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001, 2020-06-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 336 2020-06-12T02:36:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937457+0000", 2020-06-12T02:36:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218168 2020-06-12T02:36:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937675+0000", 2020-06-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6641000000000001e-05 2020-06-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937702+0000", 2020-06-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.93e-05 2020-06-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937741+0000", 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7470999999999999e-05 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937759+0000", 2020-06-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026446970000000001 2020-06-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940403+0000", 2020-06-12T02:36:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034423 2020-06-12T02:36:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940748+0000", 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032312690000000002 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.943979+0000", 2020-06-12T02:36:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112213 2020-06-12T02:36:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944091+0000", 2020-06-12T02:36:08.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079256210000000007 2020-06-12T02:36:08.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.952017+0000", 2020-06-12T02:36:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014559610000000001 2020-06-12T02:36:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.440817194000001, 2020-06-12T02:36:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:36:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:36:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:36:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:36:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:36:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:36:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:36:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:36:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:36:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:36:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:36:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:36:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:36:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:36:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:36:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.440504805, 2020-06-12T02:36:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:36:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:36:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:36:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:36:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:36:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:36:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:36:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:36:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:36:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:36:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:36:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:36:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:36:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:36:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:36:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:36:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:461 1.es0 1:7b491eff:::smithi14213939-42:head [rollback c] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.175178667000001, 2020-06-12T02:36:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436, 2020-06-12T02:36:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 461 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203551+0000", 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6435999999999997e-05 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203637+0000", 2020-06-12T02:36:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9480000000000003e-06 2020-06-12T02:36:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203647+0000", 2020-06-12T02:36:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8502e-05 2020-06-12T02:36:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203666+0000", 2020-06-12T02:36:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8129999999999998e-06 2020-06-12T02:36:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203673+0000", 2020-06-12T02:36:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096826799999999999 2020-06-12T02:36:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204641+0000", 2020-06-12T02:36:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119819 2020-06-12T02:36:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204761+0000", 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064195699999999997 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.205403+0000", 2020-06-12T02:36:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072440109999999999 2020-06-12T02:36:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.212647+0000", 2020-06-12T02:36:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053321380000000002 2020-06-12T02:36:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.217979+0000", 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4543999999999995e-05 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218073+0000", 2020-06-12T02:36:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014522436 2020-06-12T02:36:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:462 1.es0 1:7b491eff:::smithi14213939-42:head [append 0~0] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.174984859999999, 2020-06-12T02:36:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904, 2020-06-12T02:36:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 462 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1038999999999995e-05 2020-06-12T02:36:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203816+0000", 2020-06-12T02:36:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2599999999999994e-06 2020-06-12T02:36:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203825+0000", 2020-06-12T02:36:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8184000000000001e-05 2020-06-12T02:36:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203843+0000", 2020-06-12T02:36:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4880000000000004e-06 2020-06-12T02:36:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203850+0000", 2020-06-12T02:36:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022970600000000001 2020-06-12T02:36:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206147+0000", 2020-06-12T02:36:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000178705 2020-06-12T02:36:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.206325+0000", 2020-06-12T02:36:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00081980599999999996 2020-06-12T02:36:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.207145+0000", 2020-06-12T02:36:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010946226 2020-06-12T02:36:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218091+0000", 2020-06-12T02:36:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016788799999999999 2020-06-12T02:36:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218259+0000", 2020-06-12T02:36:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9247999999999996e-05 2020-06-12T02:36:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.218359+0000", 2020-06-12T02:36:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014613904 2020-06-12T02:36:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:512 1.as0 1:583b628a:::smithi14213939-40:head [sparse-read 0~2386561] snapc 0=[] ondisk+read+known_if_redirected e42)", 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.125077517000001, 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001, 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2020-06-12T02:36:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253652+0000", 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9982999999999999e-05 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253702+0000", 2020-06-12T02:36:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2009999999999996e-06 2020-06-12T02:36:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253708+0000", 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1005000000000001e-05 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253719+0000", 2020-06-12T02:36:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9659999999999998e-06 2020-06-12T02:36:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.253723+0000", 2020-06-12T02:36:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027125069999999999 2020-06-12T02:36:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256436+0000", 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010001300000000001 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.256536+0000", 2020-06-12T02:36:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010807363 2020-06-12T02:36:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:49.267343+0000", 2020-06-12T02:36:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013691038000000001 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.428936213, 2020-06-12T02:36:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:36:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:36:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:36:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:36:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:36:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:36:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:36:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:36:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:36:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:36:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:36:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:36:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:36:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:36:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:36:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:36:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:36:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:36:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:36:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:36:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:36:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.428596754999999, 2020-06-12T02:36:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:36:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:36:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:36:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:36:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:36:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:36:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:36:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:36:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:36:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:36:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:36:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:36:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:36:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:36:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:36:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:36:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:36:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:36:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:36:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:36:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:36:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.428300309999999, 2020-06-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:36:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:36:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:36:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:36:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:36:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:36:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:36:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:36:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:36:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:36:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:36:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:36:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:36:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:36:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:08.745 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:08.746 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:08.747 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:08.749 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:08.741+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:08.845 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:08.841+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:08.901 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:08.901 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:08.902 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:08.902 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:08.911 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:08.957 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:08.954+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:09.015 INFO:tasks.rados.rados.0.smithi142.stdout:243: done (3 left) 2020-06-12T02:36:09.015 INFO:tasks.rados.rados.0.smithi142.stdout:244: rollback oid 44 current snap is 24 2020-06-12T02:36:09.015 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 44 to 22 2020-06-12T02:36:09.015 INFO:tasks.rados.rados.0.smithi142.stdout:245: snap_create 2020-06-12T02:36:09.016 INFO:tasks.rados.rados.0.smithi142.stdout:241: expect (ObjNum 49 snap 0 seq_num 49) 2020-06-12T02:36:09.030 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:36:09.033 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:09.033 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:09.046 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:09.093 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:09.090+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:09.108 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 1 to smithi14213939-45 2020-06-12T02:36:09.109 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 2 to smithi14213939-45 2020-06-12T02:36:09.109 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 3 to smithi14213939-45 2020-06-12T02:36:09.109 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 4 to smithi14213939-45 2020-06-12T02:36:09.109 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 6 to smithi14213939-45 2020-06-12T02:36:09.109 INFO:tasks.rados.rados.0.smithi142.stdout:242: finishing write tid 7 to smithi14213939-45 2020-06-12T02:36:09.110 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 45 v 28 (ObjNum 112 snap 24 seq_num 112) dirty exists 2020-06-12T02:36:09.110 INFO:tasks.rados.rados.0.smithi142.stdout:242: left oid 45 (ObjNum 112 snap 24 seq_num 112) 2020-06-12T02:36:09.110 INFO:tasks.rados.rados.0.smithi142.stdout:240: finishing copy_from to smithi14213939-4 2020-06-12T02:36:09.110 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 4 v 56 (ObjNum 75 snap 10 seq_num 75) dirty exists 2020-06-12T02:36:09.110 INFO:tasks.rados.rados.0.smithi142.stdout:240: finishing copy_from racing read to smithi14213939-4 2020-06-12T02:36:09.111 INFO:tasks.rados.rados.0.smithi142.stdout:244: finishing rollback tid 1 to smithi14213939-44 2020-06-12T02:36:09.111 INFO:tasks.rados.rados.0.smithi142.stdout:244: finishing rollback tid 2 to smithi14213939-44 2020-06-12T02:36:09.111 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 44 v 62 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:36:09.150 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:09.141+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:09.208 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:09.208 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:09.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:09.209 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:09.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.210 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:09.210 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:09.210 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.044359096999997, 2020-06-12T02:36:09.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:09.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.213 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:09.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:09.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:09.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:09.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:09.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:09.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:09.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:09.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:09.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:09.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:09.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:09.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:09.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:09.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:09.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:09.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:09.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:09.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:09.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:09.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:09.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:09.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:09.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:09.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:09.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:09.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:09.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.232 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:09.232 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:09.232 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.044047593999998, 2020-06-12T02:36:09.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:09.233 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.233 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.234 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.234 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.234 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:09.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.234 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:09.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:09.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:09.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:09.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:09.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:09.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:09.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:09.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:09.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:09.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:09.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:09.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:09.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:09.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:09.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:09.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:09.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:09.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:09.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:09.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:09.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:09.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:09.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:09.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:09.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:09.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:09.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:09.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:09.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:422 1.ds0 1:b8c47ae9:::smithi14213939-24:head [write 1681102~474010] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:36:09.255 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:09.257 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.941278452999999, 2020-06-12T02:36:09.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619, 2020-06-12T02:36:09.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.258 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.258 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.258 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.259 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 422 2020-06-12T02:36:09.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.259 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:09.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00060803099999999998 2020-06-12T02:36:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260649+0000", 2020-06-12T02:36:09.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5483999999999999e-05 2020-06-12T02:36:09.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260674+0000", 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4036000000000003e-05 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260718+0000", 2020-06-12T02:36:09.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8003999999999999e-05 2020-06-12T02:36:09.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260736+0000", 2020-06-12T02:36:09.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063788600000000005 2020-06-12T02:36:09.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261374+0000", 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153311 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261527+0000", 2020-06-12T02:36:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011428038 2020-06-12T02:36:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272955+0000", 2020-06-12T02:36:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118906 2020-06-12T02:36:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273074+0000", 2020-06-12T02:36:09.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037998620000000002 2020-06-12T02:36:09.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276874+0000", 2020-06-12T02:36:09.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065599220000000001 2020-06-12T02:36:09.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283434+0000", 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128603 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283563+0000", 2020-06-12T02:36:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120536 2020-06-12T02:36:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283683+0000", 2020-06-12T02:36:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619 2020-06-12T02:36:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:425 1.ds0 1:b8c47ae9:::smithi14213939-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.933630236999999, 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999, 2020-06-12T02:36:09.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.275 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.276 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.276 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.276 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.276 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 425 2020-06-12T02:36:09.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.277 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:09.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:09.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3261999999999999e-05 2020-06-12T02:36:09.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267712+0000", 2020-06-12T02:36:09.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.472e-06 2020-06-12T02:36:09.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267715+0000", 2020-06-12T02:36:09.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6889999999999998e-06 2020-06-12T02:36:09.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267722+0000", 2020-06-12T02:36:09.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.616e-06 2020-06-12T02:36:09.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267725+0000", 2020-06-12T02:36:09.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00083742500000000004 2020-06-12T02:36:09.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.268562+0000", 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024361180000000001 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.270998+0000", 2020-06-12T02:36:09.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039727 2020-06-12T02:36:09.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.274971+0000", 2020-06-12T02:36:09.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0976000000000004e-05 2020-06-12T02:36:09.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.275062+0000", 2020-06-12T02:36:09.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011605994 2020-06-12T02:36:09.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286668+0000", 2020-06-12T02:36:09.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000157675 2020-06-12T02:36:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286826+0000", 2020-06-12T02:36:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073582880000000002 2020-06-12T02:36:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294184+0000", 2020-06-12T02:36:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:444 1.5s0 1:a8df2b52:::smithi14213939-27:head [write 544560~783450] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:09.292 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:09.292 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.271481958999999, 2020-06-12T02:36:09.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001, 2020-06-12T02:36:09.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.292 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.293 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 444 2020-06-12T02:36:09.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041368699999999998 2020-06-12T02:36:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930251+0000", 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0767999999999999e-05 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930261+0000", 2020-06-12T02:36:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6778000000000001e-05 2020-06-12T02:36:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930278+0000", 2020-06-12T02:36:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0348e-05 2020-06-12T02:36:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930289+0000", 2020-06-12T02:36:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100268 2020-06-12T02:36:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930389+0000", 2020-06-12T02:36:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2133000000000001e-05 2020-06-12T02:36:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930401+0000", 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003798161 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934199+0000", 2020-06-12T02:36:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000124413 2020-06-12T02:36:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934324+0000", 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001950249 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.936274+0000", 2020-06-12T02:36:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086764879999999996 2020-06-12T02:36:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.944950+0000", 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071019539999999997 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952052+0000", 2020-06-12T02:36:09.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012448599999999999 2020-06-12T02:36:09.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952177+0000", 2020-06-12T02:36:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001 2020-06-12T02:36:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.251797027, 2020-06-12T02:36:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.251280348, 2020-06-12T02:36:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:09.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:09.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:09.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:09.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:09.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:09.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:09.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:09.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:09.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:09.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:09.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:09.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:09.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248773913999999, 2020-06-12T02:36:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.343 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:09.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.344 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:09.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:09.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:09.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:09.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:09.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:09.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:09.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:09.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:09.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:09.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:09.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:09.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:09.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:09.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248593917999999, 2020-06-12T02:36:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248458826, 2020-06-12T02:36:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:573 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248284562, 2020-06-12T02:36:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281, 2020-06-12T02:36:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 573 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0703000000000003e-05 2020-06-12T02:36:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953115+0000", 2020-06-12T02:36:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.96e-06 2020-06-12T02:36:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953123+0000", 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3210000000000001e-05 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953136+0000", 2020-06-12T02:36:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8659999999999997e-06 2020-06-12T02:36:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953141+0000", 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00054970300000000002 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953691+0000", 2020-06-12T02:36:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6529999999999994e-06 2020-06-12T02:36:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953698+0000", 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040487869999999999 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957747+0000", 2020-06-12T02:36:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7700000000000003e-07 2020-06-12T02:36:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957748+0000", 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015554228 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973302+0000", 2020-06-12T02:36:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020247700000000001 2020-06-12T02:36:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973505+0000", 2020-06-12T02:36:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047224210000000001 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978227+0000", 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015839599999999999 2020-06-12T02:36:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978386+0000", 2020-06-12T02:36:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281 2020-06-12T02:36:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:574 1.ds0 1:bb6dbdab:::smithi14213939-46:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248134264999999, 2020-06-12T02:36:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998, 2020-06-12T02:36:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 574 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5772999999999997e-05 2020-06-12T02:36:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953230+0000", 2020-06-12T02:36:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6329999999999996e-06 2020-06-12T02:36:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953238+0000", 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3053e-05 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953251+0000", 2020-06-12T02:36:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1039999999999998e-06 2020-06-12T02:36:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953256+0000", 2020-06-12T02:36:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046425299999999997 2020-06-12T02:36:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953721+0000", 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5349999999999999e-06 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953728+0000", 2020-06-12T02:36:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040455209999999998 2020-06-12T02:36:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957774+0000", 2020-06-12T02:36:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0550000000000001e-06 2020-06-12T02:36:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957775+0000", 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015755697999999999 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973530+0000", 2020-06-12T02:36:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2848e-05 2020-06-12T02:36:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973573+0000", 2020-06-12T02:36:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048625020000000003 2020-06-12T02:36:09.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978436+0000", 2020-06-12T02:36:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012710299999999999 2020-06-12T02:36:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978563+0000", 2020-06-12T02:36:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998 2020-06-12T02:36:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:575 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.248010090999999, 2020-06-12T02:36:09.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999, 2020-06-12T02:36:09.424 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:09.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.425 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.425 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 575 2020-06-12T02:36:09.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.425 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8362000000000006e-05 2020-06-12T02:36:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953387+0000", 2020-06-12T02:36:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5710000000000003e-06 2020-06-12T02:36:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953394+0000", 2020-06-12T02:36:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3081999999999999e-05 2020-06-12T02:36:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953407+0000", 2020-06-12T02:36:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953412+0000", 2020-06-12T02:36:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000338394 2020-06-12T02:36:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953751+0000", 2020-06-12T02:36:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1470000000000001e-06 2020-06-12T02:36:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953759+0000", 2020-06-12T02:36:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040449010000000001 2020-06-12T02:36:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957804+0000", 2020-06-12T02:36:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7770000000000001e-06 2020-06-12T02:36:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957806+0000", 2020-06-12T02:36:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015827687999999999 2020-06-12T02:36:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973633+0000", 2020-06-12T02:36:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3745999999999998e-05 2020-06-12T02:36:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973667+0000", 2020-06-12T02:36:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049250680000000003 2020-06-12T02:36:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978592+0000", 2020-06-12T02:36:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3843000000000005e-05 2020-06-12T02:36:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978656+0000", 2020-06-12T02:36:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999 2020-06-12T02:36:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:579 1.5s0 1:aa8c60b3:::smithi14213939-31:head [write 2158943~647020] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.2503061290000002, 2020-06-12T02:36:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001, 2020-06-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 579 2020-06-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032091999999999998 2020-06-12T02:36:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951334+0000", 2020-06-12T02:36:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0485e-05 2020-06-12T02:36:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951344+0000", 2020-06-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0214999999999999e-05 2020-06-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951364+0000", 2020-06-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7785e-05 2020-06-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951382+0000", 2020-06-12T02:36:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1069999999999996e-05 2020-06-12T02:36:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951443+0000", 2020-06-12T02:36:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015391999999999999 2020-06-12T02:36:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951597+0000", 2020-06-12T02:36:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014059853000000001 2020-06-12T02:36:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.965657+0000", 2020-06-12T02:36:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003128432 2020-06-12T02:36:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968786+0000", 2020-06-12T02:36:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042710819999999998 2020-06-12T02:36:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973057+0000", 2020-06-12T02:36:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024853800000000002 2020-06-12T02:36:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973305+0000", 2020-06-12T02:36:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001 2020-06-12T02:36:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:581 1.5s0 1:aa8c60b3:::smithi14213939-31:head [setxattr _header (57) in=7b,truncate 3563051] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.2454381829999992, 2020-06-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999, 2020-06-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 581 2020-06-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1825999999999998e-05 2020-06-12T02:36:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955973+0000", 2020-06-12T02:36:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1440000000000003e-06 2020-06-12T02:36:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955981+0000", 2020-06-12T02:36:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2928000000000001e-05 2020-06-12T02:36:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955994+0000", 2020-06-12T02:36:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6300000000000003e-06 2020-06-12T02:36:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955999+0000", 2020-06-12T02:36:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040354799999999999 2020-06-12T02:36:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956403+0000", 2020-06-12T02:36:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010726300000000001 2020-06-12T02:36:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956510+0000", 2020-06-12T02:36:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011669656 2020-06-12T02:36:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968180+0000", 2020-06-12T02:36:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024867209999999999 2020-06-12T02:36:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.970666+0000", 2020-06-12T02:36:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072037769999999998 2020-06-12T02:36:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977870+0000", 2020-06-12T02:36:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106267 2020-06-12T02:36:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977977+0000", 2020-06-12T02:36:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999 2020-06-12T02:36:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:582 1.5s0 1:aa8c60b3:::smithi14213939-31:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.2452610820000007, 2020-06-12T02:36:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962, 2020-06-12T02:36:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 582 2020-06-12T02:36:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7505e-05 2020-06-12T02:36:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956105+0000", 2020-06-12T02:36:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.311e-06 2020-06-12T02:36:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956113+0000", 2020-06-12T02:36:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3230999999999999e-05 2020-06-12T02:36:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956126+0000", 2020-06-12T02:36:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:36:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956131+0000", 2020-06-12T02:36:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00057600900000000005 2020-06-12T02:36:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956707+0000", 2020-06-12T02:36:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000126515 2020-06-12T02:36:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956833+0000", 2020-06-12T02:36:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021768708000000001 2020-06-12T02:36:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978602+0000", 2020-06-12T02:36:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012831499999999999 2020-06-12T02:36:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978730+0000", 2020-06-12T02:36:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017164490000000001 2020-06-12T02:36:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.980447+0000", 2020-06-12T02:36:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962 2020-06-12T02:36:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1988685550000007, 2020-06-12T02:36:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1908217650000008, 2020-06-12T02:36:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1904764009999997, 2020-06-12T02:36:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1903448480000005, 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:09.569 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:09.570 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:09.571 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:09.566+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:09.671 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:09.666+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:09.715 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:36:09.715 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 0 1 2020-06-12T02:36:09.732 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:09.732 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:09.732 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:09.733 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:09.742 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:09.771 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:09.765+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:09.829 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:09.814+0000 7f89c0f80700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:09.834 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:09.830+0000 7f89c0f80700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:09.873 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:09.869+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:09.900 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:09.901 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:09.909 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:09.938 INFO:tasks.rados.rados.0.smithi142.stdout:240: done (4 left) 2020-06-12T02:36:09.938 INFO:tasks.rados.rados.0.smithi142.stdout:241: done (3 left) 2020-06-12T02:36:09.939 INFO:tasks.rados.rados.0.smithi142.stdout:242: done (2 left) 2020-06-12T02:36:09.939 INFO:tasks.rados.rados.0.smithi142.stdout:244: done (1 left) 2020-06-12T02:36:09.940 INFO:tasks.rados.rados.0.smithi142.stdout:245: done (0 left) 2020-06-12T02:36:09.940 INFO:tasks.rados.rados.0.smithi142.stdout:246: snap_remove snap 22 2020-06-12T02:36:09.990 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:09.986+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:10.047 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:192 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 41.270445334000001, 2020-06-12T02:36:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999, 2020-06-12T02:36:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 192 2020-06-12T02:36:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:36:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767818+0000", 2020-06-12T02:36:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6110000000000004e-06 2020-06-12T02:36:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767822+0000", 2020-06-12T02:36:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8060000000000006e-06 2020-06-12T02:36:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767832+0000", 2020-06-12T02:36:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3510000000000004e-06 2020-06-12T02:36:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767836+0000", 2020-06-12T02:36:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050647340000000004 2020-06-12T02:36:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772901+0000", 2020-06-12T02:36:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109873 2020-06-12T02:36:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773011+0000", 2020-06-12T02:36:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035580400000000002 2020-06-12T02:36:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776569+0000", 2020-06-12T02:36:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6688999999999996e-05 2020-06-12T02:36:10.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776656+0000", 2020-06-12T02:36:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001371709 2020-06-12T02:36:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778027+0000", 2020-06-12T02:36:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999 2020-06-12T02:36:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.916108448000003, 2020-06-12T02:36:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:10.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.915885006000003, 2020-06-12T02:36:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:225 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.91550238, 2020-06-12T02:36:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001, 2020-06-12T02:36:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 225 2020-06-12T02:36:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9922000000000001e-05 2020-06-12T02:36:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122781+0000", 2020-06-12T02:36:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0399999999999998e-06 2020-06-12T02:36:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122787+0000", 2020-06-12T02:36:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1926999999999999e-05 2020-06-12T02:36:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122799+0000", 2020-06-12T02:36:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7280000000000001e-06 2020-06-12T02:36:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122802+0000", 2020-06-12T02:36:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004465063 2020-06-12T02:36:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127267+0000", 2020-06-12T02:36:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014145999999999999 2020-06-12T02:36:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127409+0000", 2020-06-12T02:36:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069305699999999996 2020-06-12T02:36:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128102+0000", 2020-06-12T02:36:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026151099999999999 2020-06-12T02:36:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130717+0000", 2020-06-12T02:36:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057126850000000003 2020-06-12T02:36:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136430+0000", 2020-06-12T02:36:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8999999999999995e-05 2020-06-12T02:36:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136519+0000", 2020-06-12T02:36:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001 2020-06-12T02:36:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.873405896999998, 2020-06-12T02:36:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.873071003, 2020-06-12T02:36:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:310 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.772693599, 2020-06-12T02:36:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098877180000000002, 2020-06-12T02:36:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 310 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4818e-05 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265624+0000", 2020-06-12T02:36:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2554999999999999e-05 2020-06-12T02:36:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265637+0000", 2020-06-12T02:36:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7989e-05 2020-06-12T02:36:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265655+0000", 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1130000000000007e-06 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265664+0000", 2020-06-12T02:36:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9839999999999994e-05 2020-06-12T02:36:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265754+0000", 2020-06-12T02:36:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023071300000000001 2020-06-12T02:36:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265985+0000", 2020-06-12T02:36:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094426900000000001 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.275427+0000", 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098877180000000002 2020-06-12T02:36:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:311 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.772474936999998, 2020-06-12T02:36:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347, 2020-06-12T02:36:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 311 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2830999999999993e-05 2020-06-12T02:36:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265841+0000", 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5279999999999998e-06 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265849+0000", 2020-06-12T02:36:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9006999999999999e-05 2020-06-12T02:36:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265868+0000", 2020-06-12T02:36:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.772e-06 2020-06-12T02:36:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265873+0000", 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072750600000000005 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266601+0000", 2020-06-12T02:36:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011586699999999999 2020-06-12T02:36:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266717+0000", 2020-06-12T02:36:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016014836000000001 2020-06-12T02:36:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.282732+0000", 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:312 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.772301104999997, 2020-06-12T02:36:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001, 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 312 2020-06-12T02:36:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0629000000000003e-05 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266013+0000", 2020-06-12T02:36:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9190000000000002e-06 2020-06-12T02:36:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266020+0000", 2020-06-12T02:36:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2887e-05 2020-06-12T02:36:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266032+0000", 2020-06-12T02:36:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5258e-05 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266048+0000", 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091540999999999997 2020-06-12T02:36:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266963+0000", 2020-06-12T02:36:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101524 2020-06-12T02:36:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.267065+0000", 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019677448 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286742+0000", 2020-06-12T02:36:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001 2020-06-12T02:36:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(osd.1.13:2 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [assert-version v6,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.769641970999999, 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094306830000000005, 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:36:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268591+0000", 2020-06-12T02:36:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019565399999999999 2020-06-12T02:36:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268787+0000", 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1355e-05 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268828+0000", 2020-06-12T02:36:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5587999999999999e-05 2020-06-12T02:36:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268864+0000", 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5806000000000001e-05 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268880+0000", 2020-06-12T02:36:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010734900000000001 2020-06-12T02:36:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.268987+0000", 2020-06-12T02:36:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000216317 2020-06-12T02:36:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.269203+0000", 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088186140000000007 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.278022+0000", 2020-06-12T02:36:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094306830000000005 2020-06-12T02:36:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 34/18 ECSubWrite(tid=108, reqid=osd.2.0:106, at_version=0'0, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:36:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.078609702000001, 2020-06-12T02:36:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013603179, 2020-06-12T02:36:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0952999999999997e-05 2020-06-12T02:36:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959684+0000", 2020-06-12T02:36:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7781000000000001e-05 2020-06-12T02:36:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959702+0000", 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7286999999999999e-05 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959719+0000", 2020-06-12T02:36:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7219999999999999e-06 2020-06-12T02:36:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959727+0000", 2020-06-12T02:36:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2355000000000003e-05 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959780+0000", 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2128e-05 2020-06-12T02:36:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959792+0000", 2020-06-12T02:36:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013367046 2020-06-12T02:36:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.973159+0000", 2020-06-12T02:36:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7906999999999999e-05 2020-06-12T02:36:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.973227+0000", 2020-06-12T02:36:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013603179 2020-06-12T02:36:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 34/18 ECSubWrite(tid=109, reqid=osd.2.0:109, at_version=34'35, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.075203502000001, 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011680961, 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2312999999999998e-05 2020-06-12T02:36:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963092+0000", 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2055999999999999e-05 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963124+0000", 2020-06-12T02:36:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7685000000000001e-05 2020-06-12T02:36:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963142+0000", 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6190000000000002e-06 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963149+0000", 2020-06-12T02:36:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00065343699999999998 2020-06-12T02:36:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963803+0000", 2020-06-12T02:36:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5209e-05 2020-06-12T02:36:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963818+0000", 2020-06-12T02:36:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010837009 2020-06-12T02:36:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.974655+0000", 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5633000000000001e-05 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.974711+0000", 2020-06-12T02:36:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011680961 2020-06-12T02:36:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:427 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.765314902, 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016209472999999999, 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 427 2020-06-12T02:36:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010785600000000001 2020-06-12T02:36:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273026+0000", 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2359e-05 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273038+0000", 2020-06-12T02:36:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0114000000000001e-05 2020-06-12T02:36:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273059+0000", 2020-06-12T02:36:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0756e-05 2020-06-12T02:36:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273069+0000", 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047501200000000003 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273544+0000", 2020-06-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2884000000000001e-05 2020-06-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273557+0000", 2020-06-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031519489999999998 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276709+0000", 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115417 2020-06-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276825+0000", 2020-06-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012303125999999999 2020-06-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.289128+0000", 2020-06-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016209472999999999 2020-06-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:428 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.765091465000001, 2020-06-12T02:36:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020091841999999999, 2020-06-12T02:36:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 428 2020-06-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3462999999999996e-05 2020-06-12T02:36:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273235+0000", 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2430000000000005e-06 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273243+0000", 2020-06-12T02:36:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4543e-05 2020-06-12T02:36:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273258+0000", 2020-06-12T02:36:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9540000000000001e-06 2020-06-12T02:36:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273264+0000", 2020-06-12T02:36:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037543199999999998 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273639+0000", 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0042e-05 2020-06-12T02:36:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273649+0000", 2020-06-12T02:36:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037505450000000001 2020-06-12T02:36:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277400+0000", 2020-06-12T02:36:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9163000000000001e-05 2020-06-12T02:36:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277479+0000", 2020-06-12T02:36:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015754456999999999 2020-06-12T02:36:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.293234+0000", 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020091841999999999 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:429 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.76490926, 2020-06-12T02:36:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862, 2020-06-12T02:36:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 429 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7293000000000005e-05 2020-06-12T02:36:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273421+0000", 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2640000000000008e-06 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273429+0000", 2020-06-12T02:36:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5403000000000001e-05 2020-06-12T02:36:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273445+0000", 2020-06-12T02:36:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.759e-06 2020-06-12T02:36:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273452+0000", 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022692599999999999 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273679+0000", 2020-06-12T02:36:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8340000000000005e-06 2020-06-12T02:36:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273687+0000", 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040310149999999998 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277718+0000", 2020-06-12T02:36:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106714 2020-06-12T02:36:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277825+0000", 2020-06-12T02:36:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016577654000000001 2020-06-12T02:36:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294403+0000", 2020-06-12T02:36:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862 2020-06-12T02:36:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:459 1.1s0 1:82c302db:::smithi14213939-48:a [sparse-read 0~2689087] snapc 0=[] ondisk+read+known_if_redirected e38)", 2020-06-12T02:36:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.834541924, 2020-06-12T02:36:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013834964999999999, 2020-06-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 459 2020-06-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3652000000000001e-05 2020-06-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8890000000000002e-06 2020-06-12T02:36:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203753+0000", 2020-06-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4484000000000001e-05 2020-06-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203767+0000", 2020-06-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6529999999999994e-06 2020-06-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203775+0000", 2020-06-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010078859999999999 2020-06-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204783+0000", 2020-06-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011844 2020-06-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204901+0000", 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012624961000000001 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.217526+0000", 2020-06-12T02:36:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013834964999999999 2020-06-12T02:36:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:591 1.1s0 1:82c302db:::smithi14213939-48:head [write 1759554~650689] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.979263+0000", 2020-06-12T02:36:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.058969673, 2020-06-12T02:36:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0089788430000000002, 2020-06-12T02:36:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 591 2020-06-12T02:36:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979263+0000", 2020-06-12T02:36:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979263+0000", 2020-06-12T02:36:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031140900000000001 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979575+0000", 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:36:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979585+0000", 2020-06-12T02:36:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5551000000000001e-05 2020-06-12T02:36:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979600+0000", 2020-06-12T02:36:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.041e-06 2020-06-12T02:36:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979607+0000", 2020-06-12T02:36:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9607000000000001e-05 2020-06-12T02:36:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979657+0000", 2020-06-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012671899999999999 2020-06-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.979784+0000", 2020-06-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046283269999999998 2020-06-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.984412+0000", 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024557649999999999 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.986868+0000", 2020-06-12T02:36:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00127848 2020-06-12T02:36:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988146+0000", 2020-06-12T02:36:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6058999999999996e-05 2020-06-12T02:36:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988242+0000", 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0089788430000000002 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:594 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.987947+0000", 2020-06-12T02:36:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.050286504000001, 2020-06-12T02:36:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097417389999999993, 2020-06-12T02:36:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 594 2020-06-12T02:36:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.987947+0000", 2020-06-12T02:36:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.987947+0000", 2020-06-12T02:36:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1730999999999994e-05 2020-06-12T02:36:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988028+0000", 2020-06-12T02:36:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7880000000000001e-06 2020-06-12T02:36:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988035+0000", 2020-06-12T02:36:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3246e-05 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988048+0000", 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.083e-06 2020-06-12T02:36:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.988054+0000", 2020-06-12T02:36:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005708528 2020-06-12T02:36:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.993763+0000", 2020-06-12T02:36:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012814599999999999 2020-06-12T02:36:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.993891+0000", 2020-06-12T02:36:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026187039999999999 2020-06-12T02:36:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.996510+0000", 2020-06-12T02:36:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109672 2020-06-12T02:36:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.996620+0000", 2020-06-12T02:36:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010688410000000001 2020-06-12T02:36:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.997688+0000", 2020-06-12T02:36:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097417389999999993 2020-06-12T02:36:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:601 1.6s0 1:6f0b6341:::smithi14213939-20:head [read 0~2470596,checksum] snapc 0=[] ondisk+read+known_if_redirected e53)", 2020-06-12T02:36:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.027164365999999, 2020-06-12T02:36:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010173364000000001, 2020-06-12T02:36:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 601 2020-06-12T02:36:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4679999999999996e-05 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011143+0000", 2020-06-12T02:36:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8110000000000003e-06 2020-06-12T02:36:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011151+0000", 2020-06-12T02:36:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3455000000000001e-05 2020-06-12T02:36:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011165+0000", 2020-06-12T02:36:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5910000000000003e-06 2020-06-12T02:36:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011170+0000", 2020-06-12T02:36:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039521790000000001 2020-06-12T02:36:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015122+0000", 2020-06-12T02:36:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011416 2020-06-12T02:36:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015237+0000", 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060054879999999998 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.021242+0000", 2020-06-12T02:36:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010173364000000001 2020-06-12T02:36:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:602 1.6s0 1:6f0b6341:::smithi14213939-20:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e53)", 2020-06-12T02:36:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.027020186, 2020-06-12T02:36:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013692607000000001, 2020-06-12T02:36:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 602 2020-06-12T02:36:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5103999999999999e-05 2020-06-12T02:36:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011238+0000", 2020-06-12T02:36:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1250000000000003e-06 2020-06-12T02:36:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011242+0000", 2020-06-12T02:36:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4440000000000002e-06 2020-06-12T02:36:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011250+0000", 2020-06-12T02:36:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1089999999999998e-06 2020-06-12T02:36:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011253+0000", 2020-06-12T02:36:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046336219999999996 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015886+0000", 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8393000000000001e-05 2020-06-12T02:36:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015945+0000", 2020-06-12T02:36:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0089608099999999996 2020-06-12T02:36:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.024906+0000", 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013692607000000001 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:10.364 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:10.366 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:10.357+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:10.366 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:10.467 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:10.461+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:10.480 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:10.481 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:10.490 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:10.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:10.569+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:10.646 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:10.647 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:10.654 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:10.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:10.693+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:10.751 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:10.797 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:10.794+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:10.811 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:10.812 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:10.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:10.812 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:10.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.813 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:10.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:10.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.672063092999998, 2020-06-12T02:36:10.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:10.813 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.814 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:10.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:10.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:10.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:10.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:10.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:10.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:10.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:10.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:10.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:10.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:10.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:10.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:10.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:10.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:10.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:10.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:10.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:10.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:10.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:10.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:10.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:10.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:10.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:10.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:10.851 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.851 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.851 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.852 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:10.852 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:10.852 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.661171711999998, 2020-06-12T02:36:10.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:10.853 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.853 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.853 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.853 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.854 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.854 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:10.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.854 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:10.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:10.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:10.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:10.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:10.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:10.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.868 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.869 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:10.869 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:10.869 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.660039668000003, 2020-06-12T02:36:10.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:10.870 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.870 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.870 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.870 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.871 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:10.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.871 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:10.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:10.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:10.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:10.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:10.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:10.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:10.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:10.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:10.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:10.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:10.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:10.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:10.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:10.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:10.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:10.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:10.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:10.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:10.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:10.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:10.885 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.885 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.885 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.886 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:10.886 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:10.886 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.659784483000003, 2020-06-12T02:36:10.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.887 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:10.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.888 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:10.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:10.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:10.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:10.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:10.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:10.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:10.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:10.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:10.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:10.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:10.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:10.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:10.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:10.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:10.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:10.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:10.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.901 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.659625296000002, 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:10.902 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.903 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:10.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.903 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:10.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.904 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:10.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:10.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:10.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:10.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:10.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:10.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:10.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:10.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:10.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:10.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:10.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:10.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:10.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:10.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:10.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:10.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:10.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:10.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:10.917 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.917 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.917 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.918 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:10.918 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:10.918 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.515302718000001, 2020-06-12T02:36:10.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:10.919 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.919 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:10.920 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.920 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:10.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:10.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:10.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:10.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:10.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:10.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:10.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.931 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.932 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:603 1.bs0 1:d6659338:::smithi14213939-43:head [write 430279~695389,stat] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:10.933 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:10.934 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.784402262, 2020-06-12T02:36:10.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882, 2020-06-12T02:36:10.934 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.935 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.935 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.935 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.935 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.935 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 603 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:10.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:10.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014668649999999999 2020-06-12T02:36:10.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021925+0000", 2020-06-12T02:36:10.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9837e-05 2020-06-12T02:36:10.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021944+0000", 2020-06-12T02:36:10.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4341e-05 2020-06-12T02:36:10.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021969+0000", 2020-06-12T02:36:10.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4333e-05 2020-06-12T02:36:10.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021983+0000", 2020-06-12T02:36:10.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3517999999999995e-05 2020-06-12T02:36:10.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022077+0000", 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000168954 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022246+0000", 2020-06-12T02:36:10.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035737379999999999 2020-06-12T02:36:10.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.025819+0000", 2020-06-12T02:36:10.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060458619999999999 2020-06-12T02:36:10.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031865+0000", 2020-06-12T02:36:10.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158689 2020-06-12T02:36:10.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.032024+0000", 2020-06-12T02:36:10.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098174500000000001 2020-06-12T02:36:10.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033006+0000", 2020-06-12T02:36:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882 2020-06-12T02:36:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.774233220999999, 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.952 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.952 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:10.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.953 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:10.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:10.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:10.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:10.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:10.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:10.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:10.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:10.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:10.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:10.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:10.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:10.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:10.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:10.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:10.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:10.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:10.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:10.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:10.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.969 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:10.969 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:10.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 6.8365308200000001, 2020-06-12T02:36:10.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:10.969 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.970 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:10.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.970 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:10.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.971 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:10.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:10.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:10.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:10.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:10.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:10.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:10.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:10.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:10.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:10.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:10.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:10.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:10.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:10.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:10.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:10.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:10.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:10.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:10.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:10.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:10.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:10.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:10.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:10.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:10.987 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.987 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:10.988 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:10.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.988 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:10.988 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.85465474, 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:10.989 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:10.990 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:10.990 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:10.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.990 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:10.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:10.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:10.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:10.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:10.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:10.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:10.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:10.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:10.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:10.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:10.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:10.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:10.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:10.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:10.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:10.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:10.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:10.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:10.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:10.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:10.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:10.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:10.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:10.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:11.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:11.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:11.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:11.002 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.002 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.002 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.003 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:11.003 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:11.003 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8544614240000001, 2020-06-12T02:36:11.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:11.004 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.004 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:11.005 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:11.005 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:11.005 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:11.006 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:11.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.006 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:11.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:11.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:11.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:11.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:11.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:11.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:11.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:11.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:11.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:11.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:11.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:11.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:11.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:11.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:11.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:11.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:11.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.019 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.020 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.020 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:11.020 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:11.021 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8543129690000004, 2020-06-12T02:36:11.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:11.021 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.021 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:11.021 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:11.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:11.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:11.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:11.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:11.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:11.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:11.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:11.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:11.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:11.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:11.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:11.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:11.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:11.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:11.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:11.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:11.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.037 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:11.038 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8468800190000003, 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:11.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:11.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:11.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:11.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:11.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:11.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:11.047 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.047 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.047 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.048 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.4s2 59/18 ECSubWrite(tid=104, reqid=osd.7.0:104, at_version=59'72, trim_to=0'0, roll_forward_to=57'68))", 2020-06-12T02:36:11.048 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.958516+0000", 2020-06-12T02:36:11.048 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8463435270000002, 2020-06-12T02:36:11.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012244870999999999, 2020-06-12T02:36:11.049 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.049 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.049 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958516+0000", 2020-06-12T02:36:11.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958516+0000", 2020-06-12T02:36:11.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0123999999999994e-05 2020-06-12T02:36:11.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958597+0000", 2020-06-12T02:36:11.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4596e-05 2020-06-12T02:36:11.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958621+0000", 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6397999999999994e-05 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958718+0000", 2020-06-12T02:36:11.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1440000000000003e-06 2020-06-12T02:36:11.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958726+0000", 2020-06-12T02:36:11.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7331999999999999e-05 2020-06-12T02:36:11.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958783+0000", 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2119e-05 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958795+0000", 2020-06-12T02:36:11.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909957000000001 2020-06-12T02:36:11.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970705+0000", 2020-06-12T02:36:11.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6200999999999999e-05 2020-06-12T02:36:11.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970761+0000", 2020-06-12T02:36:11.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012244870999999999 2020-06-12T02:36:11.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.061 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.062 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.063 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=224, reqid=osd.0.0:224, at_version=59'129, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:11.063 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:11.064 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8454768389999998, 2020-06-12T02:36:11.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012302795, 2020-06-12T02:36:11.064 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.064 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.064 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:11.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:11.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1150999999999998e-05 2020-06-12T02:36:11.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959444+0000", 2020-06-12T02:36:11.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0902000000000002e-05 2020-06-12T02:36:11.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959485+0000", 2020-06-12T02:36:11.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7144999999999999e-05 2020-06-12T02:36:11.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959502+0000", 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9340000000000006e-06 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959510+0000", 2020-06-12T02:36:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014002599999999999 2020-06-12T02:36:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959650+0000", 2020-06-12T02:36:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2369e-05 2020-06-12T02:36:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959663+0000", 2020-06-12T02:36:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011972244 2020-06-12T02:36:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971635+0000", 2020-06-12T02:36:11.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1023999999999998e-05 2020-06-12T02:36:11.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971686+0000", 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012302795 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.076 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:11.076 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:11.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8444715189999998, 2020-06-12T02:36:11.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:11.077 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.077 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.077 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:11.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:11.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:11.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:11.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:11.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:11.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:11.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:11.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:11.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:11.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:11.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:11.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:11.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.087 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8424443740000003, 2020-06-12T02:36:11.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:11.089 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.089 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:11.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:11.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:11.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:11.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:11.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:11.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:11.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:11.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:11.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:11.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:11.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:11.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:11.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:11.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.104 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=227, reqid=client.4555.0:669, at_version=59'133, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:11.105 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.964297+0000", 2020-06-12T02:36:11.105 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8405629870000002, 2020-06-12T02:36:11.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012284850999999999, 2020-06-12T02:36:11.105 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.105 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.106 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964297+0000", 2020-06-12T02:36:11.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964297+0000", 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00048543099999999998 2020-06-12T02:36:11.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964782+0000", 2020-06-12T02:36:11.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7750999999999999e-05 2020-06-12T02:36:11.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964810+0000", 2020-06-12T02:36:11.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012559800000000001 2020-06-12T02:36:11.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964936+0000", 2020-06-12T02:36:11.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6181999999999999e-05 2020-06-12T02:36:11.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964952+0000", 2020-06-12T02:36:11.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064017359999999999 2020-06-12T02:36:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971354+0000", 2020-06-12T02:36:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.201e-05 2020-06-12T02:36:11.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971366+0000", 2020-06-12T02:36:11.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0051842299999999997 2020-06-12T02:36:11.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976550+0000", 2020-06-12T02:36:11.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.1912999999999998e-05 2020-06-12T02:36:11.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976582+0000", 2020-06-12T02:36:11.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012284850999999999 2020-06-12T02:36:11.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.119 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=168, attrs_read=0))", 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8405258990000002, 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001, 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.120 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.121 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:11.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:11.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001626127 2020-06-12T02:36:11.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965960+0000", 2020-06-12T02:36:11.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3662999999999999e-05 2020-06-12T02:36:11.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965974+0000", 2020-06-12T02:36:11.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4405e-05 2020-06-12T02:36:11.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965988+0000", 2020-06-12T02:36:11.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5080000000000002e-06 2020-06-12T02:36:11.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965995+0000", 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0077934429999999997 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973788+0000", 2020-06-12T02:36:11.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002853216 2020-06-12T02:36:11.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976641+0000", 2020-06-12T02:36:11.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001 2020-06-12T02:36:11.129 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.129 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.130 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:11.130 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:11.131 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.8313945409999999, 2020-06-12T02:36:11.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:11.131 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:11.131 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:11.132 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:11.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:11.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:11.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:11.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:11.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:11.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:11.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:11.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:11.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:11.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:11.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:11.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:11.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:11.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:11.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:11.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:11.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:11.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:11.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:11.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:11.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:11.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:11.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:11.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:11.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.143 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:11.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:11.144 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:11.144 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:36:11.149 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:10.858+0000 7fa8f3472700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.149 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:10.866+0000 7fa8f3472700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:11.152 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:11.152 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:11.152 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:11.152 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:11.152 INFO:tasks.rados.rados.0.smithi142.stdout:246: done (0 left) 2020-06-12T02:36:11.153 INFO:tasks.rados.rados.0.smithi142.stdout:247: delete oid 2 current snap is 25 2020-06-12T02:36:11.153 INFO:tasks.rados.rados.0.smithi142.stdout:247: done (0 left) 2020-06-12T02:36:11.153 INFO:tasks.rados.rados.0.smithi142.stdout:248: write oid 30 current snap is 25 2020-06-12T02:36:11.153 INFO:tasks.rados.rados.0.smithi142.stdout:248: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2020-06-12T02:36:11.153 INFO:tasks.rados.rados.0.smithi142.stdout:248: writing smithi14213939-30 from 715998 to 1323326 tid 1 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:248: writing smithi14213939-30 from 1838006 to 2265374 tid 2 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:248: writing smithi14213939-30 from 2864574 to 3342054 tid 3 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:248: writing smithi14213939-30 from 3863835 to 3915998 tid 4 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:249: delete oid 1 current snap is 25 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 1 to smithi14213939-30 2020-06-12T02:36:11.154 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 2 to smithi14213939-30 2020-06-12T02:36:11.155 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 3 to smithi14213939-30 2020-06-12T02:36:11.155 INFO:tasks.rados.rados.0.smithi142.stdout:249: done (1 left) 2020-06-12T02:36:11.155 INFO:tasks.rados.rados.0.smithi142.stdout:250: write (excl) oid 48 current snap is 25 2020-06-12T02:36:11.155 INFO:tasks.rados.rados.0.smithi142.stdout:250: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2020-06-12T02:36:11.155 INFO:tasks.rados.rados.0.smithi142.stdout:250: writing smithi14213939-48 from 749612 to 1223791 tid 1 2020-06-12T02:36:11.156 INFO:tasks.rados.rados.0.smithi142.stdout:250: writing smithi14213939-48 from 1954970 to 2386007 tid 2 2020-06-12T02:36:11.156 INFO:tasks.rados.rados.0.smithi142.stdout:250: writing smithi14213939-48 from 2919420 to 3535797 tid 3 2020-06-12T02:36:11.156 INFO:tasks.rados.rados.0.smithi142.stdout:251: snap_remove snap 15 2020-06-12T02:36:11.156 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.0 to 1 (10000) 2020-06-12T02:36:11.157 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:11.141+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:11.158 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 2 1 2020-06-12T02:36:11.159 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:11.246 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:11.242+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:11.298 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:11.290+0000 7f117ed09700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.302 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:11.298+0000 7f117daa7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:11.294+0000 7f264b5e1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:11.306+0000 7f264a37f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:11.310 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:11.310 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:11.320 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:11.363 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:11.357+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:11.428 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:11.428 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:11.445 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:11.487 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:11.481+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:11.550 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:11.541+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:11.599 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:11.599 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:11.608 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:11.651 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:11.646+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:11.752 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:11.745+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:11.758 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:11.758 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:11.767 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:11.853 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:11.850+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:11.918 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:11.918 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:11.928 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:11.955 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:11.950+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:11.964 INFO:tasks.rados.rados.0.smithi142.stdout:251: done (2 left) 2020-06-12T02:36:11.965 INFO:tasks.rados.rados.0.smithi142.stdout:252: rollback oid 47 current snap is 25 2020-06-12T02:36:11.965 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 47 to 20 2020-06-12T02:36:11.965 INFO:tasks.rados.rados.0.smithi142.stdout:253: write oid 39 current snap is 25 2020-06-12T02:36:11.965 INFO:tasks.rados.rados.0.smithi142.stdout:253: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2020-06-12T02:36:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.2 to 1 (10000) 2020-06-12T02:36:11.973 INFO:tasks.rados.rados.0.smithi142.stdout:253: writing smithi14213939-39 from 766419 to 1315847 tid 1 2020-06-12T02:36:11.976 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:36:11.984 INFO:tasks.rados.rados.0.smithi142.stdout:253: writing smithi14213939-39 from 2013452 to 2588147 tid 2 2020-06-12T02:36:11.987 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 3 1 2020-06-12T02:36:11.992 INFO:tasks.rados.rados.0.smithi142.stdout:253: writing smithi14213939-39 from 3346843 to 3774492 tid 3 2020-06-12T02:36:11.993 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 4 to smithi14213939-30 2020-06-12T02:36:11.993 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 6 to smithi14213939-30 2020-06-12T02:36:11.993 INFO:tasks.rados.rados.0.smithi142.stdout:248: finishing write tid 7 to smithi14213939-30 2020-06-12T02:36:11.993 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 102 (ObjNum 114 snap 25 seq_num 114) dirty exists 2020-06-12T02:36:11.993 INFO:tasks.rados.rados.0.smithi142.stdout:248: left oid 30 (ObjNum 114 snap 25 seq_num 114) 2020-06-12T02:36:11.994 INFO:tasks.rados.rados.0.smithi142.stdout:250: finishing write tid 1 to smithi14213939-48 2020-06-12T02:36:11.994 INFO:tasks.rados.rados.0.smithi142.stdout:250: finishing write tid 2 to smithi14213939-48 2020-06-12T02:36:11.994 INFO:tasks.rados.rados.0.smithi142.stdout:250: finishing write tid 3 to smithi14213939-48 2020-06-12T02:36:11.994 INFO:tasks.rados.rados.0.smithi142.stdout:250: finishing write tid 5 to smithi14213939-48 2020-06-12T02:36:11.994 INFO:tasks.rados.rados.0.smithi142.stdout:250: finishing write tid 6 to smithi14213939-48 2020-06-12T02:36:11.995 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 27 (ObjNum 116 snap 25 seq_num 116) dirty exists 2020-06-12T02:36:11.995 INFO:tasks.rados.rados.0.smithi142.stdout:250: left oid 48 (ObjNum 116 snap 25 seq_num 116) 2020-06-12T02:36:11.995 INFO:tasks.rados.rados.0.smithi142.stdout:252: finishing rollback tid 0 to smithi14213939-47 2020-06-12T02:36:11.995 INFO:tasks.rados.rados.0.smithi142.stdout:252: finishing rollback tid 1 to smithi14213939-47 2020-06-12T02:36:11.996 INFO:tasks.rados.rados.0.smithi142.stdout:252: finishing rollback tid 2 to smithi14213939-47 2020-06-12T02:36:12.003 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 145 (ObjNum 78 snap 10 seq_num 78) dirty exists 2020-06-12T02:36:12.003 INFO:tasks.rados.rados.0.smithi142.stdout:248: done (3 left) 2020-06-12T02:36:12.003 INFO:tasks.rados.rados.0.smithi142.stdout:250: done (2 left) 2020-06-12T02:36:12.004 INFO:tasks.rados.rados.0.smithi142.stdout:252: done (1 left) 2020-06-12T02:36:12.004 INFO:tasks.rados.rados.0.smithi142.stdout:254: read oid 25 snap -1 2020-06-12T02:36:12.004 INFO:tasks.rados.rados.0.smithi142.stdout:254: expect (ObjNum 109 snap 23 seq_num 109) 2020-06-12T02:36:12.004 INFO:tasks.rados.rados.0.smithi142.stdout:255: delete oid 14 current snap is 25 2020-06-12T02:36:12.006 INFO:tasks.rados.rados.0.smithi142.stdout:253: finishing write tid 1 to smithi14213939-39 2020-06-12T02:36:12.007 INFO:tasks.rados.rados.0.smithi142.stdout:255: done (2 left) 2020-06-12T02:36:12.007 INFO:tasks.rados.rados.0.smithi142.stdout:256: rollback oid 46 current snap is 25 2020-06-12T02:36:12.008 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 46 to 24 2020-06-12T02:36:12.008 INFO:tasks.rados.rados.0.smithi142.stdout:257: rollback oid 30 current snap is 25 2020-06-12T02:36:12.008 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 30 to 19 2020-06-12T02:36:12.009 INFO:tasks.rados.rados.0.smithi142.stdout:258: delete oid 9 current snap is 25 2020-06-12T02:36:12.009 INFO:tasks.rados.rados.0.smithi142.stdout:258: done (4 left) 2020-06-12T02:36:12.009 INFO:tasks.rados.rados.0.smithi142.stdout:259: copy_from oid 31 from oid 1 current snap is 25 2020-06-12T02:36:12.010 INFO:tasks.rados.rados.0.smithi142.stdout:260: delete oid 12 current snap is 25 2020-06-12T02:36:12.010 INFO:tasks.rados.rados.0.smithi142.stdout:257: finishing rollback tid 0 to smithi14213939-30 2020-06-12T02:36:12.011 INFO:tasks.rados.rados.0.smithi142.stdout:257: finishing rollback tid 1 to smithi14213939-30 2020-06-12T02:36:12.011 INFO:tasks.rados.rados.0.smithi142.stdout:257: finishing rollback tid 2 to smithi14213939-30 2020-06-12T02:36:12.012 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 113 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-06-12T02:36:12.013 INFO:tasks.rados.rados.0.smithi142.stdout:253: finishing write tid 2 to smithi14213939-39 2020-06-12T02:36:12.013 INFO:tasks.rados.rados.0.smithi142.stdout:256: finishing rollback tid 0 to smithi14213939-46 2020-06-12T02:36:12.013 INFO:tasks.rados.rados.0.smithi142.stdout:253: finishing write tid 3 to smithi14213939-39 2020-06-12T02:36:12.015 INFO:tasks.rados.rados.0.smithi142.stdout:253: finishing write tid 5 to smithi14213939-39 2020-06-12T02:36:12.016 INFO:tasks.rados.rados.0.smithi142.stdout:259: finishing copy_from to smithi14213939-31 2020-06-12T02:36:12.017 INFO:tasks.rados.rados.0.smithi142.stdout:259: got expected ENOENT (src dne) 2020-06-12T02:36:12.017 INFO:tasks.rados.rados.0.smithi142.stdout:259: finishing copy_from racing read to smithi14213939-31 2020-06-12T02:36:12.021 INFO:tasks.rados.rados.0.smithi142.stdout:254: expect (ObjNum 109 snap 23 seq_num 109) 2020-06-12T02:36:12.063 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.063 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.064 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:12.058+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:12.072 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:12.101 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:12.086+0000 7f8423c5b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:12.110 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:12.098+0000 7f8423c5b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:12.164 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:12.157+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:12.178 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.178 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.187 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:12.191 INFO:tasks.rados.rados.0.smithi142.stdout:253: finishing write tid 6 to smithi14213939-39 2020-06-12T02:36:12.191 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 39 v 119 (ObjNum 117 snap 25 seq_num 117) dirty exists 2020-06-12T02:36:12.192 INFO:tasks.rados.rados.0.smithi142.stdout:253: left oid 39 (ObjNum 117 snap 25 seq_num 117) 2020-06-12T02:36:12.192 INFO:tasks.rados.rados.0.smithi142.stdout:256: finishing rollback tid 1 to smithi14213939-46 2020-06-12T02:36:12.192 INFO:tasks.rados.rados.0.smithi142.stdout:253: done (5 left) 2020-06-12T02:36:12.192 INFO:tasks.rados.rados.0.smithi142.stdout:254: done (4 left) 2020-06-12T02:36:12.193 INFO:tasks.rados.rados.0.smithi142.stdout:257: done (3 left) 2020-06-12T02:36:12.193 INFO:tasks.rados.rados.0.smithi142.stdout:259: done (2 left) 2020-06-12T02:36:12.193 INFO:tasks.rados.rados.0.smithi142.stdout:260: done (1 left) 2020-06-12T02:36:12.194 INFO:tasks.rados.rados.0.smithi142.stdout:261: snap_create 2020-06-12T02:36:12.194 INFO:tasks.rados.rados.0.smithi142.stdout:256: finishing rollback tid 2 to smithi14213939-46 2020-06-12T02:36:12.194 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 46 v 119 (ObjNum 100 snap 20 seq_num 100) dirty exists 2020-06-12T02:36:12.272 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:12.266+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:12.347 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.348 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.357 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:12.407 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:12.401+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:12.465 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.466 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:12.475 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:12.470+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:12.578 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:12.574+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:12.597 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.600 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.606 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:12.679 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:12.673+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:12.764 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.765 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.769 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:12.780 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:12.773+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:12.878 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.879 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:12.881 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:12.877+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:12.887 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:12.983 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:12.978+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:12.994 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:12.994 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:13.004 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:13.041 INFO:tasks.rados.rados.0.smithi142.stdout:256: done (1 left) 2020-06-12T02:36:13.042 INFO:tasks.rados.rados.0.smithi142.stdout:261: done (0 left) 2020-06-12T02:36:13.042 INFO:tasks.rados.rados.0.smithi142.stdout:262: snap_remove snap 25 2020-06-12T02:36:13.045 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.3 to 1 (10000) 2020-06-12T02:36:13.055 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 4 1 2020-06-12T02:36:13.083 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:13.077+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:13.145 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:13.146 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:13.150 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:13.158 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:13.198 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:13.194+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:13.205 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:13.190+0000 7f9637176700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:13.209 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:13.206+0000 7f9635f14700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:13.285 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:13.282+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:13.286+0000 7f2a5ab5a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:13.290+0000 7f2a5ab5a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:13.313 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:13.402 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:13.398+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:13.457 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:13.457 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:13.466 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:13.512 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:13.506+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:13.533 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:13.554 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:13.581 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:13.587 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:13.581+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:13.601 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:13.623 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:13.623 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:13.626 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:13.626 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:13.626 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:13.629 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:13.630 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:13.650 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:13.681 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:13.690 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:13.686+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:13.722 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:13.725 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.726 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.726 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.726 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.726 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.726 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.727 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.727 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:13.771 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:13.771 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:13.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:13.772 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:13.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.772 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:13.772 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:13.773 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.608071533999997, 2020-06-12T02:36:13.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:13.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.773 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:13.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.774 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:13.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.775 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:13.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:13.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:13.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:13.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:13.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:13.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:13.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:13.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:13.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:13.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:13.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:13.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:13.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:13.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:13.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:13.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:13.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:13.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:13.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:13.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:13.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:13.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:13.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:13.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:13.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:13.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.794 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:13.795 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:13.795 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.607760030999998, 2020-06-12T02:36:13.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:13.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:13.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:13.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:13.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:13.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:13.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:13.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:13.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:13.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:13.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:13.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:13.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:13.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:13.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:13.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:13.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:13.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:13.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:13.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:13.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:13.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:13.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:13.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:13.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:13.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:422 1.ds0 1:b8c47ae9:::smithi14213939-24:head [write 1681102~474010] snapc 11=[11,c,b,a] ondisk+write+known_if_redirected e37)", 2020-06-12T02:36:13.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:13.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.504990889999998, 2020-06-12T02:36:13.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619, 2020-06-12T02:36:13.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:13.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.822 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 422 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:13.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260041+0000", 2020-06-12T02:36:13.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00060803099999999998 2020-06-12T02:36:13.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260649+0000", 2020-06-12T02:36:13.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5483999999999999e-05 2020-06-12T02:36:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260674+0000", 2020-06-12T02:36:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4036000000000003e-05 2020-06-12T02:36:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260718+0000", 2020-06-12T02:36:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8003999999999999e-05 2020-06-12T02:36:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.260736+0000", 2020-06-12T02:36:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063788600000000005 2020-06-12T02:36:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261374+0000", 2020-06-12T02:36:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153311 2020-06-12T02:36:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.261527+0000", 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011428038 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272955+0000", 2020-06-12T02:36:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118906 2020-06-12T02:36:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273074+0000", 2020-06-12T02:36:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037998620000000002 2020-06-12T02:36:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276874+0000", 2020-06-12T02:36:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065599220000000001 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283434+0000", 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128603 2020-06-12T02:36:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283563+0000", 2020-06-12T02:36:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120536 2020-06-12T02:36:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.283683+0000", 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023642619 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:425 1.ds0 1:b8c47ae9:::smithi14213939-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:36:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.497342673999999, 2020-06-12T02:36:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999, 2020-06-12T02:36:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 425 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267689+0000", 2020-06-12T02:36:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3261999999999999e-05 2020-06-12T02:36:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267712+0000", 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.472e-06 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267715+0000", 2020-06-12T02:36:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6889999999999998e-06 2020-06-12T02:36:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267722+0000", 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.616e-06 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.267725+0000", 2020-06-12T02:36:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00083742500000000004 2020-06-12T02:36:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.268562+0000", 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024361180000000001 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.270998+0000", 2020-06-12T02:36:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039727 2020-06-12T02:36:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.274971+0000", 2020-06-12T02:36:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0976000000000004e-05 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.275062+0000", 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011605994 2020-06-12T02:36:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286668+0000", 2020-06-12T02:36:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000157675 2020-06-12T02:36:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.286826+0000", 2020-06-12T02:36:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073582880000000002 2020-06-12T02:36:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294184+0000", 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026495214999999999 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:444 1.5s0 1:a8df2b52:::smithi14213939-27:head [write 544560~783450] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.835194395999999, 2020-06-12T02:36:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001, 2020-06-12T02:36:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 444 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.929837+0000", 2020-06-12T02:36:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041368699999999998 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930251+0000", 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0767999999999999e-05 2020-06-12T02:36:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930261+0000", 2020-06-12T02:36:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6778000000000001e-05 2020-06-12T02:36:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930278+0000", 2020-06-12T02:36:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0348e-05 2020-06-12T02:36:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930289+0000", 2020-06-12T02:36:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100268 2020-06-12T02:36:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930389+0000", 2020-06-12T02:36:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2133000000000001e-05 2020-06-12T02:36:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.930401+0000", 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003798161 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934199+0000", 2020-06-12T02:36:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000124413 2020-06-12T02:36:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.934324+0000", 2020-06-12T02:36:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001950249 2020-06-12T02:36:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.936274+0000", 2020-06-12T02:36:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086764879999999996 2020-06-12T02:36:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.944950+0000", 2020-06-12T02:36:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071019539999999997 2020-06-12T02:36:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952052+0000", 2020-06-12T02:36:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012448599999999999 2020-06-12T02:36:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.952177+0000", 2020-06-12T02:36:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022339733000000001 2020-06-12T02:36:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.815509464000002, 2020-06-12T02:36:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.814992785000001, 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.812486351, 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.812306355, 2020-06-12T02:36:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.812171263, 2020-06-12T02:36:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:573 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.811996999, 2020-06-12T02:36:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281, 2020-06-12T02:36:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 573 2020-06-12T02:36:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953034+0000", 2020-06-12T02:36:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0703000000000003e-05 2020-06-12T02:36:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953115+0000", 2020-06-12T02:36:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.96e-06 2020-06-12T02:36:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953123+0000", 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3210000000000001e-05 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953136+0000", 2020-06-12T02:36:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8659999999999997e-06 2020-06-12T02:36:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953141+0000", 2020-06-12T02:36:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00054970300000000002 2020-06-12T02:36:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953691+0000", 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6529999999999994e-06 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953698+0000", 2020-06-12T02:36:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040487869999999999 2020-06-12T02:36:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957747+0000", 2020-06-12T02:36:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7700000000000003e-07 2020-06-12T02:36:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957748+0000", 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015554228 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973302+0000", 2020-06-12T02:36:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020247700000000001 2020-06-12T02:36:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973505+0000", 2020-06-12T02:36:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047224210000000001 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978227+0000", 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015839599999999999 2020-06-12T02:36:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978386+0000", 2020-06-12T02:36:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025351281 2020-06-12T02:36:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:574 1.ds0 1:bb6dbdab:::smithi14213939-46:head [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.811846702, 2020-06-12T02:36:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998, 2020-06-12T02:36:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 574 2020-06-12T02:36:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953185+0000", 2020-06-12T02:36:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5772999999999997e-05 2020-06-12T02:36:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953230+0000", 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6329999999999996e-06 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953238+0000", 2020-06-12T02:36:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3053e-05 2020-06-12T02:36:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953251+0000", 2020-06-12T02:36:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1039999999999998e-06 2020-06-12T02:36:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953256+0000", 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046425299999999997 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953721+0000", 2020-06-12T02:36:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5349999999999999e-06 2020-06-12T02:36:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953728+0000", 2020-06-12T02:36:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040455209999999998 2020-06-12T02:36:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957774+0000", 2020-06-12T02:36:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0550000000000001e-06 2020-06-12T02:36:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957775+0000", 2020-06-12T02:36:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015755697999999999 2020-06-12T02:36:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973530+0000", 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2848e-05 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973573+0000", 2020-06-12T02:36:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048625020000000003 2020-06-12T02:36:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978436+0000", 2020-06-12T02:36:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012710299999999999 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978563+0000", 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025378077999999998 2020-06-12T02:36:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:575 1.ds0 1:bb6dbdab:::smithi14213939-46:head [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.811722528000001, 2020-06-12T02:36:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999, 2020-06-12T02:36:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 575 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953309+0000", 2020-06-12T02:36:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8362000000000006e-05 2020-06-12T02:36:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953387+0000", 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5710000000000003e-06 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953394+0000", 2020-06-12T02:36:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3081999999999999e-05 2020-06-12T02:36:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953407+0000", 2020-06-12T02:36:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953412+0000", 2020-06-12T02:36:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000338394 2020-06-12T02:36:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953751+0000", 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1470000000000001e-06 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953759+0000", 2020-06-12T02:36:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040449010000000001 2020-06-12T02:36:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957804+0000", 2020-06-12T02:36:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7770000000000001e-06 2020-06-12T02:36:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957806+0000", 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015827687999999999 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973633+0000", 2020-06-12T02:36:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3745999999999998e-05 2020-06-12T02:36:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for missing object", 2020-06-12T02:36:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.973667+0000", 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049250680000000003 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978592+0000", 2020-06-12T02:36:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3843000000000005e-05 2020-06-12T02:36:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.978656+0000", 2020-06-12T02:36:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025347031999999999 2020-06-12T02:36:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:579 1.5s0 1:aa8c60b3:::smithi14213939-31:head [write 2158943~647020] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.814018566, 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001, 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 579 2020-06-12T02:36:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951013+0000", 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032091999999999998 2020-06-12T02:36:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951334+0000", 2020-06-12T02:36:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0485e-05 2020-06-12T02:36:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951344+0000", 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0214999999999999e-05 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951364+0000", 2020-06-12T02:36:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7785e-05 2020-06-12T02:36:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951382+0000", 2020-06-12T02:36:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1069999999999996e-05 2020-06-12T02:36:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951443+0000", 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015391999999999999 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.951597+0000", 2020-06-12T02:36:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014059853000000001 2020-06-12T02:36:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.965657+0000", 2020-06-12T02:36:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003128432 2020-06-12T02:36:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968786+0000", 2020-06-12T02:36:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042710819999999998 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973057+0000", 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024853800000000002 2020-06-12T02:36:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.973305+0000", 2020-06-12T02:36:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022292300000000001 2020-06-12T02:36:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:581 1.5s0 1:aa8c60b3:::smithi14213939-31:head [setxattr _header (57) in=7b,truncate 3563051] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.80915062, 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999, 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 581 2020-06-12T02:36:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955881+0000", 2020-06-12T02:36:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1825999999999998e-05 2020-06-12T02:36:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955973+0000", 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1440000000000003e-06 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955981+0000", 2020-06-12T02:36:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2928000000000001e-05 2020-06-12T02:36:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955994+0000", 2020-06-12T02:36:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6300000000000003e-06 2020-06-12T02:36:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.955999+0000", 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040354799999999999 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956403+0000", 2020-06-12T02:36:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010726300000000001 2020-06-12T02:36:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956510+0000", 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011669656 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968180+0000", 2020-06-12T02:36:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024867209999999999 2020-06-12T02:36:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.970666+0000", 2020-06-12T02:36:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072037769999999998 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977870+0000", 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106267 2020-06-12T02:36:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.977977+0000", 2020-06-12T02:36:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022095759999999999 2020-06-12T02:36:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:582 1.5s0 1:aa8c60b3:::smithi14213939-31:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.808973519, 2020-06-12T02:36:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962, 2020-06-12T02:36:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 582 2020-06-12T02:36:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956058+0000", 2020-06-12T02:36:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7505e-05 2020-06-12T02:36:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956105+0000", 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.311e-06 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956113+0000", 2020-06-12T02:36:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3230999999999999e-05 2020-06-12T02:36:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956126+0000", 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9189999999999998e-06 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956131+0000", 2020-06-12T02:36:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00057600900000000005 2020-06-12T02:36:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956707+0000", 2020-06-12T02:36:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000126515 2020-06-12T02:36:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.956833+0000", 2020-06-12T02:36:14.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021768708000000001 2020-06-12T02:36:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978602+0000", 2020-06-12T02:36:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012831499999999999 2020-06-12T02:36:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.978730+0000", 2020-06-12T02:36:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017164490000000001 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.980447+0000", 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024388962 2020-06-12T02:36:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.762580992, 2020-06-12T02:36:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.754534202, 2020-06-12T02:36:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.754188837999999, 2020-06-12T02:36:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.754057285, 2020-06-12T02:36:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:14.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.121 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:14.121 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:36:14.124 INFO:tasks.rados.rados.0.smithi142.stdout:262: done (0 left) 2020-06-12T02:36:14.124 INFO:tasks.rados.rados.0.smithi142.stdout:263: write (excl) oid 20 current snap is 26 2020-06-12T02:36:14.125 INFO:tasks.rados.rados.0.smithi142.stdout:263: seq_num 121 ranges {433647=450424,1331027=582033} 2020-06-12T02:36:14.125 INFO:tasks.rados.rados.0.smithi142.stdout:263: writing smithi14213939-20 from 433647 to 884071 tid 1 2020-06-12T02:36:14.125 INFO:tasks.rados.rados.0.smithi142.stdout:263: writing smithi14213939-20 from 1331027 to 1913060 tid 2 2020-06-12T02:36:14.125 INFO:tasks.rados.rados.0.smithi142.stdout:264: snap_create 2020-06-12T02:36:14.125 INFO:tasks.rados.rados.0.smithi142.stdout:263: finishing write tid 1 to smithi14213939-20 2020-06-12T02:36:14.126 INFO:tasks.rados.rados.0.smithi142.stdout:263: finishing write tid 2 to smithi14213939-20 2020-06-12T02:36:14.126 INFO:tasks.rados.rados.0.smithi142.stdout:263: finishing write tid 4 to smithi14213939-20 2020-06-12T02:36:14.126 INFO:tasks.rados.rados.0.smithi142.stdout:263: finishing write tid 5 to smithi14213939-20 2020-06-12T02:36:14.126 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 20 v 41 (ObjNum 121 snap 26 seq_num 121) dirty exists 2020-06-12T02:36:14.126 INFO:tasks.rados.rados.0.smithi142.stdout:263: left oid 20 (ObjNum 121 snap 26 seq_num 121) 2020-06-12T02:36:14.127 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.4 to 1 (10000) 2020-06-12T02:36:14.127 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:14.113+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:14.128 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:14.128 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 5 1 2020-06-12T02:36:14.222 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:14.218+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:14.279 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:14.266+0000 7fad0b6a8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:14.284 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:14.278+0000 7fad0b6a8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:14.284 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:14.270+0000 7f4adec40700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:14.285 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:14.286 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:14.286 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:14.286 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:14.287 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:14.282+0000 7f4add9de700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:14.324 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:14.317+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:14.425 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:14.417+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:14.476 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:14.476 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:14.477 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:14.485 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:14.533 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:14.530+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:14.589 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:14.589 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:14.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:14.590 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:14.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.591 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:192 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:14.591 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:14.591 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.814840707000002, 2020-06-12T02:36:14.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999, 2020-06-12T02:36:14.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.592 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.592 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.592 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 192 2020-06-12T02:36:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.593 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767788+0000", 2020-06-12T02:36:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:36:14.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767818+0000", 2020-06-12T02:36:14.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6110000000000004e-06 2020-06-12T02:36:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767822+0000", 2020-06-12T02:36:14.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8060000000000006e-06 2020-06-12T02:36:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767832+0000", 2020-06-12T02:36:14.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3510000000000004e-06 2020-06-12T02:36:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.767836+0000", 2020-06-12T02:36:14.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050647340000000004 2020-06-12T02:36:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.772901+0000", 2020-06-12T02:36:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109873 2020-06-12T02:36:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.773011+0000", 2020-06-12T02:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035580400000000002 2020-06-12T02:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776569+0000", 2020-06-12T02:36:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6688999999999996e-05 2020-06-12T02:36:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.776656+0000", 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001371709 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.778027+0000", 2020-06-12T02:36:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010239666999999999 2020-06-12T02:36:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.460503821000003, 2020-06-12T02:36:14.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:14.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:14.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:14.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:14.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.629 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.460280378999997, 2020-06-12T02:36:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.630 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:14.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:14.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:14.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:14.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:14.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:14.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:14.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:14.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:14.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:14.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:14.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:225 1.6s0 1:6f0b6341:::smithi14213939-20:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:14.646 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.459897753, 2020-06-12T02:36:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001, 2020-06-12T02:36:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 225 2020-06-12T02:36:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.648 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122731+0000", 2020-06-12T02:36:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9922000000000001e-05 2020-06-12T02:36:14.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122781+0000", 2020-06-12T02:36:14.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0399999999999998e-06 2020-06-12T02:36:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122787+0000", 2020-06-12T02:36:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1926999999999999e-05 2020-06-12T02:36:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122799+0000", 2020-06-12T02:36:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7280000000000001e-06 2020-06-12T02:36:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122802+0000", 2020-06-12T02:36:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004465063 2020-06-12T02:36:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127267+0000", 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014145999999999999 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.127409+0000", 2020-06-12T02:36:14.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069305699999999996 2020-06-12T02:36:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.128102+0000", 2020-06-12T02:36:14.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026151099999999999 2020-06-12T02:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.130717+0000", 2020-06-12T02:36:14.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057126850000000003 2020-06-12T02:36:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136430+0000", 2020-06-12T02:36:14.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8999999999999995e-05 2020-06-12T02:36:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.136519+0000", 2020-06-12T02:36:14.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013787992000000001 2020-06-12T02:36:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.417801269999998, 2020-06-12T02:36:14.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.663 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:14.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:14.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:14.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:14.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:14.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:14.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:14.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.417466376, 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.683 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:14.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:14.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:14.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:14.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:14.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:14.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:14.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:14.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:14.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:14.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:14.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:14.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:14.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:14.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:14.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:14.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:14.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:14.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:14.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:14.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.699 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:311 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.316870309999999, 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347, 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.702 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.702 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 311 2020-06-12T02:36:14.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.702 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265758+0000", 2020-06-12T02:36:14.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2830999999999993e-05 2020-06-12T02:36:14.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265841+0000", 2020-06-12T02:36:14.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5279999999999998e-06 2020-06-12T02:36:14.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265849+0000", 2020-06-12T02:36:14.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9006999999999999e-05 2020-06-12T02:36:14.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265868+0000", 2020-06-12T02:36:14.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.772e-06 2020-06-12T02:36:14.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265873+0000", 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072750600000000005 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266601+0000", 2020-06-12T02:36:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011586699999999999 2020-06-12T02:36:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266717+0000", 2020-06-12T02:36:14.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016014836000000001 2020-06-12T02:36:14.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.282732+0000", 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016973347 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.712 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:312 1.1s0 1:82c302db:::smithi14213939-48:4 [read 0~2789929,checksum] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:14.712 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:14.712 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.316696477999997, 2020-06-12T02:36:14.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001, 2020-06-12T02:36:14.713 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.713 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 312 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265932+0000", 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0629000000000003e-05 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266013+0000", 2020-06-12T02:36:14.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9190000000000002e-06 2020-06-12T02:36:14.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266020+0000", 2020-06-12T02:36:14.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2887e-05 2020-06-12T02:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266032+0000", 2020-06-12T02:36:14.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5258e-05 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266048+0000", 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091540999999999997 2020-06-12T02:36:14.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266963+0000", 2020-06-12T02:36:14.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101524 2020-06-12T02:36:14.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.267065+0000", 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019677448 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286742+0000", 2020-06-12T02:36:14.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020810075000000001 2020-06-12T02:36:14.722 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.722 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.724 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 34/18 ECSubWrite(tid=108, reqid=osd.2.0:106, at_version=0'0, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:36:14.724 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:14.724 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.623005075000002, 2020-06-12T02:36:14.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013603179, 2020-06-12T02:36:14.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.725 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:14.725 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:14.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959623+0000", 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0952999999999997e-05 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959684+0000", 2020-06-12T02:36:14.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7781000000000001e-05 2020-06-12T02:36:14.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959702+0000", 2020-06-12T02:36:14.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7286999999999999e-05 2020-06-12T02:36:14.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959719+0000", 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7219999999999999e-06 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959727+0000", 2020-06-12T02:36:14.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2355000000000003e-05 2020-06-12T02:36:14.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959780+0000", 2020-06-12T02:36:14.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2128e-05 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.959792+0000", 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013367046 2020-06-12T02:36:14.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.973159+0000", 2020-06-12T02:36:14.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7906999999999999e-05 2020-06-12T02:36:14.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.973227+0000", 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013603179 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.734 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.735 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(1.5s2 34/18 ECSubWrite(tid=109, reqid=osd.2.0:109, at_version=34'35, trim_to=0'0, roll_forward_to=34'33))", 2020-06-12T02:36:14.735 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.619598875000001, 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011680961, 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:14.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963030+0000", 2020-06-12T02:36:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2312999999999998e-05 2020-06-12T02:36:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963092+0000", 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2055999999999999e-05 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963124+0000", 2020-06-12T02:36:14.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7685000000000001e-05 2020-06-12T02:36:14.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963142+0000", 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6190000000000002e-06 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963149+0000", 2020-06-12T02:36:14.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00065343699999999998 2020-06-12T02:36:14.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963803+0000", 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5209e-05 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.963818+0000", 2020-06-12T02:36:14.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010837009 2020-06-12T02:36:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.974655+0000", 2020-06-12T02:36:14.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5633000000000001e-05 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.974711+0000", 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011680961 2020-06-12T02:36:14.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.746 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:427 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 30.309710275, 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016209472999999999, 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 427 2020-06-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.748 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.272918+0000", 2020-06-12T02:36:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010785600000000001 2020-06-12T02:36:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273026+0000", 2020-06-12T02:36:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2359e-05 2020-06-12T02:36:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273038+0000", 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0114000000000001e-05 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273059+0000", 2020-06-12T02:36:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0756e-05 2020-06-12T02:36:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273069+0000", 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047501200000000003 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273544+0000", 2020-06-12T02:36:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2884000000000001e-05 2020-06-12T02:36:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:14.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273557+0000", 2020-06-12T02:36:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031519489999999998 2020-06-12T02:36:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276709+0000", 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115417 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.276825+0000", 2020-06-12T02:36:14.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012303125999999999 2020-06-12T02:36:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.289128+0000", 2020-06-12T02:36:14.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016209472999999999 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.759 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:428 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 30.309486838000002, 2020-06-12T02:36:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020091841999999999, 2020-06-12T02:36:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 428 2020-06-12T02:36:14.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273142+0000", 2020-06-12T02:36:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3462999999999996e-05 2020-06-12T02:36:14.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273235+0000", 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2430000000000005e-06 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273243+0000", 2020-06-12T02:36:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4543e-05 2020-06-12T02:36:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273258+0000", 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9540000000000001e-06 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273264+0000", 2020-06-12T02:36:14.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037543199999999998 2020-06-12T02:36:14.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273639+0000", 2020-06-12T02:36:14.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0042e-05 2020-06-12T02:36:14.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273649+0000", 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037505450000000001 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277400+0000", 2020-06-12T02:36:14.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9163000000000001e-05 2020-06-12T02:36:14.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277479+0000", 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015754456999999999 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.293234+0000", 2020-06-12T02:36:14.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020091841999999999 2020-06-12T02:36:14.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.777 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:429 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:14.777 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:14.777 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 30.309304633, 2020-06-12T02:36:14.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862, 2020-06-12T02:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.778 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 429 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:14.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7293000000000005e-05 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273421+0000", 2020-06-12T02:36:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2640000000000008e-06 2020-06-12T02:36:14.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273429+0000", 2020-06-12T02:36:14.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5403000000000001e-05 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273445+0000", 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.759e-06 2020-06-12T02:36:14.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273452+0000", 2020-06-12T02:36:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022692599999999999 2020-06-12T02:36:14.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273679+0000", 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8340000000000005e-06 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:14.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273687+0000", 2020-06-12T02:36:14.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040310149999999998 2020-06-12T02:36:14.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277718+0000", 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106714 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277825+0000", 2020-06-12T02:36:14.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016577654000000001 2020-06-12T02:36:14.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294403+0000", 2020-06-12T02:36:14.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862 2020-06-12T02:36:14.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.790 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.791 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:459 1.1s0 1:82c302db:::smithi14213939-48:a [sparse-read 0~2689087] snapc 0=[] ondisk+read+known_if_redirected e38)", 2020-06-12T02:36:14.791 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:14.792 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.378937297, 2020-06-12T02:36:14.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013834964999999999, 2020-06-12T02:36:14.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.792 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.793 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 459 2020-06-12T02:36:14.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.793 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203691+0000", 2020-06-12T02:36:14.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3652000000000001e-05 2020-06-12T02:36:14.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203745+0000", 2020-06-12T02:36:14.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8890000000000002e-06 2020-06-12T02:36:14.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203753+0000", 2020-06-12T02:36:14.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4484000000000001e-05 2020-06-12T02:36:14.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203767+0000", 2020-06-12T02:36:14.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6529999999999994e-06 2020-06-12T02:36:14.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203775+0000", 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010078859999999999 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204783+0000", 2020-06-12T02:36:14.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011844 2020-06-12T02:36:14.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204901+0000", 2020-06-12T02:36:14.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012624961000000001 2020-06-12T02:36:14.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.217526+0000", 2020-06-12T02:36:14.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013834964999999999 2020-06-12T02:36:14.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.802 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.803 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:601 1.6s0 1:6f0b6341:::smithi14213939-20:head [read 0~2470596,checksum] snapc 0=[] ondisk+read+known_if_redirected e53)", 2020-06-12T02:36:14.803 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:14.803 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.571559739, 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010173364000000001, 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.804 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.805 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 601 2020-06-12T02:36:14.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.805 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011069+0000", 2020-06-12T02:36:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4679999999999996e-05 2020-06-12T02:36:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011143+0000", 2020-06-12T02:36:14.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8110000000000003e-06 2020-06-12T02:36:14.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011151+0000", 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3455000000000001e-05 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011165+0000", 2020-06-12T02:36:14.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5910000000000003e-06 2020-06-12T02:36:14.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011170+0000", 2020-06-12T02:36:14.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039521790000000001 2020-06-12T02:36:14.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015122+0000", 2020-06-12T02:36:14.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011416 2020-06-12T02:36:14.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015237+0000", 2020-06-12T02:36:14.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060054879999999998 2020-06-12T02:36:14.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.021242+0000", 2020-06-12T02:36:14.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010173364000000001 2020-06-12T02:36:14.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.816 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.817 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:602 1.6s0 1:6f0b6341:::smithi14213939-20:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e53)", 2020-06-12T02:36:14.818 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:14.818 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.571415559, 2020-06-12T02:36:14.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013692607000000001, 2020-06-12T02:36:14.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.820 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.820 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.821 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 602 2020-06-12T02:36:14.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.822 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:14.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011213+0000", 2020-06-12T02:36:14.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5103999999999999e-05 2020-06-12T02:36:14.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011238+0000", 2020-06-12T02:36:14.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1250000000000003e-06 2020-06-12T02:36:14.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011242+0000", 2020-06-12T02:36:14.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4440000000000002e-06 2020-06-12T02:36:14.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011250+0000", 2020-06-12T02:36:14.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1089999999999998e-06 2020-06-12T02:36:14.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011253+0000", 2020-06-12T02:36:14.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046336219999999996 2020-06-12T02:36:14.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015886+0000", 2020-06-12T02:36:14.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8393000000000001e-05 2020-06-12T02:36:14.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.015945+0000", 2020-06-12T02:36:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0089608099999999996 2020-06-12T02:36:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.024906+0000", 2020-06-12T02:36:14.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013692607000000001 2020-06-12T02:36:14.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.835 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:765 1.6s0 1:6f0b6341:::smithi14213939-20:head [write 433647~450424,stat] snapc 2e=[2b,25,24,23,1e,16] ondisk+write+known_if_redirected e67)", 2020-06-12T02:36:14.835 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.067718+0000", 2020-06-12T02:36:14.835 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.51491019599999999, 2020-06-12T02:36:14.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016950438000000002, 2020-06-12T02:36:14.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.836 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.836 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.836 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.837 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.837 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 765 2020-06-12T02:36:14.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.837 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.067718+0000", 2020-06-12T02:36:14.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.067718+0000", 2020-06-12T02:36:14.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029345800000000002 2020-06-12T02:36:14.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068012+0000", 2020-06-12T02:36:14.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2792999999999999e-05 2020-06-12T02:36:14.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068025+0000", 2020-06-12T02:36:14.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4590999999999999e-05 2020-06-12T02:36:14.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068049+0000", 2020-06-12T02:36:14.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3552e-05 2020-06-12T02:36:14.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068063+0000", 2020-06-12T02:36:14.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2191000000000001e-05 2020-06-12T02:36:14.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068135+0000", 2020-06-12T02:36:14.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0254999999999999e-05 2020-06-12T02:36:14.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:14.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.068145+0000", 2020-06-12T02:36:14.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030673440000000001 2020-06-12T02:36:14.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.071212+0000", 2020-06-12T02:36:14.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021392199999999999 2020-06-12T02:36:14.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.071426+0000", 2020-06-12T02:36:14.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042058199999999999 2020-06-12T02:36:14.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.075632+0000", 2020-06-12T02:36:14.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003897494 2020-06-12T02:36:14.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079530+0000", 2020-06-12T02:36:14.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049032900000000003 2020-06-12T02:36:14.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.084433+0000", 2020-06-12T02:36:14.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023572799999999999 2020-06-12T02:36:14.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.084669+0000", 2020-06-12T02:36:14.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016950438000000002 2020-06-12T02:36:14.857 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.859 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:766 1.6s0 1:6f0b6341:::smithi14213939-20:head [write 1331027~582033] snapc 2e=[2b,25,24,23,1e,16] ondisk+write+known_if_redirected e67)", 2020-06-12T02:36:14.859 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.076010+0000", 2020-06-12T02:36:14.860 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.50661898400000005, 2020-06-12T02:36:14.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015709692000000001, 2020-06-12T02:36:14.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 766 2020-06-12T02:36:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076010+0000", 2020-06-12T02:36:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076010+0000", 2020-06-12T02:36:14.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041441999999999998 2020-06-12T02:36:14.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076424+0000", 2020-06-12T02:36:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4634000000000002e-05 2020-06-12T02:36:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076449+0000", 2020-06-12T02:36:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3513999999999997e-05 2020-06-12T02:36:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076492+0000", 2020-06-12T02:36:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9626000000000001e-05 2020-06-12T02:36:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076512+0000", 2020-06-12T02:36:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021133889999999998 2020-06-12T02:36:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.078625+0000", 2020-06-12T02:36:14.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015777400000000001 2020-06-12T02:36:14.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.078783+0000", 2020-06-12T02:36:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065562229999999999 2020-06-12T02:36:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.085339+0000", 2020-06-12T02:36:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133151 2020-06-12T02:36:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.085472+0000", 2020-06-12T02:36:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027728990000000001 2020-06-12T02:36:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.088245+0000", 2020-06-12T02:36:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019792329999999999 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.090224+0000", 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001422399 2020-06-12T02:36:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.091647+0000", 2020-06-12T02:36:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2429999999999996e-05 2020-06-12T02:36:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.091719+0000", 2020-06-12T02:36:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015709692000000001 2020-06-12T02:36:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:767 1.6s0 1:6f0b6341:::smithi14213939-20:head [setxattr _header (57) in=7b,truncate 2033647] snapc 2e=[2b,25,24,23,1e,16] ondisk+write+known_if_redirected e67)", 2020-06-12T02:36:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.076675+0000", 2020-06-12T02:36:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.50595331499999996, 2020-06-12T02:36:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019174495, 2020-06-12T02:36:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 767 2020-06-12T02:36:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076675+0000", 2020-06-12T02:36:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076675+0000", 2020-06-12T02:36:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000230752 2020-06-12T02:36:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076906+0000", 2020-06-12T02:36:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5184000000000001e-05 2020-06-12T02:36:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076921+0000", 2020-06-12T02:36:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6409999999999999e-05 2020-06-12T02:36:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076958+0000", 2020-06-12T02:36:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4320000000000005e-06 2020-06-12T02:36:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.076967+0000", 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001886794 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.078854+0000", 2020-06-12T02:36:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014851999999999999 2020-06-12T02:36:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079002+0000", 2020-06-12T02:36:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069635529999999999 2020-06-12T02:36:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.085966+0000", 2020-06-12T02:36:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013420399999999999 2020-06-12T02:36:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.086100+0000", 2020-06-12T02:36:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036747170000000001 2020-06-12T02:36:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.089775+0000", 2020-06-12T02:36:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00227611 2020-06-12T02:36:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.092051+0000", 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037313379999999998 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.095782+0000", 2020-06-12T02:36:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7481e-05 2020-06-12T02:36:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.095850+0000", 2020-06-12T02:36:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019174495 2020-06-12T02:36:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:768 1.6s0 1:6f0b6341:::smithi14213939-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e67)", 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.50553036699999998, 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021124269000000001, 2020-06-12T02:36:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 768 2020-06-12T02:36:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015301 2020-06-12T02:36:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077251+0000", 2020-06-12T02:36:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2774e-05 2020-06-12T02:36:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077264+0000", 2020-06-12T02:36:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077294+0000", 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7688000000000001e-05 2020-06-12T02:36:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077311+0000", 2020-06-12T02:36:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001726684 2020-06-12T02:36:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079038+0000", 2020-06-12T02:36:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013601499999999999 2020-06-12T02:36:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079174+0000", 2020-06-12T02:36:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073522930000000002 2020-06-12T02:36:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.086526+0000", 2020-06-12T02:36:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6370000000000003e-05 2020-06-12T02:36:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.086593+0000", 2020-06-12T02:36:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097098859999999992 2020-06-12T02:36:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.096303+0000", 2020-06-12T02:36:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019877 2020-06-12T02:36:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.096501+0000", 2020-06-12T02:36:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017209250000000001 2020-06-12T02:36:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.098222+0000", 2020-06-12T02:36:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021124269000000001 2020-06-12T02:36:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:14.922 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:14.924 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:14.925 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:14.918+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:14.944 INFO:tasks.rados.rados.0.smithi142.stdout:263: done (1 left) 2020-06-12T02:36:14.945 INFO:tasks.rados.rados.0.smithi142.stdout:264: done (0 left) 2020-06-12T02:36:14.945 INFO:tasks.rados.rados.0.smithi142.stdout:265: write (excl) oid 32 current snap is 27 2020-06-12T02:36:14.945 INFO:tasks.rados.rados.0.smithi142.stdout:265: seq_num 122 ranges {450454=642026,1505862=544592} 2020-06-12T02:36:14.947 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.5 to 1 (10000) 2020-06-12T02:36:14.948 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:36:14.954 INFO:tasks.rados.rados.0.smithi142.stdout:265: writing smithi14213939-32 from 450454 to 1092480 tid 1 2020-06-12T02:36:14.961 INFO:tasks.rados.rados.0.smithi142.stdout:265: writing smithi14213939-32 from 1505862 to 2050454 tid 2 2020-06-12T02:36:14.961 INFO:tasks.rados.rados.0.smithi142.stdout:266: write oid 42 current snap is 27 2020-06-12T02:36:14.961 INFO:tasks.rados.rados.0.smithi142.stdout:266: seq_num 123 ranges {467261=717275,1847991=219270} 2020-06-12T02:36:14.964 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 6 1 2020-06-12T02:36:14.967 INFO:tasks.rados.rados.0.smithi142.stdout:266: writing smithi14213939-42 from 467261 to 1184536 tid 1 2020-06-12T02:36:14.973 INFO:tasks.rados.rados.0.smithi142.stdout:266: writing smithi14213939-42 from 1847991 to 2067261 tid 2 2020-06-12T02:36:14.973 INFO:tasks.rados.rados.0.smithi142.stdout:267: delete oid 9 current snap is 27 2020-06-12T02:36:14.974 INFO:tasks.rados.rados.0.smithi142.stdout:265: finishing write tid 1 to smithi14213939-32 2020-06-12T02:36:14.983 INFO:tasks.rados.rados.0.smithi142.stdout:267: done (2 left) 2020-06-12T02:36:14.983 INFO:tasks.rados.rados.0.smithi142.stdout:268: rollback oid 7 current snap is 27 2020-06-12T02:36:14.984 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 7 to 19 2020-06-12T02:36:14.984 INFO:tasks.rados.rados.0.smithi142.stdout:266: finishing write tid 1 to smithi14213939-42 2020-06-12T02:36:14.984 INFO:tasks.rados.rados.0.smithi142.stdout:269: copy_from oid 25 from oid 33 current snap is 27 2020-06-12T02:36:14.984 INFO:tasks.rados.rados.0.smithi142.stdout:270: read oid 21 snap 20 2020-06-12T02:36:14.984 INFO:tasks.rados.rados.0.smithi142.stdout:270: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:36:14.985 INFO:tasks.rados.rados.0.smithi142.stdout:271: copy_from oid 1 from oid 14 current snap is 27 2020-06-12T02:36:14.985 INFO:tasks.rados.rados.0.smithi142.stdout:272: read oid 38 snap 21 2020-06-12T02:36:14.985 INFO:tasks.rados.rados.0.smithi142.stdout:272: expect deleted 2020-06-12T02:36:14.985 INFO:tasks.rados.rados.0.smithi142.stdout:273: delete oid 16 current snap is 27 2020-06-12T02:36:14.986 INFO:tasks.rados.rados.0.smithi142.stdout:265: finishing write tid 2 to smithi14213939-32 2020-06-12T02:36:14.986 INFO:tasks.rados.rados.0.smithi142.stdout:265: finishing write tid 4 to smithi14213939-32 2020-06-12T02:36:14.988 INFO:tasks.rados.rados.0.smithi142.stdout:272: done (7 left) 2020-06-12T02:36:14.988 INFO:tasks.rados.rados.0.smithi142.stdout:273: done (6 left) 2020-06-12T02:36:14.989 INFO:tasks.rados.rados.0.smithi142.stdout:274: rollback oid 9 current snap is 27 2020-06-12T02:36:14.989 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 9 to 26 2020-06-12T02:36:14.989 INFO:tasks.rados.rados.0.smithi142.stdout:275: delete oid 38 current snap is 27 2020-06-12T02:36:14.990 INFO:tasks.rados.rados.0.smithi142.stdout:268: finishing rollback tid 1 to smithi14213939-7 2020-06-12T02:36:14.991 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 39 (ObjNum 1953066355 snap 875653480 seq_num 959656242) dirty dne 2020-06-12T02:36:14.991 INFO:tasks.rados.rados.0.smithi142.stdout:271: finishing copy_from to smithi14213939-1 2020-06-12T02:36:14.991 INFO:tasks.rados.rados.0.smithi142.stdout:271: got expected ENOENT (src dne) 2020-06-12T02:36:14.991 INFO:tasks.rados.rados.0.smithi142.stdout:271: finishing copy_from racing read to smithi14213939-1 2020-06-12T02:36:14.992 INFO:tasks.rados.rados.0.smithi142.stdout:265: finishing write tid 5 to smithi14213939-32 2020-06-12T02:36:14.992 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 32 v 61 (ObjNum 122 snap 27 seq_num 122) dirty exists 2020-06-12T02:36:14.992 INFO:tasks.rados.rados.0.smithi142.stdout:265: left oid 32 (ObjNum 122 snap 27 seq_num 122) 2020-06-12T02:36:14.993 INFO:tasks.rados.rados.0.smithi142.stdout:265: done (7 left) 2020-06-12T02:36:14.993 INFO:tasks.rados.rados.0.smithi142.stdout:268: done (6 left) 2020-06-12T02:36:14.993 INFO:tasks.rados.rados.0.smithi142.stdout:271: done (5 left) 2020-06-12T02:36:14.993 INFO:tasks.rados.rados.0.smithi142.stdout:275: done (4 left) 2020-06-12T02:36:14.994 INFO:tasks.rados.rados.0.smithi142.stdout:276: read oid 31 snap -1 2020-06-12T02:36:14.994 INFO:tasks.rados.rados.0.smithi142.stdout:276: expect (ObjNum 108 snap 23 seq_num 108) 2020-06-12T02:36:14.994 INFO:tasks.rados.rados.0.smithi142.stdout:277: write (excl) oid 23 current snap is 27 2020-06-12T02:36:14.994 INFO:tasks.rados.rados.0.smithi142.stdout:277: seq_num 127 ranges {534489=618271,1565566=568923} 2020-06-12T02:36:14.997 INFO:tasks.rados.rados.0.smithi142.stdout:277: writing smithi14213939-23 from 534489 to 1152760 tid 1 2020-06-12T02:36:15.004 INFO:tasks.rados.rados.0.smithi142.stdout:277: writing smithi14213939-23 from 1565566 to 2134489 tid 2 2020-06-12T02:36:15.004 INFO:tasks.rados.rados.0.smithi142.stdout:278: write oid 1 current snap is 27 2020-06-12T02:36:15.004 INFO:tasks.rados.rados.0.smithi142.stdout:278: seq_num 128 ranges {551296=693520,2024048=127248} 2020-06-12T02:36:15.012 INFO:tasks.rados.rados.0.smithi142.stdout:278: writing smithi14213939-1 from 551296 to 1244816 tid 1 2020-06-12T02:36:15.017 INFO:tasks.rados.rados.0.smithi142.stdout:278: writing smithi14213939-1 from 2024048 to 2151296 tid 2 2020-06-12T02:36:15.017 INFO:tasks.rados.rados.0.smithi142.stdout:279: rollback oid 30 current snap is 27 2020-06-12T02:36:15.018 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 30 to 26 2020-06-12T02:36:15.018 INFO:tasks.rados.rados.0.smithi142.stdout:274: finishing rollback tid 1 to smithi14213939-9 2020-06-12T02:36:15.018 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 9 v 147 (ObjNum -453387368 snap 21999 seq_num 1) dirty dne 2020-06-12T02:36:15.018 INFO:tasks.rados.rados.0.smithi142.stdout:266: finishing write tid 2 to smithi14213939-42 2020-06-12T02:36:15.019 INFO:tasks.rados.rados.0.smithi142.stdout:266: finishing write tid 4 to smithi14213939-42 2020-06-12T02:36:15.019 INFO:tasks.rados.rados.0.smithi142.stdout:270: expect (ObjNum 20 snap 0 seq_num 20) 2020-06-12T02:36:15.024 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:15.017+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:15.068 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:15.086 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:15.086 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:15.087 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:15.088 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:15.070+0000 7f7b9032d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:15.089 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:15.090 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:15.082+0000 7f7b8f0cb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:15.100 INFO:tasks.rados.rados.0.smithi142.stdout:266: finishing write tid 5 to smithi14213939-42 2020-06-12T02:36:15.101 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 42 v 70 (ObjNum 123 snap 27 seq_num 123) dirty exists 2020-06-12T02:36:15.101 INFO:tasks.rados.rados.0.smithi142.stdout:266: left oid 42 (ObjNum 123 snap 27 seq_num 123) 2020-06-12T02:36:15.101 INFO:tasks.rados.rados.0.smithi142.stdout:276: expect (ObjNum 108 snap 23 seq_num 108) 2020-06-12T02:36:15.131 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:15.125+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:15.226 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:15.222+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:15.244 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:15.245 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:15.245 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:15.254 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:15.327 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:15.322+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:15.345 INFO:tasks.rados.rados.0.smithi142.stdout:277: finishing write tid 1 to smithi14213939-23 2020-06-12T02:36:15.346 INFO:tasks.rados.rados.0.smithi142.stdout:266: done (7 left) 2020-06-12T02:36:15.346 INFO:tasks.rados.rados.0.smithi142.stdout:270: done (6 left) 2020-06-12T02:36:15.346 INFO:tasks.rados.rados.0.smithi142.stdout:274: done (5 left) 2020-06-12T02:36:15.347 INFO:tasks.rados.rados.0.smithi142.stdout:276: done (4 left) 2020-06-12T02:36:15.347 INFO:tasks.rados.rados.0.smithi142.stdout:280: write oid 13 current snap is 27 2020-06-12T02:36:15.347 INFO:tasks.rados.rados.0.smithi142.stdout:280: seq_num 129 ranges {568103=768769,2082530=85573} 2020-06-12T02:36:15.362 INFO:tasks.rados.rados.0.smithi142.stdout:280: writing smithi14213939-13 from 568103 to 1336872 tid 1 2020-06-12T02:36:15.367 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.227557806999997, 2020-06-12T02:36:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.216666426000003, 2020-06-12T02:36:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.215534382000001, 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.215279197000001, 2020-06-12T02:36:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.21512001, 2020-06-12T02:36:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.070797431999999, 2020-06-12T02:36:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:603 1.bs0 1:d6659338:::smithi14213939-43:head [write 430279~695389,stat] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.339896976, 2020-06-12T02:36:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882, 2020-06-12T02:36:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 603 2020-06-12T02:36:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014668649999999999 2020-06-12T02:36:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021925+0000", 2020-06-12T02:36:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9837e-05 2020-06-12T02:36:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021944+0000", 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4341e-05 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021969+0000", 2020-06-12T02:36:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4333e-05 2020-06-12T02:36:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021983+0000", 2020-06-12T02:36:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3517999999999995e-05 2020-06-12T02:36:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022077+0000", 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000168954 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022246+0000", 2020-06-12T02:36:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035737379999999999 2020-06-12T02:36:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.025819+0000", 2020-06-12T02:36:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060458619999999999 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031865+0000", 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158689 2020-06-12T02:36:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.032024+0000", 2020-06-12T02:36:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098174500000000001 2020-06-12T02:36:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033006+0000", 2020-06-12T02:36:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882 2020-06-12T02:36:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.329727934999999, 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.392025534, 2020-06-12T02:36:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.4101494540000008, 2020-06-12T02:36:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.4099561380000001, 2020-06-12T02:36:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.4098076830000004, 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.4023747330000003, 2020-06-12T02:36:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=224, reqid=osd.0.0:224, at_version=59'129, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.4009715529999998, 2020-06-12T02:36:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012302795, 2020-06-12T02:36:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959383+0000", 2020-06-12T02:36:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1150999999999998e-05 2020-06-12T02:36:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959444+0000", 2020-06-12T02:36:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0902000000000002e-05 2020-06-12T02:36:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959485+0000", 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7144999999999999e-05 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959502+0000", 2020-06-12T02:36:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9340000000000006e-06 2020-06-12T02:36:15.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959510+0000", 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014002599999999999 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959650+0000", 2020-06-12T02:36:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2369e-05 2020-06-12T02:36:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959663+0000", 2020-06-12T02:36:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011972244 2020-06-12T02:36:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971635+0000", 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1023999999999998e-05 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.971686+0000", 2020-06-12T02:36:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012302795 2020-06-12T02:36:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.3999662330000007, 2020-06-12T02:36:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.3979390879999993, 2020-06-12T02:36:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=168, attrs_read=0))", 2020-06-12T02:36:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.3960206129999992, 2020-06-12T02:36:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001, 2020-06-12T02:36:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001626127 2020-06-12T02:36:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965960+0000", 2020-06-12T02:36:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3662999999999999e-05 2020-06-12T02:36:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965974+0000", 2020-06-12T02:36:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4405e-05 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965988+0000", 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5080000000000002e-06 2020-06-12T02:36:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965995+0000", 2020-06-12T02:36:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0077934429999999997 2020-06-12T02:36:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973788+0000", 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002853216 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976641+0000", 2020-06-12T02:36:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001 2020-06-12T02:36:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.3868892549999998, 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.382676238, 2020-06-12T02:36:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.38249303899999998, 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:15.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:15.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:15.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:15.664 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:15.668 INFO:tasks.rados.rados.0.smithi142.stdout:280: writing smithi14213939-13 from 2082530 to 2168103 tid 2 2020-06-12T02:36:15.668 INFO:tasks.rados.rados.0.smithi142.stdout:281: read oid 48 snap -1 2020-06-12T02:36:15.669 INFO:tasks.rados.rados.0.smithi142.stdout:281: expect (ObjNum 116 snap 25 seq_num 116) 2020-06-12T02:36:15.669 INFO:tasks.rados.rados.0.smithi142.stdout:282: write oid 7 current snap is 27 2020-06-12T02:36:15.669 INFO:tasks.rados.rados.0.smithi142.stdout:282: seq_num 130 ranges {584910=560371,1857365=327545} 2020-06-12T02:36:15.669 INFO:tasks.rados.rados.0.smithi142.stdout:282: writing smithi14213939-7 from 584910 to 1145281 tid 1 2020-06-12T02:36:15.669 INFO:tasks.rados.rados.0.smithi142.stdout:282: writing smithi14213939-7 from 1857365 to 2184910 tid 2 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:283: copy_from oid 41 from oid 43 current snap is 27 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:269: finishing copy_from to smithi14213939-25 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 25 v 14 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:284: read oid 8 snap -1 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:284: expect (ObjNum 91 snap 14 seq_num 91) 2020-06-12T02:36:15.670 INFO:tasks.rados.rados.0.smithi142.stdout:285: rollback oid 34 current snap is 27 2020-06-12T02:36:15.671 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 34 to 12 2020-06-12T02:36:15.671 INFO:tasks.rados.rados.0.smithi142.stdout:269: finishing copy_from racing read to smithi14213939-25 2020-06-12T02:36:15.671 INFO:tasks.rados.rados.0.smithi142.stdout:278: finishing write tid 1 to smithi14213939-1 2020-06-12T02:36:15.671 INFO:tasks.rados.rados.0.smithi142.stdout:279: finishing rollback tid 0 to smithi14213939-30 2020-06-12T02:36:15.671 INFO:tasks.rados.rados.0.smithi142.stdout:278: finishing write tid 2 to smithi14213939-1 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:279: finishing rollback tid 1 to smithi14213939-30 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:278: finishing write tid 4 to smithi14213939-1 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:279: finishing rollback tid 2 to smithi14213939-30 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 117 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:277: finishing write tid 2 to smithi14213939-23 2020-06-12T02:36:15.672 INFO:tasks.rados.rados.0.smithi142.stdout:277: finishing write tid 4 to smithi14213939-23 2020-06-12T02:36:15.673 INFO:tasks.rados.rados.0.smithi142.stdout:269: done (9 left) 2020-06-12T02:36:15.673 INFO:tasks.rados.rados.0.smithi142.stdout:279: done (8 left) 2020-06-12T02:36:15.673 INFO:tasks.rados.rados.0.smithi142.stdout:286: read oid 35 snap -1 2020-06-12T02:36:15.673 INFO:tasks.rados.rados.0.smithi142.stdout:286: expect (ObjNum 75 snap 10 seq_num 75) 2020-06-12T02:36:15.673 INFO:tasks.rados.rados.0.smithi142.stdout:278: finishing write tid 5 to smithi14213939-1 2020-06-12T02:36:15.674 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 1 v 27 (ObjNum 128 snap 27 seq_num 128) dirty exists 2020-06-12T02:36:15.674 INFO:tasks.rados.rados.0.smithi142.stdout:278: left oid 1 (ObjNum 128 snap 27 seq_num 128) 2020-06-12T02:36:15.674 INFO:tasks.rados.rados.0.smithi142.stdout:277: finishing write tid 5 to smithi14213939-23 2020-06-12T02:36:15.674 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 23 v 59 (ObjNum 127 snap 27 seq_num 127) dirty exists 2020-06-12T02:36:15.674 INFO:tasks.rados.rados.0.smithi142.stdout:277: left oid 23 (ObjNum 127 snap 27 seq_num 127) 2020-06-12T02:36:15.675 INFO:tasks.rados.rados.0.smithi142.stdout:280: finishing write tid 1 to smithi14213939-13 2020-06-12T02:36:15.675 INFO:tasks.rados.rados.0.smithi142.stdout:287: read oid 5 snap -1 2020-06-12T02:36:15.675 INFO:tasks.rados.rados.0.smithi142.stdout:287: expect (ObjNum 88 snap 13 seq_num 88) 2020-06-12T02:36:15.675 INFO:tasks.rados.rados.0.smithi142.stdout:277: done (9 left) 2020-06-12T02:36:15.675 INFO:tasks.rados.rados.0.smithi142.stdout:278: done (8 left) 2020-06-12T02:36:15.676 INFO:tasks.rados.rados.0.smithi142.stdout:288: read oid 12 snap -1 2020-06-12T02:36:15.676 INFO:tasks.rados.rados.0.smithi142.stdout:288: expect deleted 2020-06-12T02:36:15.676 INFO:tasks.rados.rados.0.smithi142.stdout:289: read oid 1 snap -1 2020-06-12T02:36:15.676 INFO:tasks.rados.rados.0.smithi142.stdout:289: expect (ObjNum 128 snap 27 seq_num 128) 2020-06-12T02:36:15.676 INFO:tasks.rados.rados.0.smithi142.stdout:290: read oid 19 snap -1 2020-06-12T02:36:15.677 INFO:tasks.rados.rados.0.smithi142.stdout:290: expect (ObjNum 82 snap 12 seq_num 82) 2020-06-12T02:36:15.677 INFO:tasks.rados.rados.0.smithi142.stdout:291: write (excl) oid 17 current snap is 27 2020-06-12T02:36:15.677 INFO:tasks.rados.rados.0.smithi142.stdout:291: seq_num 131 ranges {601717=635620,1799494=402223} 2020-06-12T02:36:15.677 INFO:tasks.rados.rados.0.smithi142.stdout:291: writing smithi14213939-17 from 601717 to 1237337 tid 1 2020-06-12T02:36:15.677 INFO:tasks.rados.rados.0.smithi142.stdout:291: writing smithi14213939-17 from 1799494 to 2201717 tid 2 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:292: read oid 29 snap -1 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:292: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:293: copy_from oid 47 from oid 26 current snap is 27 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:294: delete oid 30 current snap is 27 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:282: finishing write tid 1 to smithi14213939-7 2020-06-12T02:36:15.678 INFO:tasks.rados.rados.0.smithi142.stdout:282: finishing write tid 2 to smithi14213939-7 2020-06-12T02:36:15.679 INFO:tasks.rados.rados.0.smithi142.stdout:281: expect (ObjNum 116 snap 25 seq_num 116) 2020-06-12T02:36:15.679 INFO:tasks.rados.rados.0.smithi142.stdout:282: finishing write tid 4 to smithi14213939-7 2020-06-12T02:36:15.679 INFO:tasks.rados.rados.0.smithi142.stdout:280: finishing write tid 2 to smithi14213939-13 2020-06-12T02:36:15.679 INFO:tasks.rados.rados.0.smithi142.stdout:280: finishing write tid 4 to smithi14213939-13 2020-06-12T02:36:15.679 INFO:tasks.rados.rados.0.smithi142.stdout:290: expect (ObjNum 82 snap 12 seq_num 82) 2020-06-12T02:36:15.680 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:15.662+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:15.680 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:15.736 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:15.767 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:15.761+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:15.801 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:15.802 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:15.810 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:15.829 INFO:tasks.rados.rados.0.smithi142.stdout:280: finishing write tid 5 to smithi14213939-13 2020-06-12T02:36:15.830 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 45 (ObjNum 129 snap 27 seq_num 129) dirty exists 2020-06-12T02:36:15.830 INFO:tasks.rados.rados.0.smithi142.stdout:280: left oid 13 (ObjNum 129 snap 27 seq_num 129) 2020-06-12T02:36:15.831 INFO:tasks.rados.rados.0.smithi142.stdout:282: finishing write tid 5 to smithi14213939-7 2020-06-12T02:36:15.831 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 65 (ObjNum 130 snap 27 seq_num 130) dirty exists 2020-06-12T02:36:15.831 INFO:tasks.rados.rados.0.smithi142.stdout:282: left oid 7 (ObjNum 130 snap 27 seq_num 130) 2020-06-12T02:36:15.832 INFO:tasks.rados.rados.0.smithi142.stdout:291: finishing write tid 1 to smithi14213939-17 2020-06-12T02:36:15.832 INFO:tasks.rados.rados.0.smithi142.stdout:280: done (14 left) 2020-06-12T02:36:15.832 INFO:tasks.rados.rados.0.smithi142.stdout:281: done (13 left) 2020-06-12T02:36:15.833 INFO:tasks.rados.rados.0.smithi142.stdout:282: done (12 left) 2020-06-12T02:36:15.833 INFO:tasks.rados.rados.0.smithi142.stdout:288: done (11 left) 2020-06-12T02:36:15.833 INFO:tasks.rados.rados.0.smithi142.stdout:290: done (10 left) 2020-06-12T02:36:15.834 INFO:tasks.rados.rados.0.smithi142.stdout:294: done (9 left) 2020-06-12T02:36:15.835 INFO:tasks.rados.rados.0.smithi142.stdout:295: copy_from oid 49 from oid 15 current snap is 27 2020-06-12T02:36:15.835 INFO:tasks.rados.rados.0.smithi142.stdout:284: expect (ObjNum 91 snap 14 seq_num 91) 2020-06-12T02:36:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:15.834+0000 7f361ed83700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:15.844 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:15.838+0000 7f361db21700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:15.874 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:15.865+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:15.875 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:15.893 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:15.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:15.944 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:15.964 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:15.978 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:15.974+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:15.979 INFO:tasks.rados.rados.0.smithi142.stdout:285: finishing rollback tid 0 to smithi14213939-34 2020-06-12T02:36:15.980 INFO:tasks.rados.rados.0.smithi142.stdout:285: finishing rollback tid 1 to smithi14213939-34 2020-06-12T02:36:15.980 INFO:tasks.rados.rados.0.smithi142.stdout:285: finishing rollback tid 2 to smithi14213939-34 2020-06-12T02:36:15.980 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 34 v 153 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-06-12T02:36:15.980 INFO:tasks.rados.rados.0.smithi142.stdout:287: expect (ObjNum 88 snap 13 seq_num 88) 2020-06-12T02:36:15.982 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:15.982 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:15.982 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:15.982 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:15.983 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:15.990 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:15.991 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:16.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:16.054 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.074 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.075 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:16.076 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.6 to 1 (10000) 2020-06-12T02:36:16.086 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:16.073+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:16.087 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 7 1 2020-06-12T02:36:16.090 INFO:tasks.rados.rados.0.smithi142.stdout:286: expect (ObjNum 75 snap 10 seq_num 75) 2020-06-12T02:36:16.121 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.122 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.131 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:16.183 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:16.177+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:16.187 INFO:tasks.rados.rados.0.smithi142.stdout:289: expect (ObjNum 128 snap 27 seq_num 128) 2020-06-12T02:36:16.258 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:16.238+0000 7f6773dfe700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:16.259 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:16.250+0000 7f6773dfe700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:16.259 INFO:tasks.rados.rados.0.smithi142.stdout:292: expect (ObjNum 28 snap 0 seq_num 28) 2020-06-12T02:36:16.280 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:16.273+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:16.297 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.298 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.306 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:16.330 INFO:tasks.rados.rados.0.smithi142.stdout:283: finishing copy_from to smithi14213939-41 2020-06-12T02:36:16.330 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 41 v 42 (ObjNum 97 snap 19 seq_num 97) dirty exists 2020-06-12T02:36:16.330 INFO:tasks.rados.rados.0.smithi142.stdout:283: finishing copy_from racing read to smithi14213939-41 2020-06-12T02:36:16.331 INFO:tasks.rados.rados.0.smithi142.stdout:291: finishing write tid 2 to smithi14213939-17 2020-06-12T02:36:16.331 INFO:tasks.rados.rados.0.smithi142.stdout:291: finishing write tid 4 to smithi14213939-17 2020-06-12T02:36:16.331 INFO:tasks.rados.rados.0.smithi142.stdout:291: finishing write tid 5 to smithi14213939-17 2020-06-12T02:36:16.331 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 17 v 123 (ObjNum 131 snap 27 seq_num 131) dirty exists 2020-06-12T02:36:16.331 INFO:tasks.rados.rados.0.smithi142.stdout:291: left oid 17 (ObjNum 131 snap 27 seq_num 131) 2020-06-12T02:36:16.332 INFO:tasks.rados.rados.0.smithi142.stdout:293: finishing copy_from to smithi14213939-47 2020-06-12T02:36:16.332 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 47 v 18 (ObjNum 107 snap 23 seq_num 107) dirty exists 2020-06-12T02:36:16.332 INFO:tasks.rados.rados.0.smithi142.stdout:293: finishing copy_from racing read to smithi14213939-47 2020-06-12T02:36:16.332 INFO:tasks.rados.rados.0.smithi142.stdout:295: finishing copy_from to smithi14213939-49 2020-06-12T02:36:16.332 INFO:tasks.rados.rados.0.smithi142.stdout:295: got expected ENOENT (src dne) 2020-06-12T02:36:16.333 INFO:tasks.rados.rados.0.smithi142.stdout:295: finishing copy_from racing read to smithi14213939-49 2020-06-12T02:36:16.333 INFO:tasks.rados.rados.0.smithi142.stdout:283: done (9 left) 2020-06-12T02:36:16.333 INFO:tasks.rados.rados.0.smithi142.stdout:284: done (8 left) 2020-06-12T02:36:16.334 INFO:tasks.rados.rados.0.smithi142.stdout:285: done (7 left) 2020-06-12T02:36:16.334 INFO:tasks.rados.rados.0.smithi142.stdout:286: done (6 left) 2020-06-12T02:36:16.334 INFO:tasks.rados.rados.0.smithi142.stdout:287: done (5 left) 2020-06-12T02:36:16.334 INFO:tasks.rados.rados.0.smithi142.stdout:289: done (4 left) 2020-06-12T02:36:16.334 INFO:tasks.rados.rados.0.smithi142.stdout:291: done (3 left) 2020-06-12T02:36:16.335 INFO:tasks.rados.rados.0.smithi142.stdout:292: done (2 left) 2020-06-12T02:36:16.335 INFO:tasks.rados.rados.0.smithi142.stdout:293: done (1 left) 2020-06-12T02:36:16.335 INFO:tasks.rados.rados.0.smithi142.stdout:295: done (0 left) 2020-06-12T02:36:16.335 INFO:tasks.rados.rados.0.smithi142.stdout:296: rollback oid 6 current snap is 27 2020-06-12T02:36:16.335 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 6 to 19 2020-06-12T02:36:16.336 INFO:tasks.rados.rados.0.smithi142.stdout:297: delete oid 50 current snap is 27 2020-06-12T02:36:16.336 INFO:tasks.rados.rados.0.smithi142.stdout:297: done (1 left) 2020-06-12T02:36:16.336 INFO:tasks.rados.rados.0.smithi142.stdout:298: write oid 14 current snap is 27 2020-06-12T02:36:16.337 INFO:tasks.rados.rados.0.smithi142.stdout:298: seq_num 134 ranges {652138=461367,1574940=677198} 2020-06-12T02:36:16.346 INFO:tasks.rados.rados.0.smithi142.stdout:298: writing smithi14213939-14 from 652138 to 1113505 tid 1 2020-06-12T02:36:16.355 INFO:tasks.rados.rados.0.smithi142.stdout:298: writing smithi14213939-14 from 1574940 to 2252138 tid 2 2020-06-12T02:36:16.355 INFO:tasks.rados.rados.0.smithi142.stdout:299: delete oid 43 current snap is 27 2020-06-12T02:36:16.355 INFO:tasks.rados.rados.0.smithi142.stdout:296: finishing rollback tid 0 to smithi14213939-6 2020-06-12T02:36:16.355 INFO:tasks.rados.rados.0.smithi142.stdout:296: finishing rollback tid 1 to smithi14213939-6 2020-06-12T02:36:16.356 INFO:tasks.rados.rados.0.smithi142.stdout:296: finishing rollback tid 2 to smithi14213939-6 2020-06-12T02:36:16.356 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 126 (ObjNum 69 snap 9 seq_num 69) dirty exists 2020-06-12T02:36:16.364 INFO:tasks.rados.rados.0.smithi142.stdout:296: done (2 left) 2020-06-12T02:36:16.365 INFO:tasks.rados.rados.0.smithi142.stdout:299: done (1 left) 2020-06-12T02:36:16.365 INFO:tasks.rados.rados.0.smithi142.stdout:300: snap_remove snap 21 2020-06-12T02:36:16.380 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:16.374+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:16.460 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.460 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.466 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:16.511 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:16.505+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:16.574 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.575 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.581 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:16.573+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:16.584 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:16.683 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:16.678+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:16.739 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.740 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.742 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:16.783 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:16.778+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:16.854 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.854 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.865 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:16.884 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:16.878+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:16.963 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:36:16.973 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:16.973 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:16.982 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:17.009 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:17.006+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:17.083 INFO:tasks.rados.rados.0.smithi142.stdout:300: done (1 left) 2020-06-12T02:36:17.084 INFO:tasks.rados.rados.0.smithi142.stdout:301: copy_from oid 43 from oid 2 current snap is 27 2020-06-12T02:36:17.084 INFO:tasks.rados.rados.0.smithi142.stdout:302: snap_create 2020-06-12T02:36:17.084 INFO:tasks.rados.rados.0.smithi142.stdout:298: finishing write tid 1 to smithi14213939-14 2020-06-12T02:36:17.084 INFO:tasks.rados.rados.0.smithi142.stdout:298: finishing write tid 2 to smithi14213939-14 2020-06-12T02:36:17.085 INFO:tasks.rados.rados.0.smithi142.stdout:298: finishing write tid 4 to smithi14213939-14 2020-06-12T02:36:17.085 INFO:tasks.rados.rados.0.smithi142.stdout:298: finishing write tid 5 to smithi14213939-14 2020-06-12T02:36:17.085 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 14 v 129 (ObjNum 134 snap 27 seq_num 134) dirty exists 2020-06-12T02:36:17.085 INFO:tasks.rados.rados.0.smithi142.stdout:298: left oid 14 (ObjNum 134 snap 27 seq_num 134) 2020-06-12T02:36:17.088 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.074+0000 7fa159681700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.092 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:17.081+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:reweighted osd.7 to 1 (10000) 2020-06-12T02:36:17.106 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.102+0000 7fa153fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.107 INFO:tasks.rados.rados.0.smithi142.stdout:301: finishing copy_from to smithi14213939-43 2020-06-12T02:36:17.107 INFO:tasks.rados.rados.0.smithi142.stdout:301: got expected ENOENT (src dne) 2020-06-12T02:36:17.108 INFO:tasks.rados.rados.0.smithi142.stdout:301: finishing copy_from racing read to smithi14213939-43 2020-06-12T02:36:17.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2020-06-12T02:36:17.111 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:17.153 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.154 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.166 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:17.192 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:17.189+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:17.217 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.206+0000 7fd2a0e8b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.226 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.218+0000 7fd29b59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.306 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:17.293+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:17.310 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.310 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.319 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:17.380 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:17.382 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:17.398 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2020-06-12T02:36:17.078502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181728841,"num_objects":87,"num_object_clones":42,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":7,"num_read":373,"num_read_kb":320764,"num_write":531,"num_write_kb":177119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7615940,"kb_used_data":275852,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652986940,"statfs":{"total":676457349120,"available":668658626560,"internally_reserved":7516192768,"allocated":282472448,"data_stored":373565022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5685392,"num_objects":7,"num_object_clones":7,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":7,"num_read_kb":4,"num_write":28,"num_write_kb":5543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044502"},"pg_stats":[{"pgid":"1.f","version":"65'28","reported_seq":"180","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941097+0000","last_change":"2020-06-12T02:36:14.072171+0000","last_active":"2020-06-12T02:36:14.941097+0000","last_peered":"2020-06-12T02:36:14.941097+0000","last_clean":"2020-06-12T02:36:14.941097+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:14.941097+0000","last_undegraded":"2020-06-12T02:36:14.941097+0000","last_fullsized":"2020-06-12T02:36:14.941097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9671511,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7836,"num_write":18,"num_write_kb":5721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.e","version":"65'66","reported_seq":"89","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:11.966344+0000","last_change":"2020-06-12T02:36:11.967250+0000","last_active":"2020-06-12T02:36:11.966344+0000","last_peered":"2020-06-12T02:36:11.966344+0000","last_clean":"2020-06-12T02:36:11.966344+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:11.966344+0000","last_undegraded":"2020-06-12T02:36:11.966344+0000","last_fullsized":"2020-06-12T02:36:11.966344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10140035,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30097,"num_write":35,"num_write_kb":10064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.d","version":"65'119","reported_seq":"322","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939127+0000","last_change":"2020-06-12T02:36:14.058408+0000","last_active":"2020-06-12T02:36:14.939127+0000","last_peered":"2020-06-12T02:36:14.939127+0000","last_clean":"2020-06-12T02:36:14.939127+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:14.939127+0000","last_undegraded":"2020-06-12T02:36:14.939127+0000","last_fullsized":"2020-06-12T02:36:14.939127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24521149,"num_objects":9,"num_object_clones":3,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":51090,"num_write":55,"num_write_kb":29045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.c","version":"64'24","reported_seq":"166","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.075968+0000","last_change":"2020-06-12T02:36:14.077075+0000","last_active":"2020-06-12T02:36:14.075968+0000","last_peered":"2020-06-12T02:36:14.075968+0000","last_clean":"2020-06-12T02:36:14.075968+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:14.075968+0000","last_undegraded":"2020-06-12T02:36:14.075968+0000","last_fullsized":"2020-06-12T02:36:14.075968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.b","version":"65'48","reported_seq":"195","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:11.979995+0000","last_change":"2020-06-12T02:36:11.983844+0000","last_active":"2020-06-12T02:36:11.979995+0000","last_peered":"2020-06-12T02:36:11.979995+0000","last_clean":"2020-06-12T02:36:11.979995+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:11.979995+0000","last_undegraded":"2020-06-12T02:36:11.979995+0000","last_fullsized":"2020-06-12T02:36:11.979995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7853990,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":25866,"num_write":30,"num_write_kb":7797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"66","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188105+0000","last_change":"2020-06-12T02:36:14.188592+0000","last_active":"2020-06-12T02:36:14.188105+0000","last_peered":"2020-06-12T02:36:14.188105+0000","last_clean":"2020-06-12T02:36:14.188105+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:14.188105+0000","last_undegraded":"2020-06-12T02:36:14.188105+0000","last_fullsized":"2020-06-12T02:36:14.188105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.9","version":"59'57","reported_seq":"85","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939897+0000","last_change":"2020-06-12T02:36:14.072032+0000","last_active":"2020-06-12T02:36:14.939897+0000","last_peered":"2020-06-12T02:36:14.939897+0000","last_clean":"2020-06-12T02:36:14.939897+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:14.939897+0000","last_undegraded":"2020-06-12T02:36:14.939897+0000","last_fullsized":"2020-06-12T02:36:14.939897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":57,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5344560,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":25,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.8","version":"65'42","reported_seq":"92","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939731+0000","last_change":"2020-06-12T02:36:14.058207+0000","last_active":"2020-06-12T02:36:14.939731+0000","last_peered":"2020-06-12T02:36:14.939731+0000","last_clean":"2020-06-12T02:36:14.939731+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:14.939731+0000","last_undegraded":"2020-06-12T02:36:14.939731+0000","last_fullsized":"2020-06-12T02:36:14.939731+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10947823,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8034,"num_write":21,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.7","version":"65'122","reported_seq":"273","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188896+0000","last_change":"2020-06-12T02:36:14.189462+0000","last_active":"2020-06-12T02:36:14.188896+0000","last_peered":"2020-06-12T02:36:14.188896+0000","last_clean":"2020-06-12T02:36:14.188896+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:14.188896+0000","last_undegraded":"2020-06-12T02:36:14.188896+0000","last_fullsized":"2020-06-12T02:36:14.188896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":122,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17376628,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":41,"num_read_kb":32175,"num_write":58,"num_write_kb":20810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.6","version":"67'41","reported_seq":"188","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941582+0000","last_change":"2020-06-12T02:36:14.073415+0000","last_active":"2020-06-12T02:36:14.941582+0000","last_peered":"2020-06-12T02:36:14.941582+0000","last_clean":"2020-06-12T02:36:14.941582+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:14.941582+0000","last_undegraded":"2020-06-12T02:36:14.941582+0000","last_fullsized":"2020-06-12T02:36:14.941582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8337388,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7245,"num_write":22,"num_write_kb":7089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.1","version":"65'29","reported_seq":"184","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941198+0000","last_change":"2020-06-12T02:36:14.073519+0000","last_active":"2020-06-12T02:36:14.941198+0000","last_peered":"2020-06-12T02:36:14.941198+0000","last_clean":"2020-06-12T02:36:14.941198+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:14.941198+0000","last_undegraded":"2020-06-12T02:36:14.941198+0000","last_fullsized":"2020-06-12T02:36:14.941198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6666785,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":23943,"num_write":15,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"76","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081789+0000","last_change":"2020-06-12T02:36:14.082220+0000","last_active":"2020-06-12T02:36:14.081789+0000","last_peered":"2020-06-12T02:36:14.081789+0000","last_clean":"2020-06-12T02:36:14.081789+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:14.081789+0000","last_undegraded":"2020-06-12T02:36:14.081789+0000","last_fullsized":"2020-06-12T02:36:14.081789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.2","version":"65'147","reported_seq":"334","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188224+0000","last_change":"2020-06-12T02:36:14.188936+0000","last_active":"2020-06-12T02:36:14.188224+0000","last_peered":"2020-06-12T02:36:14.188224+0000","last_clean":"2020-06-12T02:36:14.188224+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:14.188224+0000","last_undegraded":"2020-06-12T02:36:14.188224+0000","last_fullsized":"2020-06-12T02:36:14.188224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":147,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15522851,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":24,"num_read_kb":6220,"num_write":71,"num_write_kb":20169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.3","version":"65'78","reported_seq":"259","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:12.009710+0000","last_change":"2020-06-12T02:36:12.001327+0000","last_active":"2020-06-12T02:36:12.009710+0000","last_peered":"2020-06-12T02:36:12.009710+0000","last_clean":"2020-06-12T02:36:12.009710+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:12.009710+0000","last_undegraded":"2020-06-12T02:36:12.009710+0000","last_fullsized":"2020-06-12T02:36:12.009710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":78,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19602919,"num_objects":12,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":45,"num_read_kb":49664,"num_write":44,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.4","version":"65'113","reported_seq":"266","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081568+0000","last_change":"2020-06-12T02:36:14.081989+0000","last_active":"2020-06-12T02:36:14.081568+0000","last_peered":"2020-06-12T02:36:14.081568+0000","last_clean":"2020-06-12T02:36:14.081568+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:14.081568+0000","last_undegraded":"2020-06-12T02:36:14.081568+0000","last_fullsized":"2020-06-12T02:36:14.081568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19688150,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":43,"num_read_kb":44147,"num_write":58,"num_write_kb":12625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.5","version":"65'119","reported_seq":"273","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939918+0000","last_change":"2020-06-12T02:36:14.058724+0000","last_active":"2020-06-12T02:36:14.939918+0000","last_peered":"2020-06-12T02:36:14.939918+0000","last_clean":"2020-06-12T02:36:14.939918+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:14.939918+0000","last_undegraded":"2020-06-12T02:36:14.939918+0000","last_fullsized":"2020-06-12T02:36:14.939918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23668491,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":27446,"num_write":67,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":181728841,"num_objects":87,"num_object_clones":42,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":7,"num_read":373,"num_read_kb":320764,"num_write":531,"num_write_kb":177119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325365760,"data_stored":426405888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084152,"kb_used_data":35568,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93287688,"statfs":{"total":96636764160,"available":95526592512,"internally_reserved":1073741824,"allocated":36421632,"data_stored":46510452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.3170000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":2.2349999999999999},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.8400000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.7689999999999999},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.141}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":2.6120000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.8929999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.794},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.0179999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.1179999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.347},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.464}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1086596,"kb_used_data":38012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93285244,"statfs":{"total":96636764160,"available":95524089856,"internally_reserved":1073741824,"allocated":38924288,"data_stored":53371252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.2869999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.7430000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5529999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.621}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.992},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4169999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.7170000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":3.286}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.5419999999999998},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1899999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.8730000000000002},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.0409999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.3660000000000001},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.5270000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104420,"kb_used_data":55836,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267420,"statfs":{"total":96636764160,"available":95505838080,"internally_reserved":1073741824,"allocated":57176064,"data_stored":77583152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.1400000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.6539999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.0590000000000002},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.3300000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.7410000000000001}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":2.2360000000000002},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":3.0489999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.6400000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.915}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.4260000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.573}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":3.4420000000000002},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.7029999999999998}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1065536,"kb_used_data":16952,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306304,"statfs":{"total":96636764160,"available":95545655296,"internally_reserved":1073741824,"allocated":17358848,"data_stored":20505392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.7669999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":3.585}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.8680000000000001},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4369999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":2.552},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.8420000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":3.3399999999999999},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":3.1930000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.226},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.1389999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.9700000000000002},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.9060000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088656,"kb_used_data":40072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283184,"statfs":{"total":96636764160,"available":95521980416,"internally_reserved":1073741824,"allocated":41033728,"data_stored":57031214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.4279999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":3.702}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.885},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":2.4590000000000001}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":3.0059999999999998},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.5750000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.6269999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.6890000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":3.7850000000000001},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":3.8540000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":4.4800000000000004}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":4.1479999999999997},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.839}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1101412,"kb_used_data":52828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93270428,"statfs":{"total":96636764160,"available":95508918272,"internally_reserved":1073741824,"allocated":54095872,"data_stored":68436340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.373},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.3120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.0459999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":1.4670000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":2.3050000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.7930000000000001},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.6640000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":1.891},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":3.222}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.4420000000000002},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":2.5009999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":2.8839999999999999},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":2.9540000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085168,"kb_used_data":36584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93286672,"statfs":{"total":96636764160,"available":95525552128,"internally_reserved":1073741824,"allocated":37462016,"data_stored":50127220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.74}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.9670000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.254}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":3.577},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":3.294}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":3.1419999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.827},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.0979999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.371},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.6739999999999999}]}]}]}} 2020-06-12T02:36:17.401 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:17.405 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:17.397+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:17.468 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.468 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.479 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:17.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:17.501+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:17.560 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.550+0000 7f350a7ba700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.568 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.558+0000 7f3509558700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.608 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:17.602+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:17.625 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.625 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.641 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:17.702 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:17.709 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:17.701+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:17.720 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2020-06-12T02:36:17.078502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181728841,"num_objects":87,"num_object_clones":42,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":7,"num_read":373,"num_read_kb":320764,"num_write":531,"num_write_kb":177119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7615940,"kb_used_data":275852,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652986940,"statfs":{"total":676457349120,"available":668658626560,"internally_reserved":7516192768,"allocated":282472448,"data_stored":373565022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5685392,"num_objects":7,"num_object_clones":7,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":7,"num_read_kb":4,"num_write":28,"num_write_kb":5543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044502"},"pg_stats":[{"pgid":"1.f","version":"65'28","reported_seq":"180","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941097+0000","last_change":"2020-06-12T02:36:14.072171+0000","last_active":"2020-06-12T02:36:14.941097+0000","last_peered":"2020-06-12T02:36:14.941097+0000","last_clean":"2020-06-12T02:36:14.941097+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:14.941097+0000","last_undegraded":"2020-06-12T02:36:14.941097+0000","last_fullsized":"2020-06-12T02:36:14.941097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9671511,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7836,"num_write":18,"num_write_kb":5721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.e","version":"65'66","reported_seq":"89","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:11.966344+0000","last_change":"2020-06-12T02:36:11.967250+0000","last_active":"2020-06-12T02:36:11.966344+0000","last_peered":"2020-06-12T02:36:11.966344+0000","last_clean":"2020-06-12T02:36:11.966344+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:11.966344+0000","last_undegraded":"2020-06-12T02:36:11.966344+0000","last_fullsized":"2020-06-12T02:36:11.966344+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":66,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10140035,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30097,"num_write":35,"num_write_kb":10064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.d","version":"65'119","reported_seq":"322","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939127+0000","last_change":"2020-06-12T02:36:14.058408+0000","last_active":"2020-06-12T02:36:14.939127+0000","last_peered":"2020-06-12T02:36:14.939127+0000","last_clean":"2020-06-12T02:36:14.939127+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:14.939127+0000","last_undegraded":"2020-06-12T02:36:14.939127+0000","last_fullsized":"2020-06-12T02:36:14.939127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24521149,"num_objects":9,"num_object_clones":3,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":51090,"num_write":55,"num_write_kb":29045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.c","version":"64'24","reported_seq":"166","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.075968+0000","last_change":"2020-06-12T02:36:14.077075+0000","last_active":"2020-06-12T02:36:14.075968+0000","last_peered":"2020-06-12T02:36:14.075968+0000","last_clean":"2020-06-12T02:36:14.075968+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:14.075968+0000","last_undegraded":"2020-06-12T02:36:14.075968+0000","last_fullsized":"2020-06-12T02:36:14.075968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.b","version":"65'48","reported_seq":"195","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:11.979995+0000","last_change":"2020-06-12T02:36:11.983844+0000","last_active":"2020-06-12T02:36:11.979995+0000","last_peered":"2020-06-12T02:36:11.979995+0000","last_clean":"2020-06-12T02:36:11.979995+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:11.979995+0000","last_undegraded":"2020-06-12T02:36:11.979995+0000","last_fullsized":"2020-06-12T02:36:11.979995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7853990,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":25866,"num_write":30,"num_write_kb":7797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"66","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188105+0000","last_change":"2020-06-12T02:36:14.188592+0000","last_active":"2020-06-12T02:36:14.188105+0000","last_peered":"2020-06-12T02:36:14.188105+0000","last_clean":"2020-06-12T02:36:14.188105+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:14.188105+0000","last_undegraded":"2020-06-12T02:36:14.188105+0000","last_fullsized":"2020-06-12T02:36:14.188105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.9","version":"59'57","reported_seq":"85","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939897+0000","last_change":"2020-06-12T02:36:14.072032+0000","last_active":"2020-06-12T02:36:14.939897+0000","last_peered":"2020-06-12T02:36:14.939897+0000","last_clean":"2020-06-12T02:36:14.939897+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:14.939897+0000","last_undegraded":"2020-06-12T02:36:14.939897+0000","last_fullsized":"2020-06-12T02:36:14.939897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":57,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5344560,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":25,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.8","version":"65'42","reported_seq":"92","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939731+0000","last_change":"2020-06-12T02:36:14.058207+0000","last_active":"2020-06-12T02:36:14.939731+0000","last_peered":"2020-06-12T02:36:14.939731+0000","last_clean":"2020-06-12T02:36:14.939731+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:14.939731+0000","last_undegraded":"2020-06-12T02:36:14.939731+0000","last_fullsized":"2020-06-12T02:36:14.939731+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10947823,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8034,"num_write":21,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.7","version":"65'122","reported_seq":"273","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188896+0000","last_change":"2020-06-12T02:36:14.189462+0000","last_active":"2020-06-12T02:36:14.188896+0000","last_peered":"2020-06-12T02:36:14.188896+0000","last_clean":"2020-06-12T02:36:14.188896+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:14.188896+0000","last_undegraded":"2020-06-12T02:36:14.188896+0000","last_fullsized":"2020-06-12T02:36:14.188896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":122,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17376628,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":41,"num_read_kb":32175,"num_write":58,"num_write_kb":20810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.6","version":"67'41","reported_seq":"188","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941582+0000","last_change":"2020-06-12T02:36:14.073415+0000","last_active":"2020-06-12T02:36:14.941582+0000","last_peered":"2020-06-12T02:36:14.941582+0000","last_clean":"2020-06-12T02:36:14.941582+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:14.941582+0000","last_undegraded":"2020-06-12T02:36:14.941582+0000","last_fullsized":"2020-06-12T02:36:14.941582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8337388,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7245,"num_write":22,"num_write_kb":7089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.1","version":"65'29","reported_seq":"184","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941198+0000","last_change":"2020-06-12T02:36:14.073519+0000","last_active":"2020-06-12T02:36:14.941198+0000","last_peered":"2020-06-12T02:36:14.941198+0000","last_clean":"2020-06-12T02:36:14.941198+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:14.941198+0000","last_undegraded":"2020-06-12T02:36:14.941198+0000","last_fullsized":"2020-06-12T02:36:14.941198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6666785,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":23943,"num_write":15,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"76","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081789+0000","last_change":"2020-06-12T02:36:14.082220+0000","last_active":"2020-06-12T02:36:14.081789+0000","last_peered":"2020-06-12T02:36:14.081789+0000","last_clean":"2020-06-12T02:36:14.081789+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:14.081789+0000","last_undegraded":"2020-06-12T02:36:14.081789+0000","last_fullsized":"2020-06-12T02:36:14.081789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.2","version":"65'147","reported_seq":"334","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188224+0000","last_change":"2020-06-12T02:36:14.188936+0000","last_active":"2020-06-12T02:36:14.188224+0000","last_peered":"2020-06-12T02:36:14.188224+0000","last_clean":"2020-06-12T02:36:14.188224+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:14.188224+0000","last_undegraded":"2020-06-12T02:36:14.188224+0000","last_fullsized":"2020-06-12T02:36:14.188224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":147,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15522851,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":24,"num_read_kb":6220,"num_write":71,"num_write_kb":20169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.3","version":"65'78","reported_seq":"259","reported_epoch":"65","state":"active+clean","last_fresh":"2020-06-12T02:36:12.009710+0000","last_change":"2020-06-12T02:36:12.001327+0000","last_active":"2020-06-12T02:36:12.009710+0000","last_peered":"2020-06-12T02:36:12.009710+0000","last_clean":"2020-06-12T02:36:12.009710+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:12.009710+0000","last_undegraded":"2020-06-12T02:36:12.009710+0000","last_fullsized":"2020-06-12T02:36:12.009710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":78,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19602919,"num_objects":12,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":45,"num_read_kb":49664,"num_write":44,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"}]},{"pgid":"1.4","version":"65'113","reported_seq":"266","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081568+0000","last_change":"2020-06-12T02:36:14.081989+0000","last_active":"2020-06-12T02:36:14.081568+0000","last_peered":"2020-06-12T02:36:14.081568+0000","last_clean":"2020-06-12T02:36:14.081568+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:14.081568+0000","last_undegraded":"2020-06-12T02:36:14.081568+0000","last_fullsized":"2020-06-12T02:36:14.081568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19688150,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":43,"num_read_kb":44147,"num_write":58,"num_write_kb":12625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.5","version":"65'119","reported_seq":"273","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939918+0000","last_change":"2020-06-12T02:36:14.058724+0000","last_active":"2020-06-12T02:36:14.939918+0000","last_peered":"2020-06-12T02:36:14.939918+0000","last_clean":"2020-06-12T02:36:14.939918+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:14.939918+0000","last_undegraded":"2020-06-12T02:36:14.939918+0000","last_fullsized":"2020-06-12T02:36:14.939918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23668491,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":27446,"num_write":67,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":181728841,"num_objects":87,"num_object_clones":42,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":7,"num_read":373,"num_read_kb":320764,"num_write":531,"num_write_kb":177119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325365760,"data_stored":426405888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1040,"ondisk_log_size":1040,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084152,"kb_used_data":35568,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93287688,"statfs":{"total":96636764160,"available":95526592512,"internally_reserved":1073741824,"allocated":36421632,"data_stored":46510452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.3170000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":2.2349999999999999},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.8400000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.7689999999999999},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.141}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":2.6120000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.8929999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.794},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.0179999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.1179999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.347},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.464}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1086596,"kb_used_data":38012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93285244,"statfs":{"total":96636764160,"available":95524089856,"internally_reserved":1073741824,"allocated":38924288,"data_stored":53371252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.2869999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.7430000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5529999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.621}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.992},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4169999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.7170000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":3.286}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.5419999999999998},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1899999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.8730000000000002},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.0409999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.3660000000000001},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.5270000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104420,"kb_used_data":55836,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267420,"statfs":{"total":96636764160,"available":95505838080,"internally_reserved":1073741824,"allocated":57176064,"data_stored":77583152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.1400000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.6539999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.0590000000000002},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.3300000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.7410000000000001}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":2.2360000000000002},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":3.0489999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.6400000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.915}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.4260000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.573}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":3.4420000000000002},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.7029999999999998}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1065536,"kb_used_data":16952,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306304,"statfs":{"total":96636764160,"available":95545655296,"internally_reserved":1073741824,"allocated":17358848,"data_stored":20505392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.7669999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":3.585}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.8680000000000001},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4369999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":2.552},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.8420000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":3.3399999999999999},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":3.1930000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.226},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.1389999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.9700000000000002},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.9060000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088656,"kb_used_data":40072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283184,"statfs":{"total":96636764160,"available":95521980416,"internally_reserved":1073741824,"allocated":41033728,"data_stored":57031214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.4279999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":3.702}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.885},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":2.4590000000000001}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":3.0059999999999998},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.5750000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.6269999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.6890000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":3.7850000000000001},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":3.8540000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":4.4800000000000004}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":4.1479999999999997},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.839}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1101412,"kb_used_data":52828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93270428,"statfs":{"total":96636764160,"available":95508918272,"internally_reserved":1073741824,"allocated":54095872,"data_stored":68436340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.373},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.3120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.0459999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":1.4670000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":2.3050000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.7930000000000001},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.6640000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":1.891},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":3.222}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.4420000000000002},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":2.5009999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":2.8839999999999999},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":2.9540000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085168,"kb_used_data":36584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93286672,"statfs":{"total":96636764160,"available":95525552128,"internally_reserved":1073741824,"allocated":37462016,"data_stored":50127220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.74}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.9670000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.254}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":3.577},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":3.294}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":3.1419999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.827},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.0979999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.371},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.6739999999999999}]}]}]}} 2020-06-12T02:36:17.723 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2020-06-12T02:36:17.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:36:17.725 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-06-12T02:36:17.795 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.795 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.804 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:17.847 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:17.842+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:17.864 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.850+0000 7ffa50e84700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:17.862+0000 7ffa4b59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:17.915 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:17.910+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:17.954 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:17.954 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:17.959 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:18.016 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:18.016 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 70, 2020-06-12T02:36:18.016 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "c120ba75-2438-45f0-aa6e-10a350976a3c", 2020-06-12T02:36:18.016 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2020-06-12T02:35:00.134323+0000", 2020-06-12T02:36:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2020-06-12T02:36:17.066383+0000", 2020-06-12T02:36:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:36:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2020-06-12T02:35:57.937806+0000", 2020-06-12T02:36:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-06-12T02:36:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5804032, 2020-06-12T02:36:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2020-06-12T02:36:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "nodeep-scrub", 2020-06-12T02:36:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2020-06-12T02:36:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2020-06-12T02:36:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2020-06-12T02:36:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2020-06-12T02:36:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 6, 2020-06-12T02:36:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.94999998807907104, 2020-06-12T02:36:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-06-12T02:36:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.85000002384185791, 2020-06-12T02:36:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2020-06-12T02:36:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 1, 2020-06-12T02:36:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2020-06-12T02:36:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "jewel", 2020-06-12T02:36:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2020-06-12T02:36:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "octopus", 2020-06-12T02:36:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2020-06-12T02:36:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "unique_pool_0", 2020-06-12T02:36:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2020-06-12T02:35:23.053307+0000", 2020-06-12T02:36:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 8197, 2020-06-12T02:36:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,ec_overwrites,selfmanaged_snaps", 2020-06-12T02:36:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 3, 2020-06-12T02:36:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 3, 2020-06-12T02:36:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 2, 2020-06-12T02:36:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 1, 2020-06-12T02:36:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2020-06-12T02:36:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2020-06-12T02:36:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 16, 2020-06-12T02:36:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 16, 2020-06-12T02:36:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 16, 2020-06-12T02:36:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 16, 2020-06-12T02:36:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 16, 2020-06-12T02:36:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2020-06-12T02:36:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2020-06-12T02:36:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2020-06-12T02:36:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2020-06-12T02:36:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "70", 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2020-06-12T02:36:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T02:36:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T02:36:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2020-06-12T02:36:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2020-06-12T02:36:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 49, 2020-06-12T02:36:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 70, 2020-06-12T02:36:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2020-06-12T02:36:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2020-06-12T02:36:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2020-06-12T02:36:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2020-06-12T02:36:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2020-06-12T02:36:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2020-06-12T02:36:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T02:36:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T02:36:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T02:36:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2020-06-12T02:36:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2020-06-12T02:36:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "teuthologyprofile", 2020-06-12T02:36:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2020-06-12T02:36:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2020-06-12T02:36:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T02:36:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2020-06-12T02:36:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2020-06-12T02:36:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 8192, 2020-06-12T02:36:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2020-06-12T02:36:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2020-06-12T02:36:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2020-06-12T02:36:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2020-06-12T02:36:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: "rados": {} 2020-06-12T02:36:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c", 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 54, 2020-06-12T02:36:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2020-06-12T02:36:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2020-06-12T02:36:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.049 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2020-06-12T02:36:18.049 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.050 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2020-06-12T02:36:18.050 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.050 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.050 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2020-06-12T02:36:18.051 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.052 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2020-06-12T02:36:18.052 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.053 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.053 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.053 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.054 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2020-06-12T02:36:18.054 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.055 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.056 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6811/12037", 2020-06-12T02:36:18.056 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6813/12037", 2020-06-12T02:36:18.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6817/12037", 2020-06-12T02:36:18.056 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/12037", 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.058 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:36:18.058 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "74343e4c-0406-4803-8619-520cbc1c60db", 2020-06-12T02:36:18.058 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.058 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 0, 2020-06-12T02:36:18.058 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 0, 2020-06-12T02:36:18.059 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.059 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.059 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.059 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:18.059 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.061 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2020-06-12T02:36:18.061 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.062 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2020-06-12T02:36:18.062 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2020-06-12T02:36:18.063 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.064 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2020-06-12T02:36:18.064 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.065 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.065 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.066 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2020-06-12T02:36:18.066 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.067 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.068 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.068 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.069 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2020-06-12T02:36:18.069 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.070 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2020-06-12T02:36:18.070 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:18.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.070 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.071 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6803/12047", 2020-06-12T02:36:18.071 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6805/12047", 2020-06-12T02:36:18.071 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6809/12047", 2020-06-12T02:36:18.071 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6807/12047", 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.073 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:36:18.073 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "18348953-2ab3-44d7-9812-308a4e504ffd", 2020-06-12T02:36:18.073 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.073 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.073 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.074 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.074 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.074 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.074 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:18.074 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:18.075 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.075 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.075 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.075 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.077 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2020-06-12T02:36:18.077 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.078 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2020-06-12T02:36:18.079 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.080 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2020-06-12T02:36:18.080 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.081 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.081 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.082 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2020-06-12T02:36:18.082 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.083 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.083 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2020-06-12T02:36:18.083 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.084 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.084 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.085 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2020-06-12T02:36:18.085 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.086 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2020-06-12T02:36:18.086 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:18.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.087 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6819/12038", 2020-06-12T02:36:18.087 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6821/12038", 2020-06-12T02:36:18.087 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6825/12038", 2020-06-12T02:36:18.087 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6823/12038", 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:36:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "318d0252-36b6-489c-8cc7-eb5245346db4", 2020-06-12T02:36:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.090 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.090 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.090 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.090 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:18.090 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.092 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2020-06-12T02:36:18.092 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.094 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.094 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.095 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2020-06-12T02:36:18.095 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.097 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.097 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.097 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6832", 2020-06-12T02:36:18.098 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.098 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6833", 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.099 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.100 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.100 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2020-06-12T02:36:18.100 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.101 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.102 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6827/12048", 2020-06-12T02:36:18.102 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6829/12048", 2020-06-12T02:36:18.102 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6833/12048", 2020-06-12T02:36:18.102 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6831/12048", 2020-06-12T02:36:18.103 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.103 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.103 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.103 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.104 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:36:18.104 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "e622cde1-ff3b-4df8-9e70-640bb7ce27fd", 2020-06-12T02:36:18.104 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.105 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.105 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.105 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.105 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.106 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:18.106 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:18.106 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.106 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.107 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.107 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6800", 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6801", 2020-06-12T02:36:18.108 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.109 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.109 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.109 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.109 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.111 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6802", 2020-06-12T02:36:18.111 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.112 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6803", 2020-06-12T02:36:18.112 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.112 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.114 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.114 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6806", 2020-06-12T02:36:18.114 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.115 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6807", 2020-06-12T02:36:18.115 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.116 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.116 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6804", 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.118 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6805", 2020-06-12T02:36:18.118 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:18.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.119 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6801/12021", 2020-06-12T02:36:18.119 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6803/12021", 2020-06-12T02:36:18.119 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6807/12021", 2020-06-12T02:36:18.119 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6805/12021", 2020-06-12T02:36:18.119 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.120 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:36:18.121 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "f7d22a59-77a8-4264-888e-3e486a4c0d82", 2020-06-12T02:36:18.121 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.121 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.121 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.121 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.122 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.123 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.123 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.123 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6808", 2020-06-12T02:36:18.124 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.126 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6811", 2020-06-12T02:36:18.126 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.127 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.127 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.128 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.129 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6814", 2020-06-12T02:36:18.129 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.131 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6817", 2020-06-12T02:36:18.131 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.132 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.133 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.134 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.135 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6823", 2020-06-12T02:36:18.135 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.137 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6828", 2020-06-12T02:36:18.137 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.138 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.139 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6820", 2020-06-12T02:36:18.140 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.141 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6822", 2020-06-12T02:36:18.141 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:18.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.142 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6811/12020", 2020-06-12T02:36:18.142 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6817/12020", 2020-06-12T02:36:18.143 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6828/12020", 2020-06-12T02:36:18.143 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6822/12020", 2020-06-12T02:36:18.143 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.143 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.144 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.145 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:36:18.145 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "60e271cc-4c4c-4397-87be-8c52ffab68d4", 2020-06-12T02:36:18.146 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.146 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.146 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.146 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.147 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:18.147 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 53, 2020-06-12T02:36:18.148 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.148 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.148 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6809", 2020-06-12T02:36:18.149 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.150 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6812", 2020-06-12T02:36:18.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.151 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.152 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.153 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.153 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6815", 2020-06-12T02:36:18.153 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.154 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6818", 2020-06-12T02:36:18.154 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.155 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.156 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6830", 2020-06-12T02:36:18.156 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6831", 2020-06-12T02:36:18.157 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.158 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.159 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.160 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6825", 2020-06-12T02:36:18.160 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.161 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6826", 2020-06-12T02:36:18.161 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:18.162 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.162 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.162 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6812/12022", 2020-06-12T02:36:18.163 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6818/12022", 2020-06-12T02:36:18.163 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6831/12022", 2020-06-12T02:36:18.163 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6826/12022", 2020-06-12T02:36:18.163 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.163 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.164 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.164 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:36:18.165 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "0f243681-edad-4e3d-9980-cfc55c5f93ab", 2020-06-12T02:36:18.165 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:18.165 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:18.165 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:18.165 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:18.166 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:18.166 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:18.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:18.166 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:18.166 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:18.167 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:18.167 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:18.167 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.168 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6810", 2020-06-12T02:36:18.168 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.169 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.169 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6813", 2020-06-12T02:36:18.169 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6816", 2020-06-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.173 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6819", 2020-06-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.174 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:18.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.175 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6827", 2020-06-12T02:36:18.175 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6829", 2020-06-12T02:36:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.177 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.177 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:18.177 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:18.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:18.178 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6821", 2020-06-12T02:36:18.178 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:18.179 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6824", 2020-06-12T02:36:18.179 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:18.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.180 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.180 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6813/12023", 2020-06-12T02:36:18.180 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6819/12023", 2020-06-12T02:36:18.181 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6829/12023", 2020-06-12T02:36:18.181 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6824/12023", 2020-06-12T02:36:18.181 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:18.181 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:18.181 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:18.182 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.182 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.182 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.182 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2020-06-12T02:36:18.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:36:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.184 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.184 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.988040+0000", 2020-06-12T02:36:18.184 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.185 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:36:18.185 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.185 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.185 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.186 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 65536, 2020-06-12T02:36:18.186 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.578658+0000", 2020-06-12T02:36:18.186 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.187 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:36:18.187 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.187 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.187 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.188 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.188 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.294920+0000", 2020-06-12T02:36:18.188 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.189 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:36:18.189 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.189 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.189 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.190 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.190 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:08.017776+0000", 2020-06-12T02:36:18.190 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.191 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:36:18.191 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.191 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.192 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.192 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.192 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:06.919687+0000", 2020-06-12T02:36:18.192 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.193 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:36:18.193 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.194 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.194 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.194 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.194 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.195 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.053961+0000", 2020-06-12T02:36:18.195 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.195 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:36:18.196 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.196 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.196 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.196 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.196 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.197 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.210941+0000", 2020-06-12T02:36:18.197 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:36:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:18.198 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:18.199 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:18.199 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.971670+0000", 2020-06-12T02:36:18.199 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:18.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.199 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.200 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2020-06-12T02:36:18.200 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2020-06-12T02:36:18.200 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2020-06-12T02:36:18.200 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2020-06-12T02:36:18.200 INFO:teuthology.orchestra.run.smithi142.stdout: "blacklist": {}, 2020-06-12T02:36:18.201 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2020-06-12T02:36:18.201 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2020-06-12T02:36:18.201 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:36:18.201 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:36:18.202 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:36:18.202 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:36:18.202 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:36:18.202 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2020-06-12T02:36:18.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.203 INFO:teuthology.orchestra.run.smithi142.stdout: "teuthologyprofile": { 2020-06-12T02:36:18.203 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-device-class": "", 2020-06-12T02:36:18.203 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:36:18.203 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-root": "default", 2020-06-12T02:36:18.204 INFO:teuthology.orchestra.run.smithi142.stdout: "jerasure-per-chunk-alignment": "false", 2020-06-12T02:36:18.204 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:36:18.204 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:36:18.204 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:36:18.205 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:36:18.205 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van", 2020-06-12T02:36:18.205 INFO:teuthology.orchestra.run.smithi142.stdout: "w": "8" 2020-06-12T02:36:18.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.206 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [ 2020-06-12T02:36:18.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.207 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:18.207 INFO:teuthology.orchestra.run.smithi142.stdout: "snaps": [ 2020-06-12T02:36:18.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.207 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 29, 2020-06-12T02:36:18.208 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:18.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.208 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 37, 2020-06-12T02:36:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 2 2020-06-12T02:36:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 46, 2020-06-12T02:36:18.209 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.210 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [ 2020-06-12T02:36:18.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.211 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:18.211 INFO:teuthology.orchestra.run.smithi142.stdout: "snaps": [ 2020-06-12T02:36:18.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.211 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 37, 2020-06-12T02:36:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.212 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:18.213 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2020-06-12T02:36:18.213 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2020-06-12T02:36:18.213 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {} 2020-06-12T02:36:18.213 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:18.214 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:18.218 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:18.009+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:18.219 INFO:tasks.thrashosds.thrasher:j is {'epoch': 70, 'fsid': 'c120ba75-2438-45f0-aa6e-10a350976a3c', 'created': '2020-06-12T02:35:00.134323+0000', 'modified': '2020-06-12T02:36:17.066383+0000', 'last_up_change': '2020-06-12T02:35:08.937742+0000', 'last_in_change': '2020-06-12T02:35:57.937806+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 1, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'unique_pool_0', 'create_time': '2020-06-12T02:35:23.053307+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 3, 'min_size': 2, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'teuthologyprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 54, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6810', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6811', 'nonce': 12037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6812', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6813', 'nonce': 12037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6816', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6817', 'nonce': 12037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6814', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6815', 'nonce': 12037}]}, 'public_addr': '172.21.15.142:6811/12037', 'cluster_addr': '172.21.15.142:6813/12037', 'heartbeat_back_addr': '172.21.15.142:6817/12037', 'heartbeat_front_addr': '172.21.15.142:6815/12037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '74343e4c-0406-4803-8619-520cbc1c60db', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 12047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 12047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6808', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6809', 'nonce': 12047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 12047}]}, 'public_addr': '172.21.15.142:6803/12047', 'cluster_addr': '172.21.15.142:6805/12047', 'heartbeat_back_addr': '172.21.15.142:6809/12047', 'heartbeat_front_addr': '172.21.15.142:6807/12047', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18348953-2ab3-44d7-9812-308a4e504ffd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6818', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6819', 'nonce': 12038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6820', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6821', 'nonce': 12038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6824', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6825', 'nonce': 12038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6822', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6823', 'nonce': 12038}]}, 'public_addr': '172.21.15.142:6819/12038', 'cluster_addr': '172.21.15.142:6821/12038', 'heartbeat_back_addr': '172.21.15.142:6825/12038', 'heartbeat_front_addr': '172.21.15.142:6823/12038', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '318d0252-36b6-489c-8cc7-eb5245346db4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6826', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6827', 'nonce': 12048}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6828', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6829', 'nonce': 12048}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 12048}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6830', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6831', 'nonce': 12048}]}, 'public_addr': '172.21.15.142:6827/12048', 'cluster_addr': '172.21.15.142:6829/12048', 'heartbeat_back_addr': '172.21.15.142:6833/12048', 'heartbeat_front_addr': '172.21.15.142:6831/12048', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'e622cde1-ff3b-4df8-9e70-640bb7ce27fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6800', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 12021}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6802', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 12021}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6806', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 12021}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6804', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 12021}]}, 'public_addr': '172.21.15.117:6801/12021', 'cluster_addr': '172.21.15.117:6803/12021', 'heartbeat_back_addr': '172.21.15.117:6807/12021', 'heartbeat_front_addr': '172.21.15.117:6805/12021', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f7d22a59-77a8-4264-888e-3e486a4c0d82', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6808', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 12020}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6814', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6817', 'nonce': 12020}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6823', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6828', 'nonce': 12020}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6820', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6822', 'nonce': 12020}]}, 'public_addr': '172.21.15.117:6811/12020', 'cluster_addr': '172.21.15.117:6817/12020', 'heartbeat_back_addr': '172.21.15.117:6828/12020', 'heartbeat_front_addr': '172.21.15.117:6822/12020', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '60e271cc-4c4c-4397-87be-8c52ffab68d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6809', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 12022}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6815', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6818', 'nonce': 12022}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6830', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6831', 'nonce': 12022}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6825', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6826', 'nonce': 12022}]}, 'public_addr': '172.21.15.117:6812/12022', 'cluster_addr': '172.21.15.117:6818/12022', 'heartbeat_back_addr': '172.21.15.117:6831/12022', 'heartbeat_front_addr': '172.21.15.117:6826/12022', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0f243681-edad-4e3d-9980-cfc55c5f93ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6810', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 12023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6816', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6819', 'nonce': 12023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6827', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6829', 'nonce': 12023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6821', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6824', 'nonce': 12023}]}, 'public_addr': '172.21.15.117:6813/12023', 'cluster_addr': '172.21.15.117:6819/12023', 'heartbeat_back_addr': '172.21.15.117:6829/12023', 'heartbeat_front_addr': '172.21.15.117:6824/12023', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.988040+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.578658+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.294920+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:08.017776+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:06.919687+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.053961+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.210941+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.971670+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}, 'teuthologyprofile': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van', 'w': '8'}}, 'removed_snaps_queue': [{'pool': 1, 'snaps': [{'begin': 29, 'length': 1}, {'begin': 37, 'length': 2}, {'begin': 46, 'length': 1}]}], 'new_removed_snaps': [{'pool': 1, 'snaps': [{'begin': 37, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-06-12T02:36:18.219 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:18.220 INFO:tasks.rados.rados.0.smithi142.stdout:298: done (2 left) 2020-06-12T02:36:18.220 INFO:tasks.rados.rados.0.smithi142.stdout:301: done (1 left) 2020-06-12T02:36:18.220 INFO:tasks.rados.rados.0.smithi142.stdout:302: done (0 left) 2020-06-12T02:36:18.221 INFO:tasks.rados.rados.0.smithi142.stdout:303: write oid 25 current snap is 28 2020-06-12T02:36:18.221 INFO:tasks.rados.rados.0.smithi142.stdout:303: seq_num 136 ranges {685752=611865,1975551=310201} 2020-06-12T02:36:18.221 INFO:tasks.rados.rados.0.smithi142.stdout:303: writing smithi14213939-25 from 685752 to 1297617 tid 1 2020-06-12T02:36:18.221 INFO:tasks.rados.rados.0.smithi142.stdout:303: writing smithi14213939-25 from 1975551 to 2285752 tid 2 2020-06-12T02:36:18.222 INFO:tasks.rados.rados.0.smithi142.stdout:304: write oid 38 current snap is 28 2020-06-12T02:36:18.222 INFO:tasks.rados.rados.0.smithi142.stdout:304: seq_num 137 ranges {702559=403467,1750386=495032} 2020-06-12T02:36:18.222 INFO:tasks.rados.rados.0.smithi142.stdout:304: writing smithi14213939-38 from 702559 to 1106026 tid 1 2020-06-12T02:36:18.222 INFO:tasks.rados.rados.0.smithi142.stdout:304: writing smithi14213939-38 from 1750386 to 2245418 tid 2 2020-06-12T02:36:18.222 INFO:tasks.rados.rados.0.smithi142.stdout:305: read oid 5 snap -1 2020-06-12T02:36:18.223 INFO:tasks.rados.rados.0.smithi142.stdout:305: expect (ObjNum 88 snap 13 seq_num 88) 2020-06-12T02:36:18.223 INFO:tasks.rados.rados.0.smithi142.stdout:306: read oid 1 snap -1 2020-06-12T02:36:18.223 INFO:tasks.rados.rados.0.smithi142.stdout:306: expect (ObjNum 128 snap 27 seq_num 128) 2020-06-12T02:36:18.224 INFO:tasks.rados.rados.0.smithi142.stdout:307: copy_from oid 12 from oid 48 current snap is 28 2020-06-12T02:36:18.224 INFO:tasks.rados.rados.0.smithi142.stdout:303: finishing write tid 1 to smithi14213939-25 2020-06-12T02:36:18.224 INFO:tasks.rados.rados.0.smithi142.stdout:304: finishing write tid 1 to smithi14213939-38 2020-06-12T02:36:18.224 INFO:tasks.rados.rados.0.smithi142.stdout:308: read oid 43 snap -1 2020-06-12T02:36:18.225 INFO:tasks.rados.rados.0.smithi142.stdout:308: expect deleted 2020-06-12T02:36:18.225 INFO:tasks.rados.rados.0.smithi142.stdout:309: write (excl) oid 26 current snap is 28 2020-06-12T02:36:18.225 INFO:tasks.rados.rados.0.smithi142.stdout:309: seq_num 138 ranges {719366=478716,1808868=510498} 2020-06-12T02:36:18.225 INFO:tasks.rados.rados.0.smithi142.stdout:309: writing smithi14213939-26 from 719366 to 1198082 tid 1 2020-06-12T02:36:18.225 INFO:tasks.rados.rados.0.smithi142.stdout:309: writing smithi14213939-26 from 1808868 to 2319366 tid 2 2020-06-12T02:36:18.226 INFO:tasks.rados.rados.0.smithi142.stdout:310: read oid 36 snap -1 2020-06-12T02:36:18.226 INFO:tasks.rados.rados.0.smithi142.stdout:310: expect (ObjNum 105 snap 23 seq_num 105) 2020-06-12T02:36:18.226 INFO:tasks.rados.rados.0.smithi142.stdout:311: copy_from oid 41 from oid 30 current snap is 28 2020-06-12T02:36:18.226 INFO:tasks.rados.rados.0.smithi142.stdout:312: snap_remove snap 24 2020-06-12T02:36:18.226 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:36:18.227 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:18.227 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:18.228 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:18.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:18.209+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:18.317 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:18.310+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:18.354+0000 7f10de09e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:18.358+0000 7f10dce3c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:18.366 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:18.354+0000 7f34a734e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:18.366+0000 7f34a60ec700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:18.381 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:18.381 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:18.391 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:18.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:18.418 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:18.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:18.413+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:18.438 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:18.464 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:18.494 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.338703760999998, 2020-06-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.507 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:18.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:18.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:18.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:18.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:18.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:18.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:18.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:18.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:18.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:18.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:18.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:18.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:18.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:18.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:18.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:18.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:18.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:18.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:18.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.558 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.559 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:18.559 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:18.559 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.338392257999999, 2020-06-12T02:36:18.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.560 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:18.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.561 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:18.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:18.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:18.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:18.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:18.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:18.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:18.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:18.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:18.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:18.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:18.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:18.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:18.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:18.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:18.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:18.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:18.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.546141690999999, 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.545625011999999, 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.543118578000001, 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.542938582000001, 2020-06-12T02:36:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.542803490000001, 2020-06-12T02:36:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:18.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:18.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:18.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:18.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:18.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.680 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:18.680 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:18.680 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.493213219000001, 2020-06-12T02:36:18.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:18.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.681 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.681 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.681 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:18.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:18.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:18.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:18.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:18.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:18.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:18.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:18.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:18.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:18.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:18.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:18.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.485166429, 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.696 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:18.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:18.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:18.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:18.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:18.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:18.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:18.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:18.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:18.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:18.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.484821064999998, 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:18.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.711 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:18.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:18.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:18.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:18.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:18.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:18.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:18.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:18.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.723 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:18.723 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:18.723 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.484689511999999, 2020-06-12T02:36:18.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:18.723 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:18.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.725 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:18.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:18.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:18.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:18.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:18.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:18.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:18.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:18.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:18.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:18.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:18.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:798 1.8s0 1:16d20421:::smithi14213939-23:head [setxattr _header (57) in=7b,truncate 2134489] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.005279+0000", 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.4903847749999999, 2020-06-12T02:36:18.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027987461000000002, 2020-06-12T02:36:18.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 798 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005279+0000", 2020-06-12T02:36:18.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005279+0000", 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3029999999999996e-05 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005362+0000", 2020-06-12T02:36:18.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4540000000000001e-06 2020-06-12T02:36:18.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005369+0000", 2020-06-12T02:36:18.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2345e-05 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005382+0000", 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9099999999999999e-06 2020-06-12T02:36:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005389+0000", 2020-06-12T02:36:18.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001370135 2020-06-12T02:36:18.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006759+0000", 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2842000000000006e-05 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006822+0000", 2020-06-12T02:36:18.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018440773000000001 2020-06-12T02:36:18.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.025262+0000", 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000160555 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.025423+0000", 2020-06-12T02:36:18.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085378899999999998 2020-06-12T02:36:18.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.026277+0000", 2020-06-12T02:36:18.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020806520000000001 2020-06-12T02:36:18.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028357+0000", 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047833559999999999 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033141+0000", 2020-06-12T02:36:18.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012562000000000001 2020-06-12T02:36:18.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033266+0000", 2020-06-12T02:36:18.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027987461000000002 2020-06-12T02:36:18.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.752 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:799 1.8s0 1:16d20421:::smithi14213939-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:18.752 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:18.752 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.4902363909999998, 2020-06-12T02:36:18.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001, 2020-06-12T02:36:18.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.754 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.754 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.754 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 799 2020-06-12T02:36:18.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.754 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:18.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.163e-05 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005469+0000", 2020-06-12T02:36:18.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5200000000000003e-06 2020-06-12T02:36:18.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005478+0000", 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2224e-05 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005491+0000", 2020-06-12T02:36:18.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5619999999999997e-06 2020-06-12T02:36:18.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005495+0000", 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001359306 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006854+0000", 2020-06-12T02:36:18.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109207 2020-06-12T02:36:18.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006964+0000", 2020-06-12T02:36:18.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021167133000000001 2020-06-12T02:36:18.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028131+0000", 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000173494 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028304+0000", 2020-06-12T02:36:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055074019999999998 2020-06-12T02:36:18.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033812+0000", 2020-06-12T02:36:18.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014122200000000001 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033953+0000", 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012596910000000001 2020-06-12T02:36:18.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.035213+0000", 2020-06-12T02:36:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001 2020-06-12T02:36:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:830 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.1166787039999999, 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998, 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.768 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.769 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 830 2020-06-12T02:36:18.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.769 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:18.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2907e-05 2020-06-12T02:36:18.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379038+0000", 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5059999999999995e-06 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379046+0000", 2020-06-12T02:36:18.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.521e-05 2020-06-12T02:36:18.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379062+0000", 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9580000000000001e-06 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379069+0000", 2020-06-12T02:36:18.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025736000000000001 2020-06-12T02:36:18.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381642+0000", 2020-06-12T02:36:18.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8594000000000001e-05 2020-06-12T02:36:18.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381711+0000", 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028781834999999999 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410493+0000", 2020-06-12T02:36:18.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998 2020-06-12T02:36:18.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:831 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.1165451900000001, 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003, 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.780 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 831 2020-06-12T02:36:18.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:18.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9319000000000002e-05 2020-06-12T02:36:18.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379148+0000", 2020-06-12T02:36:18.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.464e-06 2020-06-12T02:36:18.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379152+0000", 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8990000000000001e-06 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379160+0000", 2020-06-12T02:36:18.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4769999999999999e-06 2020-06-12T02:36:18.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379164+0000", 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002823229 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381987+0000", 2020-06-12T02:36:18.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010492699999999999 2020-06-12T02:36:18.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.382092+0000", 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039092202999999999 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.421184+0000", 2020-06-12T02:36:18.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003 2020-06-12T02:36:18.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:842 1.5s0 1:a5b7af70:::smithi14213939-17:head [write 1799494~402223] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:18.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:18.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.094397313, 2020-06-12T02:36:18.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001, 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.791 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 842 2020-06-12T02:36:18.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:18.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215639 2020-06-12T02:36:18.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401482+0000", 2020-06-12T02:36:18.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3623e-05 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401496+0000", 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2456e-05 2020-06-12T02:36:18.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401518+0000", 2020-06-12T02:36:18.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1941e-05 2020-06-12T02:36:18.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401530+0000", 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0344000000000003e-05 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401600+0000", 2020-06-12T02:36:18.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146625 2020-06-12T02:36:18.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401747+0000", 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017748788000000001 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419496+0000", 2020-06-12T02:36:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119141 2020-06-12T02:36:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419615+0000", 2020-06-12T02:36:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010974276999999999 2020-06-12T02:36:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.430589+0000", 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025664110000000002 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433156+0000", 2020-06-12T02:36:18.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054978220000000003 2020-06-12T02:36:18.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438653+0000", 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3753999999999998e-05 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438737+0000", 2020-06-12T02:36:18.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001 2020-06-12T02:36:18.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.806 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:843 1.5s0 1:a5b7af70:::smithi14213939-17:head [setxattr _header (57) in=7b,truncate 2201717] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:18.806 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:18.806 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0940669779999999, 2020-06-12T02:36:18.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003, 2020-06-12T02:36:18.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 843 2020-06-12T02:36:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:18.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1662000000000005e-05 2020-06-12T02:36:18.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401678+0000", 2020-06-12T02:36:18.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.742e-06 2020-06-12T02:36:18.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401685+0000", 2020-06-12T02:36:18.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4080000000000001e-06 2020-06-12T02:36:18.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401692+0000", 2020-06-12T02:36:18.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2159999999999997e-06 2020-06-12T02:36:18.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401698+0000", 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5162999999999998e-05 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401783+0000", 2020-06-12T02:36:18.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109722 2020-06-12T02:36:18.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401893+0000", 2020-06-12T02:36:18.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018128401999999998 2020-06-12T02:36:18.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420021+0000", 2020-06-12T02:36:18.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015958500000000001 2020-06-12T02:36:18.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420181+0000", 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011980408999999999 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:18.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432161+0000", 2020-06-12T02:36:18.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020040430000000001 2020-06-12T02:36:18.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.434165+0000", 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053184800000000004 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:18.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439483+0000", 2020-06-12T02:36:18.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015248599999999999 2020-06-12T02:36:18.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439636+0000", 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.822 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:844 1.5s0 1:a5b7af70:::smithi14213939-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:18.822 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:18.822 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.093915779, 2020-06-12T02:36:18.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998, 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.823 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 844 2020-06-12T02:36:18.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5605000000000001e-05 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401793+0000", 2020-06-12T02:36:18.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.331e-06 2020-06-12T02:36:18.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401800+0000", 2020-06-12T02:36:18.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2789000000000001e-05 2020-06-12T02:36:18.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401813+0000", 2020-06-12T02:36:18.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1390000000000003e-06 2020-06-12T02:36:18.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401818+0000", 2020-06-12T02:36:18.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109048 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401927+0000", 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010927 2020-06-12T02:36:18.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402036+0000", 2020-06-12T02:36:18.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018472145999999998 2020-06-12T02:36:18.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420508+0000", 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9551999999999998e-05 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:18.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420608+0000", 2020-06-12T02:36:18.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019833529999999999 2020-06-12T02:36:18.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440441+0000", 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012666700000000001 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440568+0000", 2020-06-12T02:36:18.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010441980000000001 2020-06-12T02:36:18.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.441612+0000", 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:846 1.ds0 1:b3d4b74b:::smithi14213939-29:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401989+0000", 2020-06-12T02:36:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.0936741780000001, 2020-06-12T02:36:18.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027072190999999999, 2020-06-12T02:36:18.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 846 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401989+0000", 2020-06-12T02:36:18.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401989+0000", 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8755999999999999e-05 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402038+0000", 2020-06-12T02:36:18.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7190000000000004e-06 2020-06-12T02:36:18.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402045+0000", 2020-06-12T02:36:18.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2839e-05 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402058+0000", 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9459999999999997e-06 2020-06-12T02:36:18.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402063+0000", 2020-06-12T02:36:18.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015197139999999999 2020-06-12T02:36:18.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403582+0000", 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7035999999999998e-05 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403669+0000", 2020-06-12T02:36:18.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025392181 2020-06-12T02:36:18.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.429062+0000", 2020-06-12T02:36:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027072190999999999 2020-06-12T02:36:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:847 1.ds0 1:b3d4b74b:::smithi14213939-29:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.09355183, 2020-06-12T02:36:18.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664, 2020-06-12T02:36:18.849 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:18.849 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:18.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:18.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 847 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:18.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:18.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:18.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:18.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:18.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4753000000000003e-05 2020-06-12T02:36:18.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:18.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402157+0000", 2020-06-12T02:36:18.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.55e-06 2020-06-12T02:36:18.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:18.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402163+0000", 2020-06-12T02:36:18.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1355000000000001e-05 2020-06-12T02:36:18.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:18.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402174+0000", 2020-06-12T02:36:18.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8770000000000001e-06 2020-06-12T02:36:18.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402179+0000", 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020908300000000001 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:18.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404270+0000", 2020-06-12T02:36:18.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5341999999999997e-05 2020-06-12T02:36:18.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404356+0000", 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026823956999999999 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:18.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:18.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.431179+0000", 2020-06-12T02:36:18.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664 2020-06-12T02:36:18.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:18.860 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:18.860 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:18.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:18.864 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2020-06-12T02:36:18.087484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":185589771,"num_objects":90,"num_object_clones":45,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":8,"num_read":376,"num_read_kb":320765,"num_write":537,"num_write_kb":180891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1066,"ondisk_log_size":1066,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8677164,"kb_used_data":288492,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746297556,"statfs":{"total":773094113280,"available":764208697344,"internally_reserved":8589934592,"allocated":295415808,"data_stored":387891209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9546322,"num_objects":10,"num_object_clones":10,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":3,"num_read":10,"num_read_kb":5,"num_write":34,"num_write_kb":9315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033472"},"pg_stats":[{"pgid":"1.f","version":"65'28","reported_seq":"180","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941097+0000","last_change":"2020-06-12T02:36:14.072171+0000","last_active":"2020-06-12T02:36:14.941097+0000","last_peered":"2020-06-12T02:36:14.941097+0000","last_clean":"2020-06-12T02:36:14.941097+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:14.941097+0000","last_undegraded":"2020-06-12T02:36:14.941097+0000","last_fullsized":"2020-06-12T02:36:14.941097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9671511,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7836,"num_write":18,"num_write_kb":5721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.e","version":"70'74","reported_seq":"110","reported_epoch":"70","state":"active+clean","last_fresh":"2020-06-12T02:36:17.103508+0000","last_change":"2020-06-12T02:36:17.104411+0000","last_active":"2020-06-12T02:36:17.103508+0000","last_peered":"2020-06-12T02:36:17.103508+0000","last_clean":"2020-06-12T02:36:17.103508+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:17.103508+0000","last_undegraded":"2020-06-12T02:36:17.103508+0000","last_fullsized":"2020-06-12T02:36:17.103508+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":74,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":30098,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2e","length":"1"}]},{"pgid":"1.d","version":"65'119","reported_seq":"322","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939127+0000","last_change":"2020-06-12T02:36:14.058408+0000","last_active":"2020-06-12T02:36:14.939127+0000","last_peered":"2020-06-12T02:36:14.939127+0000","last_clean":"2020-06-12T02:36:14.939127+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:14.939127+0000","last_undegraded":"2020-06-12T02:36:14.939127+0000","last_fullsized":"2020-06-12T02:36:14.939127+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24521149,"num_objects":9,"num_object_clones":3,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":51090,"num_write":55,"num_write_kb":29045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.c","version":"64'24","reported_seq":"166","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.075968+0000","last_change":"2020-06-12T02:36:14.077075+0000","last_active":"2020-06-12T02:36:14.075968+0000","last_peered":"2020-06-12T02:36:14.075968+0000","last_clean":"2020-06-12T02:36:14.075968+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:14.075968+0000","last_undegraded":"2020-06-12T02:36:14.075968+0000","last_fullsized":"2020-06-12T02:36:14.075968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.b","version":"70'52","reported_seq":"213","reported_epoch":"70","state":"active+clean","last_fresh":"2020-06-12T02:36:17.102833+0000","last_change":"2020-06-12T02:36:17.104094+0000","last_active":"2020-06-12T02:36:17.102833+0000","last_peered":"2020-06-12T02:36:17.102833+0000","last_clean":"2020-06-12T02:36:17.102833+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:17.102833+0000","last_undegraded":"2020-06-12T02:36:17.102833+0000","last_fullsized":"2020-06-12T02:36:17.102833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":52,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7853990,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":24,"num_read_kb":25866,"num_write":31,"num_write_kb":7797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2e","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"66","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188105+0000","last_change":"2020-06-12T02:36:14.188592+0000","last_active":"2020-06-12T02:36:14.188105+0000","last_peered":"2020-06-12T02:36:14.188105+0000","last_clean":"2020-06-12T02:36:14.188105+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:14.188105+0000","last_undegraded":"2020-06-12T02:36:14.188105+0000","last_fullsized":"2020-06-12T02:36:14.188105+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.9","version":"59'57","reported_seq":"85","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939897+0000","last_change":"2020-06-12T02:36:14.072032+0000","last_active":"2020-06-12T02:36:14.939897+0000","last_peered":"2020-06-12T02:36:14.939897+0000","last_clean":"2020-06-12T02:36:14.939897+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:14.939897+0000","last_undegraded":"2020-06-12T02:36:14.939897+0000","last_fullsized":"2020-06-12T02:36:14.939897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":57,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5344560,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":25,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.8","version":"65'42","reported_seq":"92","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939731+0000","last_change":"2020-06-12T02:36:14.058207+0000","last_active":"2020-06-12T02:36:14.939731+0000","last_peered":"2020-06-12T02:36:14.939731+0000","last_clean":"2020-06-12T02:36:14.939731+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:14.939731+0000","last_undegraded":"2020-06-12T02:36:14.939731+0000","last_fullsized":"2020-06-12T02:36:14.939731+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10947823,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":8034,"num_write":21,"num_write_kb":10814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.7","version":"65'122","reported_seq":"273","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188896+0000","last_change":"2020-06-12T02:36:14.189462+0000","last_active":"2020-06-12T02:36:14.188896+0000","last_peered":"2020-06-12T02:36:14.188896+0000","last_clean":"2020-06-12T02:36:14.188896+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:14.188896+0000","last_undegraded":"2020-06-12T02:36:14.188896+0000","last_fullsized":"2020-06-12T02:36:14.188896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":122,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17376628,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":41,"num_read_kb":32175,"num_write":58,"num_write_kb":20810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.6","version":"67'41","reported_seq":"188","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941582+0000","last_change":"2020-06-12T02:36:14.073415+0000","last_active":"2020-06-12T02:36:14.941582+0000","last_peered":"2020-06-12T02:36:14.941582+0000","last_clean":"2020-06-12T02:36:14.941582+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:14.941582+0000","last_undegraded":"2020-06-12T02:36:14.941582+0000","last_fullsized":"2020-06-12T02:36:14.941582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":41,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8337388,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7245,"num_write":22,"num_write_kb":7089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.1","version":"65'29","reported_seq":"184","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.941198+0000","last_change":"2020-06-12T02:36:14.073519+0000","last_active":"2020-06-12T02:36:14.941198+0000","last_peered":"2020-06-12T02:36:14.941198+0000","last_clean":"2020-06-12T02:36:14.941198+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:14.941198+0000","last_undegraded":"2020-06-12T02:36:14.941198+0000","last_fullsized":"2020-06-12T02:36:14.941198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6666785,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":23943,"num_write":15,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"76","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081789+0000","last_change":"2020-06-12T02:36:14.082220+0000","last_active":"2020-06-12T02:36:14.081789+0000","last_peered":"2020-06-12T02:36:14.081789+0000","last_clean":"2020-06-12T02:36:14.081789+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:14.081789+0000","last_undegraded":"2020-06-12T02:36:14.081789+0000","last_fullsized":"2020-06-12T02:36:14.081789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.2","version":"65'147","reported_seq":"334","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.188224+0000","last_change":"2020-06-12T02:36:14.188936+0000","last_active":"2020-06-12T02:36:14.188224+0000","last_peered":"2020-06-12T02:36:14.188224+0000","last_clean":"2020-06-12T02:36:14.188224+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:14.188224+0000","last_undegraded":"2020-06-12T02:36:14.188224+0000","last_fullsized":"2020-06-12T02:36:14.188224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":147,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15522851,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":24,"num_read_kb":6220,"num_write":71,"num_write_kb":20169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.3","version":"70'92","reported_seq":"285","reported_epoch":"70","state":"active+clean","last_fresh":"2020-06-12T02:36:17.119061+0000","last_change":"2020-06-12T02:36:17.119667+0000","last_active":"2020-06-12T02:36:17.119061+0000","last_peered":"2020-06-12T02:36:17.119061+0000","last_clean":"2020-06-12T02:36:17.119061+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:17.119061+0000","last_undegraded":"2020-06-12T02:36:17.119061+0000","last_fullsized":"2020-06-12T02:36:17.119061+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22527304,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":46,"num_read_kb":49664,"num_write":45,"num_write_kb":14176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2e","length":"1"}]},{"pgid":"1.4","version":"65'113","reported_seq":"266","reported_epoch":"67","state":"active+clean","last_fresh":"2020-06-12T02:36:14.081568+0000","last_change":"2020-06-12T02:36:14.081989+0000","last_active":"2020-06-12T02:36:14.081568+0000","last_peered":"2020-06-12T02:36:14.081568+0000","last_clean":"2020-06-12T02:36:14.081568+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:14.081568+0000","last_undegraded":"2020-06-12T02:36:14.081568+0000","last_fullsized":"2020-06-12T02:36:14.081568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":113,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19688150,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":43,"num_read_kb":44147,"num_write":58,"num_write_kb":12625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"13","length":"1"},{"start":"1d","length":"1"},{"start":"21","length":"1"},{"start":"26","length":"1"},{"start":"29","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.5","version":"65'119","reported_seq":"273","reported_epoch":"68","state":"active+clean","last_fresh":"2020-06-12T02:36:14.939918+0000","last_change":"2020-06-12T02:36:14.058724+0000","last_active":"2020-06-12T02:36:14.939918+0000","last_peered":"2020-06-12T02:36:14.939918+0000","last_clean":"2020-06-12T02:36:14.939918+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:14.939918+0000","last_undegraded":"2020-06-12T02:36:14.939918+0000","last_fullsized":"2020-06-12T02:36:14.939918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23668491,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":27446,"num_write":67,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1d","length":"1"},{"start":"26","length":"1"},{"start":"2e","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":185589771,"num_objects":90,"num_object_clones":45,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":8,"num_read":376,"num_read_kb":320765,"num_write":537,"num_write_kb":180891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":337371136,"data_stored":440311808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1066,"ondisk_log_size":1066,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084152,"kb_used_data":35568,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93287688,"statfs":{"total":96636764160,"available":95526592512,"internally_reserved":1073741824,"allocated":36421632,"data_stored":46510452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.3170000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":2.2349999999999999},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.8400000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.7689999999999999},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.141}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":2.6120000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.8929999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.794},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.0179999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.1179999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.347},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.464}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1086596,"kb_used_data":38012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93285244,"statfs":{"total":96636764160,"available":95524089856,"internally_reserved":1073741824,"allocated":38924288,"data_stored":53371252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.2869999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.7430000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5529999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.621}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.992},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4169999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.7170000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":3.286}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.5419999999999998},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1899999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.8730000000000002},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.0409999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.3660000000000001},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.5270000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111984,"kb_used_data":63400,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93259856,"statfs":{"total":96636764160,"available":95498092544,"internally_reserved":1073741824,"allocated":64921600,"data_stored":86213977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":1.855},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.4419999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.1499999999999999},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.7809999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.3380000000000001},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.298}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.5449999999999999},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.226}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.5659999999999998},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.6179999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.1669999999999998},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.7130000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.911},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.972}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049380,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322460,"statfs":{"total":96636764160,"available":95562199040,"internally_reserved":1073741824,"allocated":815104,"data_stored":361817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.494},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.5429999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.954},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.984}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":1.901},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":1.631}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":2.0950000000000002},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":2.6320000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":2.7789999999999999},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":3.3069999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":2.831},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":3.1850000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":2.9940000000000002},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":3.052}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069816,"kb_used_data":21232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93302024,"statfs":{"total":96636764160,"available":95541272576,"internally_reserved":1073741824,"allocated":21741568,"data_stored":25838937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":2.2029999999999998},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.8109999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.605},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.105}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.831},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4399999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":2.7749999999999999},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.9940000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":2.5219999999999998},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":1.718}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.2799999999999998},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.1989999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.121},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.9049999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088656,"kb_used_data":40072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283184,"statfs":{"total":96636764160,"available":95521980416,"internally_reserved":1073741824,"allocated":41033728,"data_stored":57031214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.4279999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":3.702}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.885},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":2.4590000000000001}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":3.0059999999999998},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.5750000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.6269999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.6890000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":3.7850000000000001},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":3.8540000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":4.4800000000000004}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":4.1479999999999997},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.839}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1101412,"kb_used_data":52828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93270428,"statfs":{"total":96636764160,"available":95508918272,"internally_reserved":1073741824,"allocated":54095872,"data_stored":68436340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.373},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.3120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.0459999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":1.4670000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":2.3050000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.7930000000000001},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.6640000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":1.891},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":3.222}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.4420000000000002},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":2.5009999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":2.8839999999999999},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":2.9540000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085168,"kb_used_data":36584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93286672,"statfs":{"total":96636764160,"available":95525552128,"internally_reserved":1073741824,"allocated":37462016,"data_stored":50127220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.74}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.9670000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.254}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":3.577},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":3.294}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":3.1419999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.827},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.0979999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.371},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.6739999999999999}]}]}]}} 2020-06-12T02:36:18.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:18.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:18.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:18.870 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:18.873 INFO:tasks.thrashosds.thrasher:Setting 1.f to [4, 0, 7, 2, 5, 3] 2020-06-12T02:36:18.873 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '1.f', '4', '0', '7', '2', '5', '3'] 2020-06-12T02:36:18.874 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 1.f 4 0 7 2 5 3 2020-06-12T02:36:18.874 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.875 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.875 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.875 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.875 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.875 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.876 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.876 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:18.876 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:18.858+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:18.877 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:18.962 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:18.957+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:19.027 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:19.028 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:19.030 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:19.040 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:19.018+0000 7fa9b10f5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:19.041 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:19.034+0000 7fa9b08f4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:19.041 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:19.069 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:19.061+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:19.096 INFO:tasks.rados.rados.0.smithi142.stdout:312: done (9 left) 2020-06-12T02:36:19.096 INFO:tasks.rados.rados.0.smithi142.stdout:313: read oid 50 snap -1 2020-06-12T02:36:19.096 INFO:tasks.rados.rados.0.smithi142.stdout:313: expect deleted 2020-06-12T02:36:19.097 INFO:tasks.rados.rados.0.smithi142.stdout:314: copy_from oid 24 from oid 10 current snap is 28 2020-06-12T02:36:19.097 INFO:tasks.rados.rados.0.smithi142.stdout:303: finishing write tid 2 to smithi14213939-25 2020-06-12T02:36:19.097 INFO:tasks.rados.rados.0.smithi142.stdout:303: finishing write tid 4 to smithi14213939-25 2020-06-12T02:36:19.098 INFO:tasks.rados.rados.0.smithi142.stdout:303: finishing write tid 5 to smithi14213939-25 2020-06-12T02:36:19.098 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 25 v 96 (ObjNum 136 snap 28 seq_num 136) dirty exists 2020-06-12T02:36:19.098 INFO:tasks.rados.rados.0.smithi142.stdout:303: left oid 25 (ObjNum 136 snap 28 seq_num 136) 2020-06-12T02:36:19.098 INFO:tasks.rados.rados.0.smithi142.stdout:304: finishing write tid 2 to smithi14213939-38 2020-06-12T02:36:19.099 INFO:tasks.rados.rados.0.smithi142.stdout:304: finishing write tid 4 to smithi14213939-38 2020-06-12T02:36:19.099 INFO:tasks.rados.rados.0.smithi142.stdout:309: finishing write tid 1 to smithi14213939-26 2020-06-12T02:36:19.099 INFO:tasks.rados.rados.0.smithi142.stdout:311: finishing copy_from to smithi14213939-41 2020-06-12T02:36:19.099 INFO:tasks.rados.rados.0.smithi142.stdout:311: got expected ENOENT (src dne) 2020-06-12T02:36:19.100 INFO:tasks.rados.rados.0.smithi142.stdout:311: finishing copy_from racing read to smithi14213939-41 2020-06-12T02:36:19.100 INFO:tasks.rados.rados.0.smithi142.stdout:305: expect (ObjNum 88 snap 13 seq_num 88) 2020-06-12T02:36:19.170 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:19.161+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:19.171 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:19.171 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:19.172 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:19.172 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:19.172 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:19.182 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:19.232 INFO:teuthology.orchestra.run.smithi142.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-06-12T02:36:19.233 INFO:tasks.rados.rados.0.smithi142.stdout:304: finishing write tid 5 to smithi14213939-38 2020-06-12T02:36:19.234 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 38 v 125 (ObjNum 137 snap 28 seq_num 137) dirty exists 2020-06-12T02:36:19.234 INFO:tasks.rados.rados.0.smithi142.stdout:304: left oid 38 (ObjNum 137 snap 28 seq_num 137) 2020-06-12T02:36:19.234 INFO:tasks.rados.rados.0.smithi142.stdout:309: finishing write tid 2 to smithi14213939-26 2020-06-12T02:36:19.236 INFO:tasks.rados.rados.0.smithi142.stdout:309: finishing write tid 4 to smithi14213939-26 2020-06-12T02:36:19.236 INFO:tasks.rados.rados.0.smithi142.stdout:303: done (10 left) 2020-06-12T02:36:19.237 INFO:tasks.rados.rados.0.smithi142.stdout:304: done (9 left) 2020-06-12T02:36:19.237 INFO:tasks.rados.rados.0.smithi142.stdout:305: done (8 left) 2020-06-12T02:36:19.237 INFO:tasks.rados.rados.0.smithi142.stdout:308: done (7 left) 2020-06-12T02:36:19.238 INFO:tasks.rados.rados.0.smithi142.stdout:311: done (6 left) 2020-06-12T02:36:19.238 INFO:tasks.rados.rados.0.smithi142.stdout:315: write (excl) oid 28 current snap is 28 2020-06-12T02:36:19.238 INFO:tasks.rados.rados.0.smithi142.stdout:315: seq_num 139 ranges {736173=553965,1867350=468823} 2020-06-12T02:36:19.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:36:19.257 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-06-12T02:36:19.259 INFO:tasks.rados.rados.0.smithi142.stdout:315: writing smithi14213939-28 from 736173 to 1290138 tid 1 2020-06-12T02:36:19.259 INFO:tasks.rados.rados.0.smithi142.stdout:315: writing smithi14213939-28 from 1867350 to 2336173 tid 2 2020-06-12T02:36:19.260 INFO:tasks.rados.rados.0.smithi142.stdout:316: rollback oid 4 current snap is 28 2020-06-12T02:36:19.260 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 4 to 16 2020-06-12T02:36:19.260 INFO:tasks.rados.rados.0.smithi142.stdout:309: finishing write tid 5 to smithi14213939-26 2020-06-12T02:36:19.260 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 26 v 45 (ObjNum 138 snap 28 seq_num 138) dirty exists 2020-06-12T02:36:19.260 INFO:tasks.rados.rados.0.smithi142.stdout:309: left oid 26 (ObjNum 138 snap 28 seq_num 138) 2020-06-12T02:36:19.261 INFO:tasks.rados.rados.0.smithi142.stdout:306: expect (ObjNum 128 snap 27 seq_num 128) 2020-06-12T02:36:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.166782300000001, 2020-06-12T02:36:19.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:19.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:19.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.310 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.166558858000002, 2020-06-12T02:36:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:19.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.312 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.312 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:19.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.313 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:19.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:19.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:19.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:19.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:19.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:19.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:19.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:19.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:19.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:19.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:19.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:19.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:19.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:19.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:19.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:19.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:19.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:19.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.327 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:19.327 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:19.327 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.124079749000003, 2020-06-12T02:36:19.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:19.328 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.328 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.328 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.328 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.329 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.329 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:19.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.329 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:19.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:19.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:19.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:19.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:19.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:19.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:19.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:19.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:19.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:19.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:19.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:19.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:19.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:19.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:19.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:19.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:19.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:19.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:19.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:19.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:19.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:19.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:19.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:19.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:19.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:19.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:19.348 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:19.348 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.123744854999998, 2020-06-12T02:36:19.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:19.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.350 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.350 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:19.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:19.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:19.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:19.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:19.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:19.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:19.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:19.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:19.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:19.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:19.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:19.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:19.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:19.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:19.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:19.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:19.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:19.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:19.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:19.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:19.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:19.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:19.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:19.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:19.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:19.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:19.367 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.367 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.367 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.368 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:429 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~2689087,checksum] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:19.368 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:19.368 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.015583112000002, 2020-06-12T02:36:19.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862, 2020-06-12T02:36:19.369 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.369 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.370 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 429 2020-06-12T02:36:19.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.370 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273324+0000", 2020-06-12T02:36:19.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7293000000000005e-05 2020-06-12T02:36:19.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273421+0000", 2020-06-12T02:36:19.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2640000000000008e-06 2020-06-12T02:36:19.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273429+0000", 2020-06-12T02:36:19.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5403000000000001e-05 2020-06-12T02:36:19.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273445+0000", 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.759e-06 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273452+0000", 2020-06-12T02:36:19.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022692599999999999 2020-06-12T02:36:19.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273679+0000", 2020-06-12T02:36:19.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8340000000000005e-06 2020-06-12T02:36:19.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:19.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.273687+0000", 2020-06-12T02:36:19.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040310149999999998 2020-06-12T02:36:19.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277718+0000", 2020-06-12T02:36:19.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000106714 2020-06-12T02:36:19.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.277825+0000", 2020-06-12T02:36:19.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016577654000000001 2020-06-12T02:36:19.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:44.294403+0000", 2020-06-12T02:36:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021078862 2020-06-12T02:36:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.382 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.383 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.383 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:768 1.6s0 1:6f0b6341:::smithi14213939-20:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e67)", 2020-06-12T02:36:19.383 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:19.384 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2118088460000003, 2020-06-12T02:36:19.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021124269000000001, 2020-06-12T02:36:19.384 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.384 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.384 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.385 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.385 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.385 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 768 2020-06-12T02:36:19.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.387 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077098+0000", 2020-06-12T02:36:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015301 2020-06-12T02:36:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077251+0000", 2020-06-12T02:36:19.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2774e-05 2020-06-12T02:36:19.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077264+0000", 2020-06-12T02:36:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9853999999999999e-05 2020-06-12T02:36:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077294+0000", 2020-06-12T02:36:19.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7688000000000001e-05 2020-06-12T02:36:19.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.077311+0000", 2020-06-12T02:36:19.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001726684 2020-06-12T02:36:19.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079038+0000", 2020-06-12T02:36:19.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013601499999999999 2020-06-12T02:36:19.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.079174+0000", 2020-06-12T02:36:19.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073522930000000002 2020-06-12T02:36:19.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.086526+0000", 2020-06-12T02:36:19.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6370000000000003e-05 2020-06-12T02:36:19.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.086593+0000", 2020-06-12T02:36:19.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097098859999999992 2020-06-12T02:36:19.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.096303+0000", 2020-06-12T02:36:19.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019877 2020-06-12T02:36:19.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.096501+0000", 2020-06-12T02:36:19.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017209250000000001 2020-06-12T02:36:19.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.098222+0000", 2020-06-12T02:36:19.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021124269000000001 2020-06-12T02:36:19.402 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.403 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.403 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.403 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:771 1.9s0 1:9d744368:::smithi14213939-32:head [write 1505862~544592] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.404 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.959927+0000", 2020-06-12T02:36:19.404 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.328980262, 2020-06-12T02:36:19.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021177957000000001, 2020-06-12T02:36:19.404 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.404 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.407 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 771 2020-06-12T02:36:19.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.959927+0000", 2020-06-12T02:36:19.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.959927+0000", 2020-06-12T02:36:19.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000362047 2020-06-12T02:36:19.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960289+0000", 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4082e-05 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960303+0000", 2020-06-12T02:36:19.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4218000000000001e-05 2020-06-12T02:36:19.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960327+0000", 2020-06-12T02:36:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4963000000000001e-05 2020-06-12T02:36:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960342+0000", 2020-06-12T02:36:19.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8973000000000005e-05 2020-06-12T02:36:19.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960411+0000", 2020-06-12T02:36:19.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012099000000000001 2020-06-12T02:36:19.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960532+0000", 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006203559 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.966736+0000", 2020-06-12T02:36:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8307000000000006e-05 2020-06-12T02:36:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.966834+0000", 2020-06-12T02:36:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078012869999999996 2020-06-12T02:36:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.974635+0000", 2020-06-12T02:36:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062105859999999997 2020-06-12T02:36:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.980846+0000", 2020-06-12T02:36:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000142912 2020-06-12T02:36:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.980989+0000", 2020-06-12T02:36:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011603300000000001 2020-06-12T02:36:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.981105+0000", 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021177957000000001 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:772 1.9s0 1:9d744368:::smithi14213939-32:head [setxattr _header (57) in=7b,truncate 2050454] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.960409+0000", 2020-06-12T02:36:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3284979950000002, 2020-06-12T02:36:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024288339999999999, 2020-06-12T02:36:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 772 2020-06-12T02:36:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960409+0000", 2020-06-12T02:36:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960409+0000", 2020-06-12T02:36:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6100999999999997e-05 2020-06-12T02:36:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960465+0000", 2020-06-12T02:36:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6420000000000004e-06 2020-06-12T02:36:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960471+0000", 2020-06-12T02:36:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2480000000000001e-05 2020-06-12T02:36:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960483+0000", 2020-06-12T02:36:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7990000000000001e-06 2020-06-12T02:36:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960488+0000", 2020-06-12T02:36:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6489000000000006e-05 2020-06-12T02:36:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960565+0000", 2020-06-12T02:36:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105783 2020-06-12T02:36:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960670+0000", 2020-06-12T02:36:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064513189999999996 2020-06-12T02:36:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.967122+0000", 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105401 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.967227+0000", 2020-06-12T02:36:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0099313019999999995 2020-06-12T02:36:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.977158+0000", 2020-06-12T02:36:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066522150000000004 2020-06-12T02:36:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.983811+0000", 2020-06-12T02:36:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5375000000000002e-05 2020-06-12T02:36:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.983896+0000", 2020-06-12T02:36:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080143399999999996 2020-06-12T02:36:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.984697+0000", 2020-06-12T02:36:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024288339999999999 2020-06-12T02:36:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:773 1.9s0 1:9d744368:::smithi14213939-32:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:14.960528+0000", 2020-06-12T02:36:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3283789260000001, 2020-06-12T02:36:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028024362000000001, 2020-06-12T02:36:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 773 2020-06-12T02:36:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960528+0000", 2020-06-12T02:36:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960528+0000", 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5092000000000002e-05 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960563+0000", 2020-06-12T02:36:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4580000000000003e-06 2020-06-12T02:36:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960568+0000", 2020-06-12T02:36:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1838999999999999e-05 2020-06-12T02:36:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960589+0000", 2020-06-12T02:36:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9709999999999999e-06 2020-06-12T02:36:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960599+0000", 2020-06-12T02:36:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6722e-05 2020-06-12T02:36:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960696+0000", 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0826000000000002e-05 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.960777+0000", 2020-06-12T02:36:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067373700000000003 2020-06-12T02:36:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.967514+0000", 2020-06-12T02:36:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4230000000000001e-05 2020-06-12T02:36:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.967569+0000", 2020-06-12T02:36:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017220915999999999 2020-06-12T02:36:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.984789+0000", 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000117296 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.984907+0000", 2020-06-12T02:36:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036456420000000002 2020-06-12T02:36:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:14.988552+0000", 2020-06-12T02:36:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028024362000000001 2020-06-12T02:36:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9228689719999998, 2020-06-12T02:36:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:36:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:36:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:36:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:36:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:36:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:36:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:36:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:36:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:36:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:36:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:36:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:36:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:36:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:36:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:36:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:36:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:36:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:36:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9227091590000001, 2020-06-12T02:36:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:36:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:36:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:36:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:36:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:36:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:36:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:36:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:36:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:36:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:36:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:36:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:36:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:36:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:36:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:36:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:36:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:36:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.922628446, 2020-06-12T02:36:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:36:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:36:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:36:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:36:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:36:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:36:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:36:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:36:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:36:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:36:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:36:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:36:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:36:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:36:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:36:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:36:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:812 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366428+0000", 2020-06-12T02:36:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.922478844, 2020-06-12T02:36:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025383203999999999, 2020-06-12T02:36:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 812 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366428+0000", 2020-06-12T02:36:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366428+0000", 2020-06-12T02:36:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1786999999999998e-05 2020-06-12T02:36:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366470+0000", 2020-06-12T02:36:19.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7629999999999998e-06 2020-06-12T02:36:19.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366474+0000", 2020-06-12T02:36:19.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7159999999999997e-06 2020-06-12T02:36:19.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366480+0000", 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.76e-06 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366484+0000", 2020-06-12T02:36:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00099517000000000008 2020-06-12T02:36:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.367479+0000", 2020-06-12T02:36:19.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9992000000000001e-05 2020-06-12T02:36:19.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.367579+0000", 2020-06-12T02:36:19.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024232015999999999 2020-06-12T02:36:19.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391811+0000", 2020-06-12T02:36:19.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025383203999999999 2020-06-12T02:36:19.524 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.525 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9223818929999998, 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.527 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:36:19.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.527 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:19.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:19.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:36:19.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:36:19.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:36:19.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:36:19.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:36:19.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:36:19.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:36:19.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:36:19.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:36:19.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:36:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:36:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.537 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.537 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:814 1.9s0 1:92300f98:::smithi14213939-7:head [write 584910~560371] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.538 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.372703+0000", 2020-06-12T02:36:19.538 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9162038140000002, 2020-06-12T02:36:19.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027514703000000001, 2020-06-12T02:36:19.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.540 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 814 2020-06-12T02:36:19.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.540 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372703+0000", 2020-06-12T02:36:19.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372703+0000", 2020-06-12T02:36:19.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034346099999999998 2020-06-12T02:36:19.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373047+0000", 2020-06-12T02:36:19.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.978e-06 2020-06-12T02:36:19.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373057+0000", 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9932000000000002e-05 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373077+0000", 2020-06-12T02:36:19.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1390000000000001e-06 2020-06-12T02:36:19.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373086+0000", 2020-06-12T02:36:19.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7329000000000001e-05 2020-06-12T02:36:19.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373123+0000", 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110231 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.373233+0000", 2020-06-12T02:36:19.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012295229999999999 2020-06-12T02:36:19.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.374463+0000", 2020-06-12T02:36:19.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019013960000000001 2020-06-12T02:36:19.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.376364+0000", 2020-06-12T02:36:19.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023552044000000001 2020-06-12T02:36:19.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.399916+0000", 2020-06-12T02:36:19.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030166999999999998 2020-06-12T02:36:19.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400218+0000", 2020-06-12T02:36:19.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027514703000000001 2020-06-12T02:36:19.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:815 1.9s0 1:92300f98:::smithi14213939-7:head [write 1857365~327545] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.553 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379183+0000", 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9097236839999998, 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021507104999999999, 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 815 2020-06-12T02:36:19.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379183+0000", 2020-06-12T02:36:19.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379183+0000", 2020-06-12T02:36:19.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035192900000000001 2020-06-12T02:36:19.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379535+0000", 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9340000000000001e-06 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379545+0000", 2020-06-12T02:36:19.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8170000000000001e-05 2020-06-12T02:36:19.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379563+0000", 2020-06-12T02:36:19.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8059999999999995e-06 2020-06-12T02:36:19.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379571+0000", 2020-06-12T02:36:19.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000327091 2020-06-12T02:36:19.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379898+0000", 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015472399999999999 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380053+0000", 2020-06-12T02:36:19.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013318729999999999 2020-06-12T02:36:19.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381385+0000", 2020-06-12T02:36:19.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042095580000000004 2020-06-12T02:36:19.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385594+0000", 2020-06-12T02:36:19.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014791014999999999 2020-06-12T02:36:19.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400385+0000", 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030500500000000001 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400690+0000", 2020-06-12T02:36:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021507104999999999 2020-06-12T02:36:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.568 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:816 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2184910] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.568 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379656+0000", 2020-06-12T02:36:19.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.909250873, 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021317702000000001, 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.570 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 816 2020-06-12T02:36:19.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.570 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379656+0000", 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379656+0000", 2020-06-12T02:36:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112167 2020-06-12T02:36:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379768+0000", 2020-06-12T02:36:19.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4199999999999996e-06 2020-06-12T02:36:19.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379778+0000", 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7450000000000001e-05 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379795+0000", 2020-06-12T02:36:19.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9059999999999996e-06 2020-06-12T02:36:19.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379802+0000", 2020-06-12T02:36:19.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030652499999999998 2020-06-12T02:36:19.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.382867+0000", 2020-06-12T02:36:19.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000152559 2020-06-12T02:36:19.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.383020+0000", 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013985079999999999 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.384418+0000", 2020-06-12T02:36:19.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015040469999999999 2020-06-12T02:36:19.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385922+0000", 2020-06-12T02:36:19.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014892881 2020-06-12T02:36:19.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400815+0000", 2020-06-12T02:36:19.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015851400000000001 2020-06-12T02:36:19.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400974+0000", 2020-06-12T02:36:19.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021317702000000001 2020-06-12T02:36:19.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.583 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9090315699999998, 2020-06-12T02:36:19.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:36:19.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:36:19.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:19.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:36:19.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:36:19.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:36:19.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:36:19.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:36:19.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:36:19.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:36:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:36:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:36:19.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:36:19.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:36:19.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:36:19.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:36:19.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:36:19.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:36:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:36:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.598 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:19.598 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:19.599 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9088453159999998, 2020-06-12T02:36:19.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:36:19.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:19.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.600 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:36:19.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:19.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:36:19.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:36:19.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:36:19.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:36:19.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:36:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:36:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:36:19.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:36:19.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:36:19.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:36:19.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:19.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:36:19.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:36:19.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:19.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:36:19.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:36:19.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:19.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:36:19.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:36:19.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:19.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:19.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9086446050000001, 2020-06-12T02:36:19.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:36:19.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:19.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:19.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:19.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:19.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:19.616 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:36:19.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.616 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:19.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:19.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:19.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:19.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:19.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:36:19.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:36:19.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:19.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:36:19.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:36:19.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:19.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:36:19.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:36:19.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:19.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:36:19.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:36:19.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:36:19.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:36:19.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:19.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:36:19.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:36:19.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:19.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:36:19.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:36:19.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:19.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:19.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:19.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:36:19.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:36:19.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.629 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:19.630 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:19.630 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:19.630 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:19.290+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:19.633 INFO:tasks.rados.rados.0.smithi142.stdout:307: finishing copy_from to smithi14213939-12 2020-06-12T02:36:19.633 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 12 v 27 (ObjNum 116 snap 25 seq_num 116) dirty exists 2020-06-12T02:36:19.634 INFO:tasks.rados.rados.0.smithi142.stdout:310: expect (ObjNum 105 snap 23 seq_num 105) 2020-06-12T02:36:19.634 INFO:tasks.rados.rados.0.smithi142.stdout:307: finishing copy_from racing read to smithi14213939-12 2020-06-12T02:36:19.634 INFO:tasks.rados.rados.0.smithi142.stdout:306: done (7 left) 2020-06-12T02:36:19.634 INFO:tasks.rados.rados.0.smithi142.stdout:307: done (6 left) 2020-06-12T02:36:19.634 INFO:tasks.rados.rados.0.smithi142.stdout:309: done (5 left) 2020-06-12T02:36:19.635 INFO:tasks.rados.rados.0.smithi142.stdout:310: done (4 left) 2020-06-12T02:36:19.635 INFO:tasks.rados.rados.0.smithi142.stdout:317: write oid 37 current snap is 28 2020-06-12T02:36:19.635 INFO:tasks.rados.rados.0.smithi142.stdout:317: seq_num 140 ranges {752980=629214,1809479=543501} 2020-06-12T02:36:19.635 INFO:tasks.rados.rados.0.smithi142.stdout:317: writing smithi14213939-37 from 752980 to 1382194 tid 1 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:317: writing smithi14213939-37 from 1809479 to 2352980 tid 2 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:318: read oid 46 snap 12 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:318: expect deleted 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:319: delete oid 12 current snap is 28 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:314: finishing copy_from to smithi14213939-24 2020-06-12T02:36:19.636 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 24 v 14 (ObjNum 52 snap 3 seq_num 52) dirty exists 2020-06-12T02:36:19.637 INFO:tasks.rados.rados.0.smithi142.stdout:314: finishing copy_from racing read to smithi14213939-24 2020-06-12T02:36:19.637 INFO:tasks.rados.rados.0.smithi142.stdout:315: finishing write tid 1 to smithi14213939-28 2020-06-12T02:36:19.637 INFO:tasks.rados.rados.0.smithi142.stdout:316: finishing rollback tid 0 to smithi14213939-4 2020-06-12T02:36:19.637 INFO:tasks.rados.rados.0.smithi142.stdout:316: finishing rollback tid 1 to smithi14213939-4 2020-06-12T02:36:19.637 INFO:tasks.rados.rados.0.smithi142.stdout:316: finishing rollback tid 2 to smithi14213939-4 2020-06-12T02:36:19.638 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 4 v 62 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:36:19.638 INFO:tasks.rados.rados.0.smithi142.stdout:315: finishing write tid 2 to smithi14213939-28 2020-06-12T02:36:19.638 INFO:tasks.rados.rados.0.smithi142.stdout:315: finishing write tid 4 to smithi14213939-28 2020-06-12T02:36:19.638 INFO:tasks.rados.rados.0.smithi142.stdout:315: finishing write tid 5 to smithi14213939-28 2020-06-12T02:36:19.638 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 28 v 130 (ObjNum 139 snap 28 seq_num 139) dirty exists 2020-06-12T02:36:19.639 INFO:tasks.rados.rados.0.smithi142.stdout:315: left oid 28 (ObjNum 139 snap 28 seq_num 139) 2020-06-12T02:36:19.639 INFO:tasks.rados.rados.0.smithi142.stdout:313: done (6 left) 2020-06-12T02:36:19.639 INFO:tasks.rados.rados.0.smithi142.stdout:314: done (5 left) 2020-06-12T02:36:19.639 INFO:tasks.rados.rados.0.smithi142.stdout:315: done (4 left) 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:316: done (3 left) 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:319: done (2 left) 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:320: delete oid 24 current snap is 28 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:317: finishing write tid 1 to smithi14213939-37 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:317: finishing write tid 2 to smithi14213939-37 2020-06-12T02:36:19.640 INFO:tasks.rados.rados.0.smithi142.stdout:317: finishing write tid 4 to smithi14213939-37 2020-06-12T02:36:19.641 INFO:tasks.rados.rados.0.smithi142.stdout:317: finishing write tid 5 to smithi14213939-37 2020-06-12T02:36:19.641 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 37 v 133 (ObjNum 140 snap 28 seq_num 140) dirty exists 2020-06-12T02:36:19.641 INFO:tasks.rados.rados.0.smithi142.stdout:317: left oid 37 (ObjNum 140 snap 28 seq_num 140) 2020-06-12T02:36:19.641 INFO:tasks.rados.rados.0.smithi142.stdout:317: done (2 left) 2020-06-12T02:36:19.641 INFO:tasks.rados.rados.0.smithi142.stdout:318: done (1 left) 2020-06-12T02:36:19.642 INFO:tasks.rados.rados.0.smithi142.stdout:320: done (0 left) 2020-06-12T02:36:19.642 INFO:tasks.rados.rados.0.smithi142.stdout:321: copy_from oid 8 from oid 6 current snap is 28 2020-06-12T02:36:19.642 INFO:tasks.rados.rados.0.smithi142.stdout:322: snap_create 2020-06-12T02:36:19.642 INFO:tasks.rados.rados.0.smithi142.stdout:321: finishing copy_from to smithi14213939-8 2020-06-12T02:36:19.643 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 126 (ObjNum 69 snap 9 seq_num 69) dirty exists 2020-06-12T02:36:19.643 INFO:tasks.rados.rados.0.smithi142.stdout:321: finishing copy_from racing read to smithi14213939-8 2020-06-12T02:36:19.643 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:19.626+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:19.644 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:19.741 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:19.729+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:19.758 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:19.758 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:19.759 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:19.759 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:19.768 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:19.859 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:19.853+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:19.923 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:19.925 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:19.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:19.933+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:19.942 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:19.943 INFO:tasks.rados.rados.0.smithi142.stdout:321: done (1 left) 2020-06-12T02:36:19.944 INFO:tasks.rados.rados.0.smithi142.stdout:322: done (0 left) 2020-06-12T02:36:19.944 INFO:tasks.rados.rados.0.smithi142.stdout:323: write oid 45 current snap is 29 2020-06-12T02:36:19.945 INFO:tasks.rados.rados.0.smithi142.stdout:323: seq_num 143 ranges {403401=454961,1584925=506039} 2020-06-12T02:36:19.952 INFO:tasks.rados.rados.0.smithi142.stdout:323: writing smithi14213939-45 from 403401 to 858362 tid 1 2020-06-12T02:36:19.959 INFO:tasks.rados.rados.0.smithi142.stdout:323: writing smithi14213939-45 from 1584925 to 2090964 tid 2 2020-06-12T02:36:19.959 INFO:tasks.rados.rados.0.smithi142.stdout:324: write oid 41 current snap is 29 2020-06-12T02:36:19.960 INFO:tasks.rados.rados.0.smithi142.stdout:324: seq_num 144 ranges {420208=530210,1527054=766050} 2020-06-12T02:36:19.965 INFO:tasks.rados.rados.0.smithi142.stdout:324: writing smithi14213939-41 from 420208 to 950418 tid 1 2020-06-12T02:36:19.974 INFO:tasks.rados.rados.0.smithi142.stdout:324: writing smithi14213939-41 from 1527054 to 2293104 tid 2 2020-06-12T02:36:19.975 INFO:tasks.rados.rados.0.smithi142.stdout:323: finishing write tid 1 to smithi14213939-45 2020-06-12T02:36:19.975 INFO:tasks.rados.rados.0.smithi142.stdout:325: read oid 10 snap -1 2020-06-12T02:36:19.975 INFO:tasks.rados.rados.0.smithi142.stdout:325: expect (ObjNum 52 snap 3 seq_num 52) 2020-06-12T02:36:19.976 INFO:tasks.rados.rados.0.smithi142.stdout:326: copy_from oid 1 from oid 16 current snap is 29 2020-06-12T02:36:19.976 INFO:tasks.rados.rados.0.smithi142.stdout:327: read oid 36 snap -1 2020-06-12T02:36:19.976 INFO:tasks.rados.rados.0.smithi142.stdout:327: expect (ObjNum 105 snap 23 seq_num 105) 2020-06-12T02:36:19.977 INFO:tasks.rados.rados.0.smithi142.stdout:328: read oid 20 snap 27 2020-06-12T02:36:19.977 INFO:tasks.rados.rados.0.smithi142.stdout:328: expect (ObjNum 121 snap 26 seq_num 121) 2020-06-12T02:36:19.977 INFO:tasks.rados.rados.0.smithi142.stdout:329: snap_create 2020-06-12T02:36:19.978 INFO:tasks.rados.rados.0.smithi142.stdout:323: finishing write tid 2 to smithi14213939-45 2020-06-12T02:36:19.981 INFO:tasks.rados.rados.0.smithi142.stdout:323: finishing write tid 4 to smithi14213939-45 2020-06-12T02:36:19.984 INFO:tasks.rados.rados.0.smithi142.stdout:326: finishing copy_from to smithi14213939-1 2020-06-12T02:36:19.984 INFO:tasks.rados.rados.0.smithi142.stdout:326: got expected ENOENT (src dne) 2020-06-12T02:36:19.984 INFO:tasks.rados.rados.0.smithi142.stdout:324: finishing write tid 1 to smithi14213939-41 2020-06-12T02:36:19.985 INFO:tasks.rados.rados.0.smithi142.stdout:326: finishing copy_from racing read to smithi14213939-1 2020-06-12T02:36:19.986 INFO:tasks.rados.rados.0.smithi142.stdout:323: finishing write tid 5 to smithi14213939-45 2020-06-12T02:36:19.986 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 45 v 65 (ObjNum 143 snap 29 seq_num 143) dirty exists 2020-06-12T02:36:19.987 INFO:tasks.rados.rados.0.smithi142.stdout:323: left oid 45 (ObjNum 143 snap 29 seq_num 143) 2020-06-12T02:36:19.994 INFO:tasks.rados.rados.0.smithi142.stdout:325: expect (ObjNum 52 snap 3 seq_num 52) 2020-06-12T02:36:20.041 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:20.038+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:20.087 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.948227850999999, 2020-06-12T02:36:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.937336469999998, 2020-06-12T02:36:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.936204426000003, 2020-06-12T02:36:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.935949241000003, 2020-06-12T02:36:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 48.935790054000002, 2020-06-12T02:36:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.791467476000001, 2020-06-12T02:36:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:603 1.bs0 1:d6659338:::smithi14213939-43:head [write 430279~695389,stat] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.060567020000001, 2020-06-12T02:36:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882, 2020-06-12T02:36:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 603 2020-06-12T02:36:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014668649999999999 2020-06-12T02:36:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021925+0000", 2020-06-12T02:36:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9837e-05 2020-06-12T02:36:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021944+0000", 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4341e-05 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021969+0000", 2020-06-12T02:36:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4333e-05 2020-06-12T02:36:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021983+0000", 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3517999999999995e-05 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022077+0000", 2020-06-12T02:36:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000168954 2020-06-12T02:36:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022246+0000", 2020-06-12T02:36:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035737379999999999 2020-06-12T02:36:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.025819+0000", 2020-06-12T02:36:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060458619999999999 2020-06-12T02:36:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031865+0000", 2020-06-12T02:36:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158689 2020-06-12T02:36:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.032024+0000", 2020-06-12T02:36:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098174500000000001 2020-06-12T02:36:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033006+0000", 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.050397979, 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.112695578, 2020-06-12T02:36:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.130819497999999, 2020-06-12T02:36:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.130626182, 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.130477727000001, 2020-06-12T02:36:20.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:20.309 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.310 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.311 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:20.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.313 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:20.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:20.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:20.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:20.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:20.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:20.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:20.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:20.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:20.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:20.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:20.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:20.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:20.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:20.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:20.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:20.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.324 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:20.325 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:20.325 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.123044777, 2020-06-12T02:36:20.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:20.325 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.325 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:20.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:20.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:20.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:20.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:20.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:20.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:20.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:20.333 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.334 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.120636276999999, 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.335 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:20.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:20.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:20.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:20.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:20.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:20.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:20.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:20.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:20.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:20.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:20.345 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.345 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.346 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:20.346 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:20.347 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.118609132, 2020-06-12T02:36:20.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:20.347 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:20.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:20.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:20.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:20.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:20.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:20.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:20.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:20.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:20.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:20.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:20.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:20.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:20.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:20.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:20.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:20.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:20.358 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.358 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.358 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.359 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=168, attrs_read=0))", 2020-06-12T02:36:20.359 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:20.360 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.116690656999999, 2020-06-12T02:36:20.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001, 2020-06-12T02:36:20.361 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.361 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.361 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001626127 2020-06-12T02:36:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965960+0000", 2020-06-12T02:36:20.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3662999999999999e-05 2020-06-12T02:36:20.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965974+0000", 2020-06-12T02:36:20.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4405e-05 2020-06-12T02:36:20.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965988+0000", 2020-06-12T02:36:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5080000000000002e-06 2020-06-12T02:36:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965995+0000", 2020-06-12T02:36:20.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0077934429999999997 2020-06-12T02:36:20.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973788+0000", 2020-06-12T02:36:20.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002853216 2020-06-12T02:36:20.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976641+0000", 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.372 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:20.372 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:20.372 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.107559299, 2020-06-12T02:36:20.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:20.373 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.373 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.373 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:20.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:20.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:20.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:20.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:20.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:20.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:20.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:20.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:20.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:20.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:20.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:20.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:20.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.383 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.384 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:20.385 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:20.385 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.1033462820000004, 2020-06-12T02:36:20.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:20.385 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.385 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.386 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.386 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.386 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.386 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:20.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.387 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:20.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:20.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:20.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:20.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:20.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:20.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:20.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:20.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:20.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:20.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:20.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:20.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:20.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:20.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:20.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:20.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.400 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.1031630830000001, 2020-06-12T02:36:20.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:20.402 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.402 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.402 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.402 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.403 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.403 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:20.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.403 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:20.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:20.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:20.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:20.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:20.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:20.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:20.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:20.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:20.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:20.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:20.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:20.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:20.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:20.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:20.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:20.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:20.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.419 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.420 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:20.420 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:20.420 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.6462450390000001, 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:20.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:20.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:20.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:20.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:20.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:20.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:20.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:20.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:20.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:20.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:20.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.431 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.432 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:20.432 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:36:20.435 INFO:tasks.rados.rados.0.smithi142.stdout:328: expect (ObjNum 121 snap 26 seq_num 121) 2020-06-12T02:36:20.436 INFO:tasks.rados.rados.0.smithi142.stdout:327: expect (ObjNum 105 snap 23 seq_num 105) 2020-06-12T02:36:20.436 INFO:tasks.rados.rados.0.smithi142.stdout:324: finishing write tid 2 to smithi14213939-41 2020-06-12T02:36:20.436 INFO:tasks.rados.rados.0.smithi142.stdout:324: finishing write tid 4 to smithi14213939-41 2020-06-12T02:36:20.436 INFO:tasks.rados.rados.0.smithi142.stdout:324: finishing write tid 5 to smithi14213939-41 2020-06-12T02:36:20.437 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 41 v 48 (ObjNum 144 snap 29 seq_num 144) dirty exists 2020-06-12T02:36:20.437 INFO:tasks.rados.rados.0.smithi142.stdout:324: left oid 41 (ObjNum 144 snap 29 seq_num 144) 2020-06-12T02:36:20.437 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:20.430+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:20.438 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:20.533 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:20.525+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:20.552 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:20.538+0000 7f56cc5a5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:20.554 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:20.554 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:20.554+0000 7f56cb343700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:20.564 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:20.652 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:20.645+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:20.719 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:20.720 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:20.729 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:20.771 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:20.765+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:20.839 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:20.833+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:20.877 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:20.885 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.733235768999997, 2020-06-12T02:36:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.586722258000002, 2020-06-12T02:36:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 29/18 ECSubWrite(tid=138, reqid=client.4555.0:314, at_version=29'17, trim_to=0'0, roll_forward_to=26'14))", 2020-06-12T02:36:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:36:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.580737642000003, 2020-06-12T02:36:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512, 2020-06-12T02:36:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:36:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298238+0000", 2020-06-12T02:36:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050880100000000002 2020-06-12T02:36:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298747+0000", 2020-06-12T02:36:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7461999999999999e-05 2020-06-12T02:36:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298774+0000", 2020-06-12T02:36:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3760999999999999e-05 2020-06-12T02:36:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298788+0000", 2020-06-12T02:36:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9280000000000004e-06 2020-06-12T02:36:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298795+0000", 2020-06-12T02:36:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0432999999999994e-05 2020-06-12T02:36:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298875+0000", 2020-06-12T02:36:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2087e-05 2020-06-12T02:36:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.298897+0000", 2020-06-12T02:36:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069111329999999999 2020-06-12T02:36:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305809+0000", 2020-06-12T02:36:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3906999999999996e-05 2020-06-12T02:36:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.305882+0000", 2020-06-12T02:36:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007644512 2020-06-12T02:36:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.909173584000001, 2020-06-12T02:36:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.908409656, 2020-06-12T02:36:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.685604601000001, 2020-06-12T02:36:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.677318314000001, 2020-06-12T02:36:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:659 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 2706697~532054] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.671074837999999, 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076657540000000003, 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 659 2020-06-12T02:36:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000595569 2020-06-12T02:36:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208496+0000", 2020-06-12T02:36:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0293000000000002e-05 2020-06-12T02:36:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208537+0000", 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7671999999999999e-05 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208564+0000", 2020-06-12T02:36:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6803000000000002e-05 2020-06-12T02:36:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208581+0000", 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131323 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208712+0000", 2020-06-12T02:36:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027796400000000001 2020-06-12T02:36:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208990+0000", 2020-06-12T02:36:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029075889999999999 2020-06-12T02:36:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211898+0000", 2020-06-12T02:36:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033717920000000002 2020-06-12T02:36:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215270+0000", 2020-06-12T02:36:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015060099999999999 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215420+0000", 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000146148 2020-06-12T02:36:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215566+0000", 2020-06-12T02:36:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076657540000000003 2020-06-12T02:36:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.670289069999999, 2020-06-12T02:36:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.670151618999999, 2020-06-12T02:36:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 59/51 ECSubWrite(tid=121, reqid=osd.3.0:121, at_version=59'53, trim_to=0'0, roll_forward_to=0'0))", 2020-06-12T02:36:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951756+0000", 2020-06-12T02:36:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.927219933, 2020-06-12T02:36:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074932929999999998, 2020-06-12T02:36:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:21.072 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951756+0000", 2020-06-12T02:36:21.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951756+0000", 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063275899999999999 2020-06-12T02:36:21.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952388+0000", 2020-06-12T02:36:21.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5826e-05 2020-06-12T02:36:21.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952414+0000", 2020-06-12T02:36:21.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0295999999999999e-05 2020-06-12T02:36:21.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952445+0000", 2020-06-12T02:36:21.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.15e-05 2020-06-12T02:36:21.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952456+0000", 2020-06-12T02:36:21.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.7361999999999996e-05 2020-06-12T02:36:21.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952533+0000", 2020-06-12T02:36:21.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6801000000000001e-05 2020-06-12T02:36:21.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952550+0000", 2020-06-12T02:36:21.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0063681859999999996 2020-06-12T02:36:21.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958918+0000", 2020-06-12T02:36:21.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033056300000000003 2020-06-12T02:36:21.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.959249+0000", 2020-06-12T02:36:21.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074932929999999998 2020-06-12T02:36:21.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.082 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 59/51 ECSubWrite(tid=122, reqid=osd.3.0:122, at_version=59'55, trim_to=0'0, roll_forward_to=0'0))", 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.952546+0000", 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.926429650999999, 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075399880000000001, 2020-06-12T02:36:21.083 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.084 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:21.084 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952546+0000", 2020-06-12T02:36:21.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952546+0000", 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5430000000000001e-05 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952621+0000", 2020-06-12T02:36:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4632000000000001e-05 2020-06-12T02:36:21.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952646+0000", 2020-06-12T02:36:21.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6429000000000001e-05 2020-06-12T02:36:21.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952662+0000", 2020-06-12T02:36:21.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6919999999999996e-06 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952669+0000", 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024331400000000001 2020-06-12T02:36:21.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952912+0000", 2020-06-12T02:36:21.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0971999999999999e-05 2020-06-12T02:36:21.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952923+0000", 2020-06-12T02:36:21.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071002289999999996 2020-06-12T02:36:21.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960024+0000", 2020-06-12T02:36:21.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2290000000000002e-05 2020-06-12T02:36:21.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960086+0000", 2020-06-12T02:36:21.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075399880000000001 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.095 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.86936388, 2020-06-12T02:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.096 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.097 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:21.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:21.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:21.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:21.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:21.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:21.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:21.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:21.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:21.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:21.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:21.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:21.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:21.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:21.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:21.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:21.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.111 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.111 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.869217266, 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.112 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.113 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:21.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.113 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:21.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:21.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:21.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:21.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:21.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:21.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:21.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:21.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:21.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:21.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:21.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:21.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:21.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:21.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:21.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:21.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:21.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:21.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.132 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.132 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.9s2 68/51 ECSubWrite(tid=175, reqid=client.4555.0:770, at_version=68'59, trim_to=0'0, roll_forward_to=59'57))", 2020-06-12T02:36:21.133 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.956883+0000", 2020-06-12T02:36:21.133 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.9220925299999996, 2020-06-12T02:36:21.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076312059999999998, 2020-06-12T02:36:21.133 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.133 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.956883+0000", 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.956883+0000", 2020-06-12T02:36:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00073915199999999997 2020-06-12T02:36:21.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957622+0000", 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9646e-05 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957662+0000", 2020-06-12T02:36:21.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4082999999999999e-05 2020-06-12T02:36:21.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957696+0000", 2020-06-12T02:36:21.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8572000000000001e-05 2020-06-12T02:36:21.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957714+0000", 2020-06-12T02:36:21.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012748499999999999 2020-06-12T02:36:21.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957842+0000", 2020-06-12T02:36:21.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8045999999999999e-05 2020-06-12T02:36:21.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.957870+0000", 2020-06-12T02:36:21.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065502099999999999 2020-06-12T02:36:21.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.964420+0000", 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4011999999999994e-05 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.964514+0000", 2020-06-12T02:36:21.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076312059999999998 2020-06-12T02:36:21.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.145 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.146 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:21.146 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:21.146 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.9132043919999999, 2020-06-12T02:36:21.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:21.147 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.147 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.148 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.148 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.148 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:21.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:21.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:21.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:21.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:21.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:21.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:21.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:21.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:21.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:21.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:21.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:21.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:21.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:21.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:21.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:21.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:21.162 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.162 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.162 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.163 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:21.163 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:21.163 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.9074728790000002, 2020-06-12T02:36:21.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:21.163 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.164 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.164 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.164 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.164 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.164 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:21.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:21.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:21.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:21.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:21.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:21.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:21.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:21.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:21.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:21.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:21.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:21.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:21.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:21.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:21.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:21.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:21.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.177 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.179 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:21.179 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:21.179 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.9069793629999996, 2020-06-12T02:36:21.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:21.180 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.180 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:21.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.181 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:21.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.181 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:21.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:21.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:21.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:21.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:21.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:21.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:21.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:21.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:21.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:21.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:21.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:21.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:21.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:21.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:21.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:21.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:21.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:21.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:21.194 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.194 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.194 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.195 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:21.195 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:21.195 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.9068853560000001, 2020-06-12T02:36:21.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:21.196 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.196 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:21.196 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:21.197 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:21.197 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:21.197 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:21.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.197 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:21.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:21.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:21.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:21.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:21.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:21.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:21.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:21.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:21.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:21.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:21.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:21.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:21.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:21.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:21.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:21.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:21.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:21.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:21.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:21.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:21.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.213 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:21.214 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:21.214 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.8687243269999998, 2020-06-12T02:36:21.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:21.215 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:21.215 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:21.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:21.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:21.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:21.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:21.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:21.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:21.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:21.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:21.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:21.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:21.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:21.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:21.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:21.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:21.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:21.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:21.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:21.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:21.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:21.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:21.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:21.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:21.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:21.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:21.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:21.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:21.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:21.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:21.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:21.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:21.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:21.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:21.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:21.231 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.231 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.231 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.231 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:21.232 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:21.232 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:21.239 INFO:tasks.rados.rados.0.smithi142.stdout:323: done (6 left) 2020-06-12T02:36:21.239 INFO:tasks.rados.rados.0.smithi142.stdout:324: done (5 left) 2020-06-12T02:36:21.239 INFO:tasks.rados.rados.0.smithi142.stdout:325: done (4 left) 2020-06-12T02:36:21.240 INFO:tasks.rados.rados.0.smithi142.stdout:326: done (3 left) 2020-06-12T02:36:21.240 INFO:tasks.rados.rados.0.smithi142.stdout:327: done (2 left) 2020-06-12T02:36:21.240 INFO:tasks.rados.rados.0.smithi142.stdout:328: done (1 left) 2020-06-12T02:36:21.240 INFO:tasks.rados.rados.0.smithi142.stdout:329: done (0 left) 2020-06-12T02:36:21.240 INFO:tasks.rados.rados.0.smithi142.stdout:330: delete oid 40 current snap is 30 2020-06-12T02:36:21.241 INFO:tasks.rados.rados.0.smithi142.stdout:330: done (0 left) 2020-06-12T02:36:21.241 INFO:tasks.rados.rados.0.smithi142.stdout:331: rollback oid 16 current snap is 30 2020-06-12T02:36:21.241 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 16 to 16 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:332: write oid 13 current snap is 30 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:332: seq_num 146 ranges {453822=797061,1760371=653366} 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:332: writing smithi14213939-13 from 453822 to 1250883 tid 1 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:332: writing smithi14213939-13 from 1760371 to 2413737 tid 2 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:333: write oid 31 current snap is 30 2020-06-12T02:36:21.242 INFO:tasks.rados.rados.0.smithi142.stdout:333: seq_num 147 ranges {470629=472310,1418853=513377} 2020-06-12T02:36:21.243 INFO:tasks.rados.rados.0.smithi142.stdout:333: writing smithi14213939-31 from 470629 to 942939 tid 1 2020-06-12T02:36:21.243 INFO:tasks.rados.rados.0.smithi142.stdout:333: writing smithi14213939-31 from 1418853 to 1932230 tid 2 2020-06-12T02:36:21.243 INFO:tasks.rados.rados.0.smithi142.stdout:334: write oid 7 current snap is 30 2020-06-12T02:36:21.243 INFO:tasks.rados.rados.0.smithi142.stdout:334: seq_num 148 ranges {487436=547559,1760982=657035} 2020-06-12T02:36:21.243 INFO:tasks.rados.rados.0.smithi142.stdout:334: writing smithi14213939-7 from 487436 to 1034995 tid 1 2020-06-12T02:36:21.244 INFO:tasks.rados.rados.0.smithi142.stdout:334: writing smithi14213939-7 from 1760982 to 2418017 tid 2 2020-06-12T02:36:21.244 INFO:tasks.rados.rados.0.smithi142.stdout:335: delete oid 39 current snap is 30 2020-06-12T02:36:21.244 INFO:tasks.rados.rados.0.smithi142.stdout:331: finishing rollback tid 1 to smithi14213939-16 2020-06-12T02:36:21.244 INFO:tasks.rados.rados.0.smithi142.stdout:331: finishing rollback tid 2 to smithi14213939-16 2020-06-12T02:36:21.244 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 16 v 106 (ObjNum 15 snap 0 seq_num 15) dirty exists 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:332: finishing write tid 1 to smithi14213939-13 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:332: finishing write tid 2 to smithi14213939-13 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:332: finishing write tid 4 to smithi14213939-13 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:332: finishing write tid 5 to smithi14213939-13 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 57 (ObjNum 146 snap 30 seq_num 146) dirty exists 2020-06-12T02:36:21.245 INFO:tasks.rados.rados.0.smithi142.stdout:332: left oid 13 (ObjNum 146 snap 30 seq_num 146) 2020-06-12T02:36:21.246 INFO:tasks.rados.rados.0.smithi142.stdout:333: finishing write tid 1 to smithi14213939-31 2020-06-12T02:36:21.246 INFO:tasks.rados.rados.0.smithi142.stdout:334: finishing write tid 1 to smithi14213939-7 2020-06-12T02:36:21.246 INFO:tasks.rados.rados.0.smithi142.stdout:333: finishing write tid 2 to smithi14213939-31 2020-06-12T02:36:21.246 INFO:tasks.rados.rados.0.smithi142.stdout:333: finishing write tid 4 to smithi14213939-31 2020-06-12T02:36:21.246 INFO:tasks.rados.rados.0.smithi142.stdout:331: done (4 left) 2020-06-12T02:36:21.247 INFO:tasks.rados.rados.0.smithi142.stdout:332: done (3 left) 2020-06-12T02:36:21.247 INFO:tasks.rados.rados.0.smithi142.stdout:335: done (2 left) 2020-06-12T02:36:21.247 INFO:tasks.rados.rados.0.smithi142.stdout:336: rollback oid 39 current snap is 30 2020-06-12T02:36:21.247 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 39 to 20 2020-06-12T02:36:21.248 INFO:tasks.rados.rados.0.smithi142.stdout:337: write (excl) oid 49 current snap is 30 2020-06-12T02:36:21.248 INFO:tasks.rados.rados.0.smithi142.stdout:337: seq_num 150 ranges {521050=698057,1877946=643104} 2020-06-12T02:36:21.248 INFO:tasks.rados.rados.0.smithi142.stdout:337: writing smithi14213939-49 from 521050 to 1219107 tid 1 2020-06-12T02:36:21.248 INFO:tasks.rados.rados.0.smithi142.stdout:337: writing smithi14213939-49 from 1877946 to 2521050 tid 2 2020-06-12T02:36:21.248 INFO:tasks.rados.rados.0.smithi142.stdout:338: write oid 35 current snap is 30 2020-06-12T02:36:21.249 INFO:tasks.rados.rados.0.smithi142.stdout:338: seq_num 151 ranges {537857=773306,1936428=520715} 2020-06-12T02:36:21.249 INFO:tasks.rados.rados.0.smithi142.stdout:338: writing smithi14213939-35 from 537857 to 1311163 tid 1 2020-06-12T02:36:21.249 INFO:tasks.rados.rados.0.smithi142.stdout:338: writing smithi14213939-35 from 1936428 to 2457143 tid 2 2020-06-12T02:36:21.249 INFO:tasks.rados.rados.0.smithi142.stdout:339: read oid 22 snap -1 2020-06-12T02:36:21.249 INFO:tasks.rados.rados.0.smithi142.stdout:339: expect (ObjNum 104 snap 22 seq_num 104) 2020-06-12T02:36:21.250 INFO:tasks.rados.rados.0.smithi142.stdout:340: write (excl) oid 36 current snap is 30 2020-06-12T02:36:21.250 INFO:tasks.rados.rados.0.smithi142.stdout:340: seq_num 152 ranges {554664=448555,1478557=664373} 2020-06-12T02:36:21.250 INFO:tasks.rados.rados.0.smithi142.stdout:340: writing smithi14213939-36 from 554664 to 1003219 tid 1 2020-06-12T02:36:21.250 INFO:tasks.rados.rados.0.smithi142.stdout:340: writing smithi14213939-36 from 1478557 to 2142930 tid 2 2020-06-12T02:36:21.250 INFO:tasks.rados.rados.0.smithi142.stdout:341: delete oid 2 current snap is 30 2020-06-12T02:36:21.251 INFO:tasks.rados.rados.0.smithi142.stdout:333: finishing write tid 5 to smithi14213939-31 2020-06-12T02:36:21.251 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 31 v 137 (ObjNum 147 snap 30 seq_num 147) dirty exists 2020-06-12T02:36:21.251 INFO:tasks.rados.rados.0.smithi142.stdout:333: left oid 31 (ObjNum 147 snap 30 seq_num 147) 2020-06-12T02:36:21.251 INFO:tasks.rados.rados.0.smithi142.stdout:334: finishing write tid 2 to smithi14213939-7 2020-06-12T02:36:21.252 INFO:tasks.rados.rados.0.smithi142.stdout:334: finishing write tid 4 to smithi14213939-7 2020-06-12T02:36:21.252 INFO:tasks.rados.rados.0.smithi142.stdout:336: finishing rollback tid 1 to smithi14213939-39 2020-06-12T02:36:21.252 INFO:tasks.rados.rados.0.smithi142.stdout:336: finishing rollback tid 2 to smithi14213939-39 2020-06-12T02:36:21.252 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 39 v 141 (ObjNum 85 snap 12 seq_num 85) dirty exists 2020-06-12T02:36:21.252 INFO:tasks.rados.rados.0.smithi142.stdout:334: finishing write tid 5 to smithi14213939-7 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 73 (ObjNum 148 snap 30 seq_num 148) dirty exists 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:334: left oid 7 (ObjNum 148 snap 30 seq_num 148) 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:337: finishing write tid 1 to smithi14213939-49 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:337: finishing write tid 2 to smithi14213939-49 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:337: finishing write tid 4 to smithi14213939-49 2020-06-12T02:36:21.253 INFO:tasks.rados.rados.0.smithi142.stdout:337: finishing write tid 5 to smithi14213939-49 2020-06-12T02:36:21.254 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 49 v 57 (ObjNum 150 snap 30 seq_num 150) dirty exists 2020-06-12T02:36:21.254 INFO:tasks.rados.rados.0.smithi142.stdout:337: left oid 49 (ObjNum 150 snap 30 seq_num 150) 2020-06-12T02:36:21.254 INFO:tasks.rados.rados.0.smithi142.stdout:338: finishing write tid 1 to smithi14213939-35 2020-06-12T02:36:21.254 INFO:tasks.rados.rados.0.smithi142.stdout:338: finishing write tid 2 to smithi14213939-35 2020-06-12T02:36:21.254 INFO:tasks.rados.rados.0.smithi142.stdout:338: finishing write tid 4 to smithi14213939-35 2020-06-12T02:36:21.255 INFO:tasks.rados.rados.0.smithi142.stdout:338: finishing write tid 5 to smithi14213939-35 2020-06-12T02:36:21.255 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 35 v 134 (ObjNum 151 snap 30 seq_num 151) dirty exists 2020-06-12T02:36:21.255 INFO:tasks.rados.rados.0.smithi142.stdout:338: left oid 35 (ObjNum 151 snap 30 seq_num 151) 2020-06-12T02:36:21.255 INFO:tasks.rados.rados.0.smithi142.stdout:333: done (7 left) 2020-06-12T02:36:21.255 INFO:tasks.rados.rados.0.smithi142.stdout:334: done (6 left) 2020-06-12T02:36:21.256 INFO:tasks.rados.rados.0.smithi142.stdout:336: done (5 left) 2020-06-12T02:36:21.256 INFO:tasks.rados.rados.0.smithi142.stdout:337: done (4 left) 2020-06-12T02:36:21.256 INFO:tasks.rados.rados.0.smithi142.stdout:338: done (3 left) 2020-06-12T02:36:21.256 INFO:tasks.rados.rados.0.smithi142.stdout:341: done (2 left) 2020-06-12T02:36:21.256 INFO:tasks.rados.rados.0.smithi142.stdout:342: write (excl) oid 8 current snap is 30 2020-06-12T02:36:21.257 INFO:tasks.rados.rados.0.smithi142.stdout:342: seq_num 154 ranges {588278=715406,1711874=668042} 2020-06-12T02:36:21.257 INFO:tasks.rados.rados.0.smithi142.stdout:342: writing smithi14213939-8 from 588278 to 1303684 tid 1 2020-06-12T02:36:21.257 INFO:tasks.rados.rados.0.smithi142.stdout:342: writing smithi14213939-8 from 1711874 to 2379916 tid 2 2020-06-12T02:36:21.257 INFO:tasks.rados.rados.0.smithi142.stdout:340: finishing write tid 1 to smithi14213939-36 2020-06-12T02:36:21.257 INFO:tasks.rados.rados.0.smithi142.stdout:343: read oid 43 snap 28 2020-06-12T02:36:21.258 INFO:tasks.rados.rados.0.smithi142.stdout:343: expect deleted 2020-06-12T02:36:21.258 INFO:tasks.rados.rados.0.smithi142.stdout:344: read oid 35 snap 28 2020-06-12T02:36:21.258 INFO:tasks.rados.rados.0.smithi142.stdout:344: expect (ObjNum 75 snap 10 seq_num 75) 2020-06-12T02:36:21.258 INFO:tasks.rados.rados.0.smithi142.stdout:345: snap_remove snap 16 2020-06-12T02:36:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:36:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:20.986+0000 7fe4d53ea700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:20.990+0000 7fe4d53ea700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:21.261 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:21.261 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:21.262 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:21.262 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:21.262 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:21.262 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:21.262 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:21.263 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:21.263 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:21.230+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:21.264 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:21.337 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:21.329+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:21.398 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:21.399 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:21.408 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:21.450 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:21.438+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:21.544 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:21.542+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:21.558 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:21.558 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:21.571 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:21.645 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:21.637+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:21.682 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:21.683 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:21.692 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:21.746 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:21.742+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:21.846 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:21.847 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:21.847 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:21.842+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:21.853 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:21.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:21.945+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:21.961 INFO:tasks.rados.rados.0.smithi142.stdout:345: done (5 left) 2020-06-12T02:36:21.961 INFO:tasks.rados.rados.0.smithi142.stdout:346: read oid 20 snap -1 2020-06-12T02:36:21.962 INFO:tasks.rados.rados.0.smithi142.stdout:346: expect (ObjNum 121 snap 26 seq_num 121) 2020-06-12T02:36:21.962 INFO:tasks.rados.rados.0.smithi142.stdout:347: snap_remove snap 19 2020-06-12T02:36:21.963 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:21.964 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:21.983 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:22.072 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:22.065+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:22.136 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.136 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.145 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:22.187 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:22.181+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:22.257 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:22.254+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:22.260 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.261 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.271 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:22.370 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:22.358+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:22.426 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.426 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.436 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:22.477 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:22.474+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:22.563 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:22.557+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.588 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.597 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:22.664 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:22.658+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:22.704 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.705 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.714 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:22.805 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:22.802+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:22.873 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:22.873 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:22.874 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:22.870+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:22.887 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:22.973 INFO:tasks.rados.rados.0.smithi142.stdout:347: done (6 left) 2020-06-12T02:36:22.974 INFO:tasks.rados.rados.0.smithi142.stdout:348: delete oid 18 current snap is 30 2020-06-12T02:36:22.974 INFO:tasks.rados.rados.0.smithi142.stdout:339: expect (ObjNum 104 snap 22 seq_num 104) 2020-06-12T02:36:22.982 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:22.973+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:23.066 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:23.067 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:23.068 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:23.132 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:23.106+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:23.186 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:23.178+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:23.192 INFO:tasks.rados.rados.0.smithi142.stdout:339: done (6 left) 2020-06-12T02:36:23.192 INFO:tasks.rados.rados.0.smithi142.stdout:348: done (5 left) 2020-06-12T02:36:23.193 INFO:tasks.rados.rados.0.smithi142.stdout:349: rollback oid 33 current snap is 30 2020-06-12T02:36:23.193 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 33 to 27 2020-06-12T02:36:23.193 INFO:tasks.rados.rados.0.smithi142.stdout:342: finishing write tid 1 to smithi14213939-8 2020-06-12T02:36:23.193 INFO:tasks.rados.rados.0.smithi142.stdout:342: finishing write tid 2 to smithi14213939-8 2020-06-12T02:36:23.193 INFO:tasks.rados.rados.0.smithi142.stdout:342: finishing write tid 4 to smithi14213939-8 2020-06-12T02:36:23.195 INFO:tasks.rados.rados.0.smithi142.stdout:342: finishing write tid 5 to smithi14213939-8 2020-06-12T02:36:23.195 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 173 (ObjNum 154 snap 30 seq_num 154) dirty exists 2020-06-12T02:36:23.196 INFO:tasks.rados.rados.0.smithi142.stdout:342: left oid 8 (ObjNum 154 snap 30 seq_num 154) 2020-06-12T02:36:23.196 INFO:tasks.rados.rados.0.smithi142.stdout:344: expect (ObjNum 75 snap 10 seq_num 75) 2020-06-12T02:36:23.238 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:23.238 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:23.246 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:23.278 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:23.279 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:36:23.294 INFO:tasks.rados.rados.0.smithi142.stdout:340: finishing write tid 2 to smithi14213939-36 2020-06-12T02:36:23.295 INFO:tasks.rados.rados.0.smithi142.stdout:340: finishing write tid 4 to smithi14213939-36 2020-06-12T02:36:23.295 INFO:tasks.rados.rados.0.smithi142.stdout:340: finishing write tid 5 to smithi14213939-36 2020-06-12T02:36:23.295 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 138 (ObjNum 152 snap 30 seq_num 152) dirty exists 2020-06-12T02:36:23.296 INFO:tasks.rados.rados.0.smithi142.stdout:340: left oid 36 (ObjNum 152 snap 30 seq_num 152) 2020-06-12T02:36:23.297 INFO:tasks.rados.rados.0.smithi142.stdout:340: done (5 left) 2020-06-12T02:36:23.297 INFO:tasks.rados.rados.0.smithi142.stdout:342: done (4 left) 2020-06-12T02:36:23.297 INFO:tasks.rados.rados.0.smithi142.stdout:343: done (3 left) 2020-06-12T02:36:23.298 INFO:tasks.rados.rados.0.smithi142.stdout:344: done (2 left) 2020-06-12T02:36:23.298 INFO:tasks.rados.rados.0.smithi142.stdout:350: write oid 6 current snap is 30 2020-06-12T02:36:23.298 INFO:tasks.rados.rados.0.smithi142.stdout:350: seq_num 156 ranges {621892=465904,1712485=671711} 2020-06-12T02:36:23.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:23.289+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:23.300 INFO:tasks.rados.rados.0.smithi142.stdout:350: writing smithi14213939-6 from 621892 to 1087796 tid 1 2020-06-12T02:36:23.304 INFO:tasks.rados.rados.0.smithi142.stdout:350: writing smithi14213939-6 from 1712485 to 2384196 tid 2 2020-06-12T02:36:23.304 INFO:tasks.rados.rados.0.smithi142.stdout:351: snap_remove snap 26 2020-06-12T02:36:23.394 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:23.382+0000 7fbac278a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:23.395 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:23.390+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:23.400 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:23.394+0000 7fbac1528700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:23.407 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:23.407 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:23.402+0000 7f8541093700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:23.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:23.406+0000 7f8541093700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:23.417 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:23.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:23.489+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:23.552 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:23.581 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:23.582 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:23.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:23.582 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:23.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.583 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:23.583 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:23.583 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.419410909, 2020-06-12T02:36:23.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:23.584 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.584 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.585 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:23.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.585 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:23.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:23.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:23.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:23.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:23.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:23.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:23.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:23.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:23.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:23.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:23.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:23.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:23.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:23.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:23.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:23.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:23.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:23.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:23.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:23.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.419099406000001, 2020-06-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:23.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:23.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:23.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:23.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:23.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:23.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:23.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:23.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:23.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:23.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:23.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:23.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:23.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:23.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.621 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.626848839000001, 2020-06-12T02:36:23.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:23.623 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.623 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.623 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.623 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.623 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.624 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:23.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.624 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:23.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:23.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:23.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:23.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:23.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:23.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:23.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:23.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:23.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:23.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:23.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:23.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:23.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:23.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:23.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:23.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:23.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.638 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.638 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.638 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:23.639 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:23.639 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.62633216, 2020-06-12T02:36:23.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:23.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.639 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:23.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:23.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:23.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:23.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:23.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:23.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:23.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:23.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:23.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:23.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:23.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:23.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:23.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:23.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:23.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:23.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:23.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:23.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:23.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:23.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:23.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.623825726, 2020-06-12T02:36:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.657 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.657 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.657 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.657 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.657 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:23.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:23.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:23.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:23.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:23.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:23.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:23.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:23.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:23.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:23.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:23.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:23.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:23.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:23.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:23.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:23.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:23.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:23.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.673 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:23.673 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:23.673 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.62364573, 2020-06-12T02:36:23.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:23.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:23.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:23.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:23.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:23.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:23.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:23.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:23.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:23.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:23.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:23.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:23.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:23.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:23.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:23.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:23.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:23.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:23.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:23.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:23.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.687 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.688 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:23.688 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:23.688 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 24.623510637999999, 2020-06-12T02:36:23.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.689 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:23.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.690 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:23.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:23.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:23.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:23.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:23.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:23.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:23.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:23.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:23.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:23.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:23.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:23.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:23.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:23.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:23.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:23.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:23.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:23.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:23.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:23.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:23.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:23.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:23.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.704 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:23.704 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:23.704 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.573920366999999, 2020-06-12T02:36:23.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:23.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.705 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:23.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:23.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:23.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:23.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:23.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:23.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:23.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:23.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:23.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:23.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:23.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:23.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:23.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:23.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:23.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:23.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:23.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:23.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:23.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.718 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.718 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.565873577000001, 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.719 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.720 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:23.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.720 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:23.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:23.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:23.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:23.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:23.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:23.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:23.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:23.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:23.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:23.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:23.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:23.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:23.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:23.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:23.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:23.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:23.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:23.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:23.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:23.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:23.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.738 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.565528213, 2020-06-12T02:36:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:23.739 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.740 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:23.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:23.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:23.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:23.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:23.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:23.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:23.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:23.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:23.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:23.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:23.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:23.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:23.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:23.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:23.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:23.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:23.755 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.756 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.756 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.756 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:23.757 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:23.757 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 23.565396660000001, 2020-06-12T02:36:23.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:23.757 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.757 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.758 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:23.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:23.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:23.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:23.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:23.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:23.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:23.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:23.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:23.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:23.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:23.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.770 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:799 1.8s0 1:16d20421:::smithi14213939-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:23.770 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:23.770 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5709435389999999, 2020-06-12T02:36:23.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001, 2020-06-12T02:36:23.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.771 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.771 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.771 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 799 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:23.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:23.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.163e-05 2020-06-12T02:36:23.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005469+0000", 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5200000000000003e-06 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005478+0000", 2020-06-12T02:36:23.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2224e-05 2020-06-12T02:36:23.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005491+0000", 2020-06-12T02:36:23.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5619999999999997e-06 2020-06-12T02:36:23.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005495+0000", 2020-06-12T02:36:23.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001359306 2020-06-12T02:36:23.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006854+0000", 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109207 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006964+0000", 2020-06-12T02:36:23.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021167133000000001 2020-06-12T02:36:23.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028131+0000", 2020-06-12T02:36:23.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000173494 2020-06-12T02:36:23.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028304+0000", 2020-06-12T02:36:23.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055074019999999998 2020-06-12T02:36:23.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033812+0000", 2020-06-12T02:36:23.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014122200000000001 2020-06-12T02:36:23.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033953+0000", 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012596910000000001 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.035213+0000", 2020-06-12T02:36:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001 2020-06-12T02:36:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.792 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.792 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:830 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:23.792 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:23.793 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.197385852, 2020-06-12T02:36:23.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998, 2020-06-12T02:36:23.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.793 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.793 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 830 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:23.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2907e-05 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379038+0000", 2020-06-12T02:36:23.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5059999999999995e-06 2020-06-12T02:36:23.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379046+0000", 2020-06-12T02:36:23.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.521e-05 2020-06-12T02:36:23.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379062+0000", 2020-06-12T02:36:23.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9580000000000001e-06 2020-06-12T02:36:23.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379069+0000", 2020-06-12T02:36:23.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025736000000000001 2020-06-12T02:36:23.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381642+0000", 2020-06-12T02:36:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8594000000000001e-05 2020-06-12T02:36:23.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381711+0000", 2020-06-12T02:36:23.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028781834999999999 2020-06-12T02:36:23.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410493+0000", 2020-06-12T02:36:23.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998 2020-06-12T02:36:23.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.806 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.807 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:831 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:23.807 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:23.807 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1972523380000002, 2020-06-12T02:36:23.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003, 2020-06-12T02:36:23.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.809 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.809 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 831 2020-06-12T02:36:23.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.809 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:23.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:23.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9319000000000002e-05 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379148+0000", 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.464e-06 2020-06-12T02:36:23.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379152+0000", 2020-06-12T02:36:23.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8990000000000001e-06 2020-06-12T02:36:23.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379160+0000", 2020-06-12T02:36:23.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4769999999999999e-06 2020-06-12T02:36:23.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379164+0000", 2020-06-12T02:36:23.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002823229 2020-06-12T02:36:23.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381987+0000", 2020-06-12T02:36:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010492699999999999 2020-06-12T02:36:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.382092+0000", 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039092202999999999 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.421184+0000", 2020-06-12T02:36:23.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003 2020-06-12T02:36:23.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:842 1.5s0 1:a5b7af70:::smithi14213939-17:head [write 1799494~402223] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1751044610000001, 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001, 2020-06-12T02:36:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.821 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 842 2020-06-12T02:36:23.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.822 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:23.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215639 2020-06-12T02:36:23.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401482+0000", 2020-06-12T02:36:23.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3623e-05 2020-06-12T02:36:23.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401496+0000", 2020-06-12T02:36:23.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2456e-05 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401518+0000", 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1941e-05 2020-06-12T02:36:23.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401530+0000", 2020-06-12T02:36:23.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0344000000000003e-05 2020-06-12T02:36:23.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401600+0000", 2020-06-12T02:36:23.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146625 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401747+0000", 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017748788000000001 2020-06-12T02:36:23.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419496+0000", 2020-06-12T02:36:23.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119141 2020-06-12T02:36:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419615+0000", 2020-06-12T02:36:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010974276999999999 2020-06-12T02:36:23.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.430589+0000", 2020-06-12T02:36:23.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025664110000000002 2020-06-12T02:36:23.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433156+0000", 2020-06-12T02:36:23.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054978220000000003 2020-06-12T02:36:23.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438653+0000", 2020-06-12T02:36:23.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3753999999999998e-05 2020-06-12T02:36:23.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438737+0000", 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:843 1.5s0 1:a5b7af70:::smithi14213939-17:head [setxattr _header (57) in=7b,truncate 2201717] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:23.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:23.838 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1747741260000009, 2020-06-12T02:36:23.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003, 2020-06-12T02:36:23.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 843 2020-06-12T02:36:23.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:23.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1662000000000005e-05 2020-06-12T02:36:23.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401678+0000", 2020-06-12T02:36:23.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.742e-06 2020-06-12T02:36:23.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401685+0000", 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4080000000000001e-06 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401692+0000", 2020-06-12T02:36:23.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2159999999999997e-06 2020-06-12T02:36:23.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401698+0000", 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5162999999999998e-05 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401783+0000", 2020-06-12T02:36:23.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109722 2020-06-12T02:36:23.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401893+0000", 2020-06-12T02:36:23.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018128401999999998 2020-06-12T02:36:23.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420021+0000", 2020-06-12T02:36:23.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015958500000000001 2020-06-12T02:36:23.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420181+0000", 2020-06-12T02:36:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011980408999999999 2020-06-12T02:36:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432161+0000", 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020040430000000001 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.434165+0000", 2020-06-12T02:36:23.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053184800000000004 2020-06-12T02:36:23.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439483+0000", 2020-06-12T02:36:23.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015248599999999999 2020-06-12T02:36:23.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439636+0000", 2020-06-12T02:36:23.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003 2020-06-12T02:36:23.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.855 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:844 1.5s0 1:a5b7af70:::smithi14213939-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:23.855 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:23.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1746229269999997, 2020-06-12T02:36:23.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998, 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.856 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 844 2020-06-12T02:36:23.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.857 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:23.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5605000000000001e-05 2020-06-12T02:36:23.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401793+0000", 2020-06-12T02:36:23.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.331e-06 2020-06-12T02:36:23.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401800+0000", 2020-06-12T02:36:23.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2789000000000001e-05 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401813+0000", 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1390000000000003e-06 2020-06-12T02:36:23.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401818+0000", 2020-06-12T02:36:23.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109048 2020-06-12T02:36:23.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401927+0000", 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010927 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402036+0000", 2020-06-12T02:36:23.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018472145999999998 2020-06-12T02:36:23.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420508+0000", 2020-06-12T02:36:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9551999999999998e-05 2020-06-12T02:36:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420608+0000", 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019833529999999999 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440441+0000", 2020-06-12T02:36:23.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012666700000000001 2020-06-12T02:36:23.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440568+0000", 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010441980000000001 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.441612+0000", 2020-06-12T02:36:23.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998 2020-06-12T02:36:23.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.869 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.870 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:847 1.ds0 1:b3d4b74b:::smithi14213939-29:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:23.870 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:23.870 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1742589779999992, 2020-06-12T02:36:23.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664, 2020-06-12T02:36:23.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.871 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.872 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 847 2020-06-12T02:36:23.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.872 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:23.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4753000000000003e-05 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402157+0000", 2020-06-12T02:36:23.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.55e-06 2020-06-12T02:36:23.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402163+0000", 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1355000000000001e-05 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402174+0000", 2020-06-12T02:36:23.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8770000000000001e-06 2020-06-12T02:36:23.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402179+0000", 2020-06-12T02:36:23.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020908300000000001 2020-06-12T02:36:23.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404270+0000", 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5341999999999997e-05 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404356+0000", 2020-06-12T02:36:23.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026823956999999999 2020-06-12T02:36:23.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.431179+0000", 2020-06-12T02:36:23.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.881 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:898 1.ds0 1:b8c47ae9:::smithi14213939-24:head [copy-from ver 14] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:23.882 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:23.882 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4803044969999997, 2020-06-12T02:36:23.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999, 2020-06-12T02:36:23.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:23.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.883 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 898 2020-06-12T02:36:23.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.884 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:23.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1056000000000005e-05 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096147+0000", 2020-06-12T02:36:23.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1107999999999999e-05 2020-06-12T02:36:23.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096158+0000", 2020-06-12T02:36:23.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8838000000000002e-05 2020-06-12T02:36:23.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096177+0000", 2020-06-12T02:36:23.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.084e-05 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096188+0000", 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206119 2020-06-12T02:36:23.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096394+0000", 2020-06-12T02:36:23.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0744000000000001e-05 2020-06-12T02:36:23.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096405+0000", 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092680699999999998 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105673+0000", 2020-06-12T02:36:23.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000149333 2020-06-12T02:36:23.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105822+0000", 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018170888 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:23.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.123993+0000", 2020-06-12T02:36:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084114589999999996 2020-06-12T02:36:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:23.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.132405+0000", 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00440384 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136809+0000", 2020-06-12T02:36:23.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011938300000000001 2020-06-12T02:36:23.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136928+0000", 2020-06-12T02:36:23.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999 2020-06-12T02:36:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.899 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:899 1.ds0 1:b8c47ae9:::smithi14213939-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:23.899 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:23.899 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4801232899999999, 2020-06-12T02:36:23.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997, 2020-06-12T02:36:23.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:23.900 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:23.901 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:23.901 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:23.901 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:23.901 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 899 2020-06-12T02:36:23.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.903 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:23.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:23.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:23.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:23.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:23.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:23.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9157999999999999e-05 2020-06-12T02:36:23.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:23.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096297+0000", 2020-06-12T02:36:23.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4880000000000001e-06 2020-06-12T02:36:23.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:23.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096304+0000", 2020-06-12T02:36:23.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4187e-05 2020-06-12T02:36:23.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:23.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096318+0000", 2020-06-12T02:36:23.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6979999999999993e-06 2020-06-12T02:36:23.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:23.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096328+0000", 2020-06-12T02:36:23.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014549100000000001 2020-06-12T02:36:23.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096474+0000", 2020-06-12T02:36:23.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8830000000000006e-06 2020-06-12T02:36:23.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:23.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096481+0000", 2020-06-12T02:36:23.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095279739999999998 2020-06-12T02:36:23.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106009+0000", 2020-06-12T02:36:23.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8401999999999999e-05 2020-06-12T02:36:23.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:23.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106088+0000", 2020-06-12T02:36:23.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022632513 2020-06-12T02:36:23.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128720+0000", 2020-06-12T02:36:23.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120066 2020-06-12T02:36:23.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128840+0000", 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093085939999999999 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:23.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138149+0000", 2020-06-12T02:36:23.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134377 2020-06-12T02:36:23.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138283+0000", 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012817500000000001 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:23.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:23.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138411+0000", 2020-06-12T02:36:23.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997 2020-06-12T02:36:23.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.919 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:23.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:23.920 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:23.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:23.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:23.923 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.923 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.923 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.924 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.924 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.924 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.924 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.924 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:23.925 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:23.918+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:23.925 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:23.998 INFO:tasks.rados.rados.0.smithi142.stdout:351: done (3 left) 2020-06-12T02:36:23.999 INFO:tasks.rados.rados.0.smithi142.stdout:352: write (excl) oid 7 current snap is 30 2020-06-12T02:36:23.999 INFO:tasks.rados.rados.0.smithi142.stdout:352: seq_num 157 ranges {638699=541153,1770967=531722} 2020-06-12T02:36:23.999 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:36:24.000 INFO:tasks.rados.rados.0.smithi142.stdout:352: writing smithi14213939-7 from 638699 to 1179852 tid 1 2020-06-12T02:36:24.009 INFO:tasks.rados.rados.0.smithi142.stdout:352: writing smithi14213939-7 from 1770967 to 2302689 tid 2 2020-06-12T02:36:24.009 INFO:tasks.rados.rados.0.smithi142.stdout:353: delete oid 48 current snap is 30 2020-06-12T02:36:24.010 INFO:tasks.rados.rados.0.smithi142.stdout:346: expect (ObjNum 121 snap 26 seq_num 121) 2020-06-12T02:36:24.023 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:24.017+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:24.095 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:24.096 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:24.096 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:24.096 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:24.104 INFO:tasks.rados.rados.0.smithi142.stdout:349: finishing rollback tid 0 to smithi14213939-33 2020-06-12T02:36:24.105 INFO:tasks.rados.rados.0.smithi142.stdout:349: finishing rollback tid 1 to smithi14213939-33 2020-06-12T02:36:24.105 INFO:tasks.rados.rados.0.smithi142.stdout:349: finishing rollback tid 2 to smithi14213939-33 2020-06-12T02:36:24.105 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 33 v 147 (ObjNum 55 snap 3 seq_num 55) dirty exists 2020-06-12T02:36:24.105 INFO:tasks.rados.rados.0.smithi142.stdout:350: finishing write tid 1 to smithi14213939-6 2020-06-12T02:36:24.105 INFO:tasks.rados.rados.0.smithi142.stdout:350: finishing write tid 2 to smithi14213939-6 2020-06-12T02:36:24.106 INFO:tasks.rados.rados.0.smithi142.stdout:346: done (4 left) 2020-06-12T02:36:24.106 INFO:tasks.rados.rados.0.smithi142.stdout:349: done (3 left) 2020-06-12T02:36:24.106 INFO:tasks.rados.rados.0.smithi142.stdout:353: done (2 left) 2020-06-12T02:36:24.106 INFO:tasks.rados.rados.0.smithi142.stdout:354: rollback oid 5 current snap is 30 2020-06-12T02:36:24.106 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 5 to 12 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:350: finishing write tid 4 to smithi14213939-6 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:350: finishing write tid 5 to smithi14213939-6 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 6 v 151 (ObjNum 156 snap 30 seq_num 156) dirty exists 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:350: left oid 6 (ObjNum 156 snap 30 seq_num 156) 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:352: finishing write tid 1 to smithi14213939-7 2020-06-12T02:36:24.107 INFO:tasks.rados.rados.0.smithi142.stdout:352: finishing write tid 2 to smithi14213939-7 2020-06-12T02:36:24.108 INFO:tasks.rados.rados.0.smithi142.stdout:352: finishing write tid 4 to smithi14213939-7 2020-06-12T02:36:24.108 INFO:tasks.rados.rados.0.smithi142.stdout:352: finishing write tid 5 to smithi14213939-7 2020-06-12T02:36:24.108 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 82 (ObjNum 157 snap 30 seq_num 157) dirty exists 2020-06-12T02:36:24.108 INFO:tasks.rados.rados.0.smithi142.stdout:352: left oid 7 (ObjNum 157 snap 30 seq_num 157) 2020-06-12T02:36:24.108 INFO:tasks.rados.rados.0.smithi142.stdout:350: done (2 left) 2020-06-12T02:36:24.109 INFO:tasks.rados.rados.0.smithi142.stdout:352: done (1 left) 2020-06-12T02:36:24.109 INFO:tasks.rados.rados.0.smithi142.stdout:355: read oid 26 snap -1 2020-06-12T02:36:24.109 INFO:tasks.rados.rados.0.smithi142.stdout:355: expect (ObjNum 138 snap 28 seq_num 138) 2020-06-12T02:36:24.109 INFO:tasks.rados.rados.0.smithi142.stdout:356: snap_remove snap 28 2020-06-12T02:36:24.110 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:24.124 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:24.117+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:24.207 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:24.207 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:24.207 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:24.207 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:24.208 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:24.216 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:24.259 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:36:24.260 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:36:24.261 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-06-12T02:36:24.262 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:24.258+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:24.325 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:24.322+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:24.329 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:24.330 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:24.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:24.330 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:24.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.330 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:24.331 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:24.331 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.202357270999997, 2020-06-12T02:36:24.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:24.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.332 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.340 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:24.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.340 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:24.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:24.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:24.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:24.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:24.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:24.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:24.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:24.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:24.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:24.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:24.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:24.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:24.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:24.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:24.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:24.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:24.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.202133828999997, 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.359 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:24.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.360 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:24.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:24.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:24.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:24.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:24.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:24.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:24.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:24.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:24.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:24.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:24.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:24.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:24.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:24.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:24.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:24.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:24.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:24.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.373 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:24.374 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:24.374 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.159654719999999, 2020-06-12T02:36:24.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:24.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:24.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:24.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:24.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:24.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:24.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:24.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:24.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:24.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:24.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:24.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:24.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:24.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:24.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:24.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:24.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:24.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:24.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:24.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:24.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:24.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.395 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.396 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:24.396 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:24.396 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.159319826000001, 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.398 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:24.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.398 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:24.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:24.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:24.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:24.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:24.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:24.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:24.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:24.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:24.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:24.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:24.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:24.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:24.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:24.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:24.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:24.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:24.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:24.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:24.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:24.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:24.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:24.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:24.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:24.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:24.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:24.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.418 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:24.418 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:24.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9584439430000007, 2020-06-12T02:36:24.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:36:24.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.420 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:36:24.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:24.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:36:24.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:36:24.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:36:24.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:36:24.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:36:24.435 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.436 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9582841299999991, 2020-06-12T02:36:24.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.439 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:36:24.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:36:24.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:36:24.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:36:24.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:36:24.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:36:24.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:36:24.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:36:24.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:36:24.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:36:24.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:36:24.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:36:24.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:36:24.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:36:24.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:36:24.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:36:24.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.455 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.455 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.455 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:24.456 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:24.456 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.958203417, 2020-06-12T02:36:24.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:36:24.456 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.457 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:36:24.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.458 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:24.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:36:24.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:36:24.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:36:24.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:36:24.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:36:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:36:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:36:24.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:36:24.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:36:24.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:36:24.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:24.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:36:24.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:36:24.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:36:24.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.469 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.471 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:24.471 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:24.471 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9579568639999998, 2020-06-12T02:36:24.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:36:24.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.472 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.472 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:36:24.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.474 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:24.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:24.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:36:24.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:36:24.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:36:24.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:36:24.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:36:24.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:36:24.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:36:24.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:36:24.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:36:24.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:36:24.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:36:24.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:36:24.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:36:24.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:36:24.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:36:24.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:24.488 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:24.488 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9446065410000006, 2020-06-12T02:36:24.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:36:24.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:36:24.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:24.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:24.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:36:24.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:36:24.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:36:24.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:36:24.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:36:24.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:36:24.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:36:24.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:36:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:36:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:36:24.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:36:24.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:24.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:36:24.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:36:24.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:36:24.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:36:24.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:36:24.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.506 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9444202869999998, 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.508 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:36:24.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:24.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:24.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:36:24.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:36:24.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:36:24.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:36:24.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:36:24.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:36:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:36:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:36:24.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:36:24.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:36:24.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:36:24.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:36:24.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:36:24.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9442195760000001, 2020-06-12T02:36:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:36:24.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.522 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:36:24.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.523 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:36:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:36:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:36:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:36:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:36:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:36:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:36:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:36:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:36:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:36:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:36:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:36:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:36:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:36:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:36:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3517316150000003, 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:36:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:36:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:36:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:36:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:36:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:36:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:36:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:36:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:36:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:36:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:36:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:36:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:36:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:36:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3513078680000001, 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:36:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:36:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:36:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:36:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:36:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:36:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:36:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:36:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:36:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:36:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:36:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:36:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:36:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3511540100000001, 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:36:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:36:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:36:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:36:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:36:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:36:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:36:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:36:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:36:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:36:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:36:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3484232220000001, 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:36:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:36:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:36:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:36:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:36:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:36:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:36:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:36:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:36:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:36:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:36:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3480028949999996, 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:36:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:36:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:36:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:36:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:36:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:36:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:36:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:36:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:36:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:36:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:36:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:36:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:36:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3479080620000001, 2020-06-12T02:36:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:36:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:36:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:36:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:36:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:36:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:36:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:36:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:36:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:36:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:36:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:36:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:36:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.31812870799999998, 2020-06-12T02:36:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:36:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:36:24.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:36:24.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:36:24.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:36:24.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:36:24.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:36:24.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:36:24.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:36:24.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:36:24.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:36:24.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:36:24.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:36:24.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:36:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:36:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:36:24.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:36:24.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:36:24.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:36:24.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:36:24.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:36:24.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.634 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.635 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:24.635 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:24.635 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.31766309500000001, 2020-06-12T02:36:24.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.636 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:36:24.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.637 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:24.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:36:24.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:36:24.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:36:24.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:36:24.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:36:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:36:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:36:24.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:36:24.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:36:24.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:36:24.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:24.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:36:24.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:36:24.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:24.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:36:24.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:36:24.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:36:24.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:36:24.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.31748915999999999, 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:36:24.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:24.652 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:24.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:24.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:24.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:24.653 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:36:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:24.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:24.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:24.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:24.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:24.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:36:24.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:24.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:36:24.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:36:24.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:24.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:36:24.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:36:24.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:24.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:36:24.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:24.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:36:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:36:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:36:24.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:36:24.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:24.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:36:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:36:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:36:24.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:36:24.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:24.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:36:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:36:24.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.668 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.670 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:24.672 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:24.354+0000 7fc425b22700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:24.672 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:24.366+0000 7fc425b22700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:24.673 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:24.673 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:24.673 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 77, 2020-06-12T02:36:24.673 INFO:teuthology.orchestra.run.smithi142.stdout: "fsid": "c120ba75-2438-45f0-aa6e-10a350976a3c", 2020-06-12T02:36:24.674 INFO:teuthology.orchestra.run.smithi142.stdout: "created": "2020-06-12T02:35:00.134323+0000", 2020-06-12T02:36:24.674 INFO:teuthology.orchestra.run.smithi142.stdout: "modified": "2020-06-12T02:36:23.970272+0000", 2020-06-12T02:36:24.674 INFO:teuthology.orchestra.run.smithi142.stdout: "last_up_change": "2020-06-12T02:35:08.937742+0000", 2020-06-12T02:36:24.674 INFO:teuthology.orchestra.run.smithi142.stdout: "last_in_change": "2020-06-12T02:35:57.937806+0000", 2020-06-12T02:36:24.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-06-12T02:36:24.675 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_num": 5806080, 2020-06-12T02:36:24.675 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_set": [ 2020-06-12T02:36:24.675 INFO:teuthology.orchestra.run.smithi142.stdout: "nodeep-scrub", 2020-06-12T02:36:24.675 INFO:teuthology.orchestra.run.smithi142.stdout: "noscrub", 2020-06-12T02:36:24.675 INFO:teuthology.orchestra.run.smithi142.stdout: "pglog_hardlimit", 2020-06-12T02:36:24.676 INFO:teuthology.orchestra.run.smithi142.stdout: "purged_snapdirs", 2020-06-12T02:36:24.676 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_deletes", 2020-06-12T02:36:24.676 INFO:teuthology.orchestra.run.smithi142.stdout: "sortbitwise" 2020-06-12T02:36:24.676 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.676 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_version": 6, 2020-06-12T02:36:24.677 INFO:teuthology.orchestra.run.smithi142.stdout: "full_ratio": 0.94999998807907104, 2020-06-12T02:36:24.677 INFO:teuthology.orchestra.run.smithi142.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-06-12T02:36:24.677 INFO:teuthology.orchestra.run.smithi142.stdout: "nearfull_ratio": 0.85000002384185791, 2020-06-12T02:36:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_snapshot": "", 2020-06-12T02:36:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_max": 1, 2020-06-12T02:36:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd": 8, 2020-06-12T02:36:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: "require_min_compat_client": "jewel", 2020-06-12T02:36:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: "min_compat_client": "jewel", 2020-06-12T02:36:24.679 INFO:teuthology.orchestra.run.smithi142.stdout: "require_osd_release": "octopus", 2020-06-12T02:36:24.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pools": [ 2020-06-12T02:36:24.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.679 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:24.680 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": "unique_pool_0", 2020-06-12T02:36:24.680 INFO:teuthology.orchestra.run.smithi142.stdout: "create_time": "2020-06-12T02:35:23.053307+0000", 2020-06-12T02:36:24.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 8197, 2020-06-12T02:36:24.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flags_names": "hashpspool,ec_overwrites,selfmanaged_snaps", 2020-06-12T02:36:24.680 INFO:teuthology.orchestra.run.smithi142.stdout: "type": 3, 2020-06-12T02:36:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 3, 2020-06-12T02:36:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": 2, 2020-06-12T02:36:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_rule": 1, 2020-06-12T02:36:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: "object_hash": 2, 2020-06-12T02:36:24.681 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscale_mode": "off", 2020-06-12T02:36:24.682 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": 16, 2020-06-12T02:36:24.683 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num": 16, 2020-06-12T02:36:24.683 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_placement_num_target": 16, 2020-06-12T02:36:24.684 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_target": 16, 2020-06-12T02:36:24.684 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num_pending": 16, 2020-06-12T02:36:24.684 INFO:teuthology.orchestra.run.smithi142.stdout: "last_pg_merge_meta": { 2020-06-12T02:36:24.684 INFO:teuthology.orchestra.run.smithi142.stdout: "source_pgid": "0.0", 2020-06-12T02:36:24.684 INFO:teuthology.orchestra.run.smithi142.stdout: "ready_epoch": 0, 2020-06-12T02:36:24.685 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_started": 0, 2020-06-12T02:36:24.685 INFO:teuthology.orchestra.run.smithi142.stdout: "last_epoch_clean": 0, 2020-06-12T02:36:24.685 INFO:teuthology.orchestra.run.smithi142.stdout: "source_version": "0'0", 2020-06-12T02:36:24.685 INFO:teuthology.orchestra.run.smithi142.stdout: "target_version": "0'0" 2020-06-12T02:36:24.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.686 INFO:teuthology.orchestra.run.smithi142.stdout: "last_change": "77", 2020-06-12T02:36:24.686 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend": "0", 2020-06-12T02:36:24.686 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_prenautilus": "0", 2020-06-12T02:36:24.686 INFO:teuthology.orchestra.run.smithi142.stdout: "last_force_op_resend_preluminous": "0", 2020-06-12T02:36:24.686 INFO:teuthology.orchestra.run.smithi142.stdout: "auid": 0, 2020-06-12T02:36:24.687 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_mode": "selfmanaged", 2020-06-12T02:36:24.687 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_seq": 56, 2020-06-12T02:36:24.687 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_epoch": 77, 2020-06-12T02:36:24.687 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_snaps": [], 2020-06-12T02:36:24.687 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps": "[]", 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_bytes": 0, 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "quota_max_objects": 0, 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "tiers": [], 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "tier_of": -1, 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "read_tier": -1, 2020-06-12T02:36:24.688 INFO:teuthology.orchestra.run.smithi142.stdout: "write_tier": -1, 2020-06-12T02:36:24.689 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_mode": "none", 2020-06-12T02:36:24.689 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_bytes": 0, 2020-06-12T02:36:24.689 INFO:teuthology.orchestra.run.smithi142.stdout: "target_max_objects": 0, 2020-06-12T02:36:24.689 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-06-12T02:36:24.689 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-06-12T02:36:24.690 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_target_full_ratio_micro": 800000, 2020-06-12T02:36:24.690 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_flush_age": 0, 2020-06-12T02:36:24.690 INFO:teuthology.orchestra.run.smithi142.stdout: "cache_min_evict_age": 0, 2020-06-12T02:36:24.690 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profile": "teuthologyprofile", 2020-06-12T02:36:24.691 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_params": { 2020-06-12T02:36:24.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "none" 2020-06-12T02:36:24.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.691 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_period": 0, 2020-06-12T02:36:24.691 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_count": 0, 2020-06-12T02:36:24.692 INFO:teuthology.orchestra.run.smithi142.stdout: "use_gmt_hitset": true, 2020-06-12T02:36:24.692 INFO:teuthology.orchestra.run.smithi142.stdout: "min_read_recency_for_promote": 0, 2020-06-12T02:36:24.692 INFO:teuthology.orchestra.run.smithi142.stdout: "min_write_recency_for_promote": 0, 2020-06-12T02:36:24.692 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_grade_decay_rate": 0, 2020-06-12T02:36:24.692 INFO:teuthology.orchestra.run.smithi142.stdout: "hit_set_search_last_n": 0, 2020-06-12T02:36:24.693 INFO:teuthology.orchestra.run.smithi142.stdout: "grade_table": [], 2020-06-12T02:36:24.693 INFO:teuthology.orchestra.run.smithi142.stdout: "stripe_width": 8192, 2020-06-12T02:36:24.693 INFO:teuthology.orchestra.run.smithi142.stdout: "expected_num_objects": 0, 2020-06-12T02:36:24.693 INFO:teuthology.orchestra.run.smithi142.stdout: "fast_read": false, 2020-06-12T02:36:24.693 INFO:teuthology.orchestra.run.smithi142.stdout: "options": {}, 2020-06-12T02:36:24.694 INFO:teuthology.orchestra.run.smithi142.stdout: "application_metadata": { 2020-06-12T02:36:24.694 INFO:teuthology.orchestra.run.smithi142.stdout: "rados": {} 2020-06-12T02:36:24.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.694 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.695 INFO:teuthology.orchestra.run.smithi142.stdout: "osds": [ 2020-06-12T02:36:24.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.695 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:36:24.695 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c", 2020-06-12T02:36:24.695 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.698 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.698 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.698 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.698 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.699 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:24.699 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 54, 2020-06-12T02:36:24.699 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.699 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.699 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.700 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.700 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6810", 2020-06-12T02:36:24.700 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.701 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6811", 2020-06-12T02:36:24.701 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.702 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.702 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.702 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.702 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.703 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.703 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6812", 2020-06-12T02:36:24.703 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.705 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6813", 2020-06-12T02:36:24.705 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.706 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.706 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.707 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6816", 2020-06-12T02:36:24.707 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.708 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.708 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6817", 2020-06-12T02:36:24.708 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.709 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.709 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6814", 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.711 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6815", 2020-06-12T02:36:24.711 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12037 2020-06-12T02:36:24.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.712 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6811/12037", 2020-06-12T02:36:24.712 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6813/12037", 2020-06-12T02:36:24.712 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6817/12037", 2020-06-12T02:36:24.712 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6815/12037", 2020-06-12T02:36:24.712 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.713 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:36:24.714 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "74343e4c-0406-4803-8619-520cbc1c60db", 2020-06-12T02:36:24.714 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.714 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 0, 2020-06-12T02:36:24.714 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 0, 2020-06-12T02:36:24.714 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.715 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.715 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.715 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:24.715 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 18, 2020-06-12T02:36:24.715 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.716 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6802", 2020-06-12T02:36:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.717 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6803", 2020-06-12T02:36:24.718 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.718 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.718 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6804", 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6805", 2020-06-12T02:36:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.721 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.721 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.721 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6808", 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6809", 2020-06-12T02:36:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6806", 2020-06-12T02:36:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.725 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.725 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6807", 2020-06-12T02:36:24.725 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12047 2020-06-12T02:36:24.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.728 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6803/12047", 2020-06-12T02:36:24.728 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6805/12047", 2020-06-12T02:36:24.728 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6809/12047", 2020-06-12T02:36:24.728 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6807/12047", 2020-06-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "18348953-2ab3-44d7-9812-308a4e504ffd", 2020-06-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.737 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6818", 2020-06-12T02:36:24.737 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.738 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.738 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6819", 2020-06-12T02:36:24.738 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.739 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.739 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.741 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.742 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.742 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.742 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6820", 2020-06-12T02:36:24.743 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.746 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.746 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6821", 2020-06-12T02:36:24.747 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.747 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.747 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.748 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.748 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.748 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.748 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6824", 2020-06-12T02:36:24.749 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.750 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6825", 2020-06-12T02:36:24.751 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.751 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.752 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.752 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.752 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6822", 2020-06-12T02:36:24.752 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6823", 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12038 2020-06-12T02:36:24.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.754 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.754 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6819/12038", 2020-06-12T02:36:24.754 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6821/12038", 2020-06-12T02:36:24.754 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6825/12038", 2020-06-12T02:36:24.755 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6823/12038", 2020-06-12T02:36:24.755 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.755 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.755 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.755 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.756 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:36:24.756 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "318d0252-36b6-489c-8cc7-eb5245346db4", 2020-06-12T02:36:24.756 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.757 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.757 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.757 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.757 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.758 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.758 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:24.758 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:24.758 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.758 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.759 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.759 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6826", 2020-06-12T02:36:24.760 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.761 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6827", 2020-06-12T02:36:24.761 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.761 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.761 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6828", 2020-06-12T02:36:24.763 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.763 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6829", 2020-06-12T02:36:24.764 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.764 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.764 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.764 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.765 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.765 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6832", 2020-06-12T02:36:24.765 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.766 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6833", 2020-06-12T02:36:24.766 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.768 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.768 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6830", 2020-06-12T02:36:24.769 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.769 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6831", 2020-06-12T02:36:24.770 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12048 2020-06-12T02:36:24.770 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.770 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.771 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.142:6827/12048", 2020-06-12T02:36:24.771 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.142:6829/12048", 2020-06-12T02:36:24.771 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.142:6833/12048", 2020-06-12T02:36:24.771 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.142:6831/12048", 2020-06-12T02:36:24.771 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "e622cde1-ff3b-4df8-9e70-640bb7ce27fd", 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.773 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.774 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.774 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.774 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:24.774 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:24.774 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.775 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.775 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.775 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6800", 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.776 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6801", 2020-06-12T02:36:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.778 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.778 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.779 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6802", 2020-06-12T02:36:24.779 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.780 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6803", 2020-06-12T02:36:24.780 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.782 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6806", 2020-06-12T02:36:24.783 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.784 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6807", 2020-06-12T02:36:24.784 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.785 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.785 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6804", 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.786 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6805", 2020-06-12T02:36:24.787 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12021 2020-06-12T02:36:24.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.787 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6801/12021", 2020-06-12T02:36:24.788 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6803/12021", 2020-06-12T02:36:24.788 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6807/12021", 2020-06-12T02:36:24.788 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6805/12021", 2020-06-12T02:36:24.788 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.789 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.789 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.790 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:36:24.790 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "f7d22a59-77a8-4264-888e-3e486a4c0d82", 2020-06-12T02:36:24.790 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.790 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.790 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.792 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.792 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.792 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.792 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 13, 2020-06-12T02:36:24.792 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:24.793 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.793 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.794 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.794 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6808", 2020-06-12T02:36:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.796 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6811", 2020-06-12T02:36:24.796 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.797 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.797 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.798 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6814", 2020-06-12T02:36:24.798 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.804 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6817", 2020-06-12T02:36:24.804 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.805 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.806 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6823", 2020-06-12T02:36:24.807 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6828", 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.808 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.809 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.809 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.809 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6820", 2020-06-12T02:36:24.809 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6822", 2020-06-12T02:36:24.810 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12020 2020-06-12T02:36:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6811/12020", 2020-06-12T02:36:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6817/12020", 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6828/12020", 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6822/12020", 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.813 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:36:24.813 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "60e271cc-4c4c-4397-87be-8c52ffab68d4", 2020-06-12T02:36:24.814 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.814 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.814 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.814 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.815 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.815 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.815 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:24.815 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 53, 2020-06-12T02:36:24.815 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.816 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6809", 2020-06-12T02:36:24.817 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.818 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6812", 2020-06-12T02:36:24.818 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.818 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.819 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6815", 2020-06-12T02:36:24.820 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.820 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6818", 2020-06-12T02:36:24.821 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.821 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6830", 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.823 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6831", 2020-06-12T02:36:24.823 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.824 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.824 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.825 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.825 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6825", 2020-06-12T02:36:24.825 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6826", 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12022 2020-06-12T02:36:24.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.827 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6812/12022", 2020-06-12T02:36:24.828 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6818/12022", 2020-06-12T02:36:24.828 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6831/12022", 2020-06-12T02:36:24.828 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6826/12022", 2020-06-12T02:36:24.828 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.828 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.829 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.829 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:36:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: "uuid": "0f243681-edad-4e3d-9980-cfc55c5f93ab", 2020-06-12T02:36:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: "up": 1, 2020-06-12T02:36:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: "in": 1, 2020-06-12T02:36:24.830 INFO:teuthology.orchestra.run.smithi142.stdout: "weight": 1, 2020-06-12T02:36:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_affinity": 1, 2020-06-12T02:36:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_begin": 0, 2020-06-12T02:36:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: "last_clean_end": 0, 2020-06-12T02:36:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: "up_from": 14, 2020-06-12T02:36:24.831 INFO:teuthology.orchestra.run.smithi142.stdout: "up_thru": 51, 2020-06-12T02:36:24.832 INFO:teuthology.orchestra.run.smithi142.stdout: "down_at": 0, 2020-06-12T02:36:24.832 INFO:teuthology.orchestra.run.smithi142.stdout: "lost_at": 0, 2020-06-12T02:36:24.832 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addrs": { 2020-06-12T02:36:24.832 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.833 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.833 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6810", 2020-06-12T02:36:24.833 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.834 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6813", 2020-06-12T02:36:24.834 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.836 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addrs": { 2020-06-12T02:36:24.836 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.837 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6816", 2020-06-12T02:36:24.837 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.838 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6819", 2020-06-12T02:36:24.838 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.838 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.839 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addrs": { 2020-06-12T02:36:24.839 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.839 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6827", 2020-06-12T02:36:24.840 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.841 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6829", 2020-06-12T02:36:24.841 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.841 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.842 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addrs": { 2020-06-12T02:36:24.842 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2020-06-12T02:36:24.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.842 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2020-06-12T02:36:24.842 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6821", 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.117:6824", 2020-06-12T02:36:24.843 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 12023 2020-06-12T02:36:24.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.844 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.844 INFO:teuthology.orchestra.run.smithi142.stdout: "public_addr": "172.21.15.117:6813/12023", 2020-06-12T02:36:24.844 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_addr": "172.21.15.117:6819/12023", 2020-06-12T02:36:24.845 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_back_addr": "172.21.15.117:6829/12023", 2020-06-12T02:36:24.845 INFO:teuthology.orchestra.run.smithi142.stdout: "heartbeat_front_addr": "172.21.15.117:6824/12023", 2020-06-12T02:36:24.845 INFO:teuthology.orchestra.run.smithi142.stdout: "state": [ 2020-06-12T02:36:24.845 INFO:teuthology.orchestra.run.smithi142.stdout: "exists", 2020-06-12T02:36:24.845 INFO:teuthology.orchestra.run.smithi142.stdout: "up" 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_xinfo": [ 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.846 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 0, 2020-06-12T02:36:24.847 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.847 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.847 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.847 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.847 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.848 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.988040+0000", 2020-06-12T02:36:24.848 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.848 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 1, 2020-06-12T02:36:24.849 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.849 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.849 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.849 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.849 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 65536, 2020-06-12T02:36:24.850 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.578658+0000", 2020-06-12T02:36:24.850 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.851 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 2, 2020-06-12T02:36:24.851 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.851 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.851 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.851 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.852 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.852 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.294920+0000", 2020-06-12T02:36:24.852 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.854 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 3, 2020-06-12T02:36:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.855 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.856 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:08.017776+0000", 2020-06-12T02:36:24.856 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.856 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 4, 2020-06-12T02:36:24.857 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.857 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.857 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:06.919687+0000", 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.859 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 5, 2020-06-12T02:36:24.859 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.859 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.859 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.859 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.860 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.860 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.053961+0000", 2020-06-12T02:36:24.860 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.861 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 6, 2020-06-12T02:36:24.861 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.861 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.861 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.861 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.862 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.862 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.210941+0000", 2020-06-12T02:36:24.862 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": 7, 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "down_stamp": "0.000000", 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_probability": 0, 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "laggy_interval": 0, 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "features": 4540138292836696063, 2020-06-12T02:36:24.863 INFO:teuthology.orchestra.run.smithi142.stdout: "old_weight": 0, 2020-06-12T02:36:24.864 INFO:teuthology.orchestra.run.smithi142.stdout: "last_purged_snaps_scrub": "2020-06-12T02:36:07.971670+0000", 2020-06-12T02:36:24.864 INFO:teuthology.orchestra.run.smithi142.stdout: "dead_epoch": 0 2020-06-12T02:36:24.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.864 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.864 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap": [], 2020-06-12T02:36:24.865 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_upmap_items": [], 2020-06-12T02:36:24.865 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_temp": [], 2020-06-12T02:36:24.865 INFO:teuthology.orchestra.run.smithi142.stdout: "primary_temp": [], 2020-06-12T02:36:24.865 INFO:teuthology.orchestra.run.smithi142.stdout: "blacklist": {}, 2020-06-12T02:36:24.865 INFO:teuthology.orchestra.run.smithi142.stdout: "erasure_code_profiles": { 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "default": { 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:36:24.866 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:36:24.867 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van" 2020-06-12T02:36:24.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.867 INFO:teuthology.orchestra.run.smithi142.stdout: "teuthologyprofile": { 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-device-class": "", 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-failure-domain": "osd", 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-root": "default", 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "jerasure-per-chunk-alignment": "false", 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "k": "2", 2020-06-12T02:36:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: "m": "1", 2020-06-12T02:36:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: "plugin": "jerasure", 2020-06-12T02:36:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: "ruleset-failure-domain": "osd", 2020-06-12T02:36:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: "technique": "reed_sol_van", 2020-06-12T02:36:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: "w": "8" 2020-06-12T02:36:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.870 INFO:teuthology.orchestra.run.smithi142.stdout: "removed_snaps_queue": [ 2020-06-12T02:36:24.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.870 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:24.870 INFO:teuthology.orchestra.run.smithi142.stdout: "snaps": [ 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 30, 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 35, 2020-06-12T02:36:24.872 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.872 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 37, 2020-06-12T02:36:24.872 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.873 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 43, 2020-06-12T02:36:24.873 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 46, 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.874 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 48, 2020-06-12T02:36:24.875 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.875 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.875 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.876 INFO:teuthology.orchestra.run.smithi142.stdout: "new_removed_snaps": [ 2020-06-12T02:36:24.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.876 INFO:teuthology.orchestra.run.smithi142.stdout: "pool": 1, 2020-06-12T02:36:24.876 INFO:teuthology.orchestra.run.smithi142.stdout: "snaps": [ 2020-06-12T02:36:24.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:24.877 INFO:teuthology.orchestra.run.smithi142.stdout: "begin": 48, 2020-06-12T02:36:24.877 INFO:teuthology.orchestra.run.smithi142.stdout: "length": 1 2020-06-12T02:36:24.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.877 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:24.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:24.878 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2020-06-12T02:36:24.878 INFO:teuthology.orchestra.run.smithi142.stdout: "new_purged_snaps": [], 2020-06-12T02:36:24.878 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_node_flags": {}, 2020-06-12T02:36:24.878 INFO:teuthology.orchestra.run.smithi142.stdout: "device_class_flags": {} 2020-06-12T02:36:24.879 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:24.880 INFO:tasks.thrashosds.thrasher:j is {'epoch': 77, 'fsid': 'c120ba75-2438-45f0-aa6e-10a350976a3c', 'created': '2020-06-12T02:35:00.134323+0000', 'modified': '2020-06-12T02:36:23.970272+0000', 'last_up_change': '2020-06-12T02:35:08.937742+0000', 'last_in_change': '2020-06-12T02:35:57.937806+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 1, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'unique_pool_0', 'create_time': '2020-06-12T02:35:23.053307+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 3, 'min_size': 2, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 56, 'snap_epoch': 77, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'teuthologyprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 54, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6810', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6811', 'nonce': 12037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6812', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6813', 'nonce': 12037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6816', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6817', 'nonce': 12037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6814', 'nonce': 12037}, {'type': 'v1', 'addr': '172.21.15.142:6815', 'nonce': 12037}]}, 'public_addr': '172.21.15.142:6811/12037', 'cluster_addr': '172.21.15.142:6813/12037', 'heartbeat_back_addr': '172.21.15.142:6817/12037', 'heartbeat_front_addr': '172.21.15.142:6815/12037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '74343e4c-0406-4803-8619-520cbc1c60db', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 12047}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 12047}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6808', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6809', 'nonce': 12047}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 12047}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 12047}]}, 'public_addr': '172.21.15.142:6803/12047', 'cluster_addr': '172.21.15.142:6805/12047', 'heartbeat_back_addr': '172.21.15.142:6809/12047', 'heartbeat_front_addr': '172.21.15.142:6807/12047', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18348953-2ab3-44d7-9812-308a4e504ffd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6818', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6819', 'nonce': 12038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6820', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6821', 'nonce': 12038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6824', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6825', 'nonce': 12038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6822', 'nonce': 12038}, {'type': 'v1', 'addr': '172.21.15.142:6823', 'nonce': 12038}]}, 'public_addr': '172.21.15.142:6819/12038', 'cluster_addr': '172.21.15.142:6821/12038', 'heartbeat_back_addr': '172.21.15.142:6825/12038', 'heartbeat_front_addr': '172.21.15.142:6823/12038', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '318d0252-36b6-489c-8cc7-eb5245346db4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6826', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6827', 'nonce': 12048}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6828', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6829', 'nonce': 12048}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 12048}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6830', 'nonce': 12048}, {'type': 'v1', 'addr': '172.21.15.142:6831', 'nonce': 12048}]}, 'public_addr': '172.21.15.142:6827/12048', 'cluster_addr': '172.21.15.142:6829/12048', 'heartbeat_back_addr': '172.21.15.142:6833/12048', 'heartbeat_front_addr': '172.21.15.142:6831/12048', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'e622cde1-ff3b-4df8-9e70-640bb7ce27fd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6800', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6801', 'nonce': 12021}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6802', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6803', 'nonce': 12021}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6806', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6807', 'nonce': 12021}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6804', 'nonce': 12021}, {'type': 'v1', 'addr': '172.21.15.117:6805', 'nonce': 12021}]}, 'public_addr': '172.21.15.117:6801/12021', 'cluster_addr': '172.21.15.117:6803/12021', 'heartbeat_back_addr': '172.21.15.117:6807/12021', 'heartbeat_front_addr': '172.21.15.117:6805/12021', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f7d22a59-77a8-4264-888e-3e486a4c0d82', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6808', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6811', 'nonce': 12020}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6814', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6817', 'nonce': 12020}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6823', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6828', 'nonce': 12020}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6820', 'nonce': 12020}, {'type': 'v1', 'addr': '172.21.15.117:6822', 'nonce': 12020}]}, 'public_addr': '172.21.15.117:6811/12020', 'cluster_addr': '172.21.15.117:6817/12020', 'heartbeat_back_addr': '172.21.15.117:6828/12020', 'heartbeat_front_addr': '172.21.15.117:6822/12020', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '60e271cc-4c4c-4397-87be-8c52ffab68d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 53, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6809', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6812', 'nonce': 12022}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6815', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6818', 'nonce': 12022}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6830', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6831', 'nonce': 12022}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6825', 'nonce': 12022}, {'type': 'v1', 'addr': '172.21.15.117:6826', 'nonce': 12022}]}, 'public_addr': '172.21.15.117:6812/12022', 'cluster_addr': '172.21.15.117:6818/12022', 'heartbeat_back_addr': '172.21.15.117:6831/12022', 'heartbeat_front_addr': '172.21.15.117:6826/12022', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0f243681-edad-4e3d-9980-cfc55c5f93ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 51, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6810', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6813', 'nonce': 12023}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6816', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6819', 'nonce': 12023}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6827', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6829', 'nonce': 12023}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6821', 'nonce': 12023}, {'type': 'v1', 'addr': '172.21.15.117:6824', 'nonce': 12023}]}, 'public_addr': '172.21.15.117:6813/12023', 'cluster_addr': '172.21.15.117:6819/12023', 'heartbeat_back_addr': '172.21.15.117:6829/12023', 'heartbeat_front_addr': '172.21.15.117:6824/12023', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.988040+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.578658+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.294920+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:08.017776+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:06.919687+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.053961+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.210941+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292836696063, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-06-12T02:36:07.971670+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}, 'teuthologyprofile': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van', 'w': '8'}}, 'removed_snaps_queue': [{'pool': 1, 'snaps': [{'begin': 30, 'length': 1}, {'begin': 35, 'length': 1}, {'begin': 37, 'length': 1}, {'begin': 43, 'length': 1}, {'begin': 46, 'length': 1}, {'begin': 48, 'length': 1}]}], 'new_removed_snaps': [{'pool': 1, 'snaps': [{'begin': 48, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-06-12T02:36:24.882 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:24.883 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:24.666+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:24.883 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:24.885 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:24.882+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:24.944 INFO:tasks.rados.rados.0.smithi142.stdout:356: done (2 left) 2020-06-12T02:36:24.945 INFO:tasks.rados.rados.0.smithi142.stdout:357: delete oid 46 current snap is 30 2020-06-12T02:36:24.945 INFO:tasks.rados.rados.0.smithi142.stdout:354: finishing rollback tid 0 to smithi14213939-5 2020-06-12T02:36:24.945 INFO:tasks.rados.rados.0.smithi142.stdout:355: expect (ObjNum 138 snap 28 seq_num 138) 2020-06-12T02:36:24.986 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:24.981+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:25.011 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:24.998+0000 7f41f6d2b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:25.012 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:25.006+0000 7f41f5ac9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:25.014 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:25.015 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:25.029 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:25.068 INFO:tasks.rados.rados.0.smithi142.stdout:354: finishing rollback tid 1 to smithi14213939-5 2020-06-12T02:36:25.068 INFO:tasks.rados.rados.0.smithi142.stdout:354: finishing rollback tid 2 to smithi14213939-5 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 5 v 150 (ObjNum 83 snap 12 seq_num 83) dirty exists 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:354: done (2 left) 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:355: done (1 left) 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:357: done (0 left) 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:358: read oid 12 snap 20 2020-06-12T02:36:25.069 INFO:tasks.rados.rados.0.smithi142.stdout:358: expect (ObjNum 11 snap 0 seq_num 11) 2020-06-12T02:36:25.070 INFO:tasks.rados.rados.0.smithi142.stdout:359: snap_create 2020-06-12T02:36:25.084 INFO:tasks.rados.rados.0.smithi142.stdout:358: expect (ObjNum 11 snap 0 seq_num 11) 2020-06-12T02:36:25.088 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:25.082+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:25.164 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:25.175 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2020-06-12T02:36:24.937399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223479936,"num_objects":106,"num_object_clones":57,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":7,"num_read":470,"num_read_kb":461843,"num_write":606,"num_write_kb":211053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1247,"ondisk_log_size":1247,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7667684,"kb_used_data":327596,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652935196,"statfs":{"total":676457349120,"available":668605640704,"internally_reserved":7516192768,"allocated":335458304,"data_stored":445881349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5695221,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":-1,"num_read":17,"num_read_kb":30392,"num_write":11,"num_write_kb":6070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.985063"},"pg_stats":[{"pgid":"1.f","version":"72'42","reported_seq":"206","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.129660+0000","last_change":"2020-06-12T02:36:19.130642+0000","last_active":"2020-06-12T02:36:19.129660+0000","last_peered":"2020-06-12T02:36:19.129660+0000","last_clean":"2020-06-12T02:36:19.129660+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:19.129660+0000","last_undegraded":"2020-06-12T02:36:19.129660+0000","last_fullsized":"2020-06-12T02:36:19.129660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":42,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14291004,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":7837,"num_write":23,"num_write_kb":10234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.e","version":"76'84","reported_seq":"143","reported_epoch":"76","state":"active+clean","last_fresh":"2020-06-12T02:36:22.973988+0000","last_change":"2020-06-12T02:36:22.974850+0000","last_active":"2020-06-12T02:36:22.973988+0000","last_peered":"2020-06-12T02:36:22.973988+0000","last_clean":"2020-06-12T02:36:22.973988+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:22.973988+0000","last_undegraded":"2020-06-12T02:36:22.973988+0000","last_fullsized":"2020-06-12T02:36:22.973988+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.d","version":"72'134","reported_seq":"361","reported_epoch":"73","state":"active+clean","last_fresh":"2020-06-12T02:36:19.940757+0000","last_change":"2020-06-12T02:36:19.129992+0000","last_active":"2020-06-12T02:36:19.940757+0000","last_peered":"2020-06-12T02:36:19.940757+0000","last_clean":"2020-06-12T02:36:19.940757+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:19.940757+0000","last_undegraded":"2020-06-12T02:36:19.940757+0000","last_fullsized":"2020-06-12T02:36:19.940757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":134,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27996423,"num_objects":11,"num_object_clones":4,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":73,"num_read_kb":78724,"num_write":65,"num_write_kb":33877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"190","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.091328+0000","last_change":"2020-06-12T02:36:19.092462+0000","last_active":"2020-06-12T02:36:19.091328+0000","last_peered":"2020-06-12T02:36:19.091328+0000","last_clean":"2020-06-12T02:36:19.091328+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:19.091328+0000","last_undegraded":"2020-06-12T02:36:19.091328+0000","last_fullsized":"2020-06-12T02:36:19.091328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.b","version":"75'59","reported_seq":"243","reported_epoch":"76","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:36:22.960383+0000","last_change":"2020-06-12T02:36:22.960509+0000","last_active":"2020-06-12T02:36:22.960383+0000","last_peered":"2020-06-12T02:36:22.960383+0000","last_clean":"2020-06-12T02:36:22.960383+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:22.960383+0000","last_undegraded":"2020-06-12T02:36:22.960383+0000","last_fullsized":"2020-06-12T02:36:22.960383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":59,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":10375040,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.a","version":"34'7","reported_seq":"80","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.107374+0000","last_change":"2020-06-12T02:36:19.107844+0000","last_active":"2020-06-12T02:36:19.107374+0000","last_peered":"2020-06-12T02:36:19.107374+0000","last_clean":"2020-06-12T02:36:19.107374+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:19.107374+0000","last_undegraded":"2020-06-12T02:36:19.107374+0000","last_fullsized":"2020-06-12T02:36:19.107374+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6995,"num_write":5,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.9","version":"72'69","reported_seq":"110","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.123220+0000","last_change":"2020-06-12T02:36:19.124137+0000","last_active":"2020-06-12T02:36:19.123220+0000","last_peered":"2020-06-12T02:36:19.123220+0000","last_clean":"2020-06-12T02:36:19.123220+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:19.123220+0000","last_undegraded":"2020-06-12T02:36:19.123220+0000","last_fullsized":"2020-06-12T02:36:19.123220+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":69,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8716088,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":33,"num_write_kb":9899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.8","version":"72'53","reported_seq":"116","reported_epoch":"73","state":"active+clean","last_fresh":"2020-06-12T02:36:19.939441+0000","last_change":"2020-06-12T02:36:19.105785+0000","last_active":"2020-06-12T02:36:19.939441+0000","last_peered":"2020-06-12T02:36:19.939441+0000","last_clean":"2020-06-12T02:36:19.939441+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:19.939441+0000","last_undegraded":"2020-06-12T02:36:19.939441+0000","last_fullsized":"2020-06-12T02:36:19.939441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16006697,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":8035,"num_write":27,"num_write_kb":11974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.7","version":"72'137","reported_seq":"308","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.129096+0000","last_change":"2020-06-12T02:36:19.129096+0000","last_active":"2020-06-12T02:36:19.129096+0000","last_peered":"2020-06-12T02:36:19.129096+0000","last_clean":"2020-06-12T02:36:19.129096+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:19.129096+0000","last_undegraded":"2020-06-12T02:36:19.129096+0000","last_fullsized":"2020-06-12T02:36:19.129096+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":137,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21022102,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":48923,"num_write":64,"num_write_kb":21923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.6","version":"72'53","reported_seq":"210","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.114943+0000","last_change":"2020-06-12T02:36:19.117502+0000","last_active":"2020-06-12T02:36:19.114943+0000","last_peered":"2020-06-12T02:36:19.114943+0000","last_clean":"2020-06-12T02:36:19.114943+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:19.114943+0000","last_undegraded":"2020-06-12T02:36:19.114943+0000","last_fullsized":"2020-06-12T02:36:19.114943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":53,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9191730,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":7246,"num_write":26,"num_write_kb":7924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.1","version":"72'33","reported_seq":"204","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.110455+0000","last_change":"2020-06-12T02:36:19.112047+0000","last_active":"2020-06-12T02:36:19.110455+0000","last_peered":"2020-06-12T02:36:19.110455+0000","last_clean":"2020-06-12T02:36:19.110455+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:19.110455+0000","last_undegraded":"2020-06-12T02:36:19.110455+0000","last_fullsized":"2020-06-12T02:36:19.110455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6666785,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":35519,"num_write":15,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"90","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.104273+0000","last_change":"2020-06-12T02:36:19.104944+0000","last_active":"2020-06-12T02:36:19.104273+0000","last_peered":"2020-06-12T02:36:19.104273+0000","last_clean":"2020-06-12T02:36:19.104273+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:19.104273+0000","last_undegraded":"2020-06-12T02:36:19.104273+0000","last_fullsized":"2020-06-12T02:36:19.104273+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.2","version":"72'169","reported_seq":"370","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.540974+0000","last_change":"2020-06-12T02:36:19.135807+0000","last_active":"2020-06-12T02:36:19.540974+0000","last_peered":"2020-06-12T02:36:19.540974+0000","last_clean":"2020-06-12T02:36:19.540974+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:19.540974+0000","last_undegraded":"2020-06-12T02:36:19.540974+0000","last_fullsized":"2020-06-12T02:36:19.540974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":169,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22480883,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":30,"num_read_kb":16562,"num_write":75,"num_write_kb":26965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.3","version":"75'117","reported_seq":"326","reported_epoch":"76","state":"active+clean+snaptrim","last_fresh":"2020-06-12T02:36:22.960661+0000","last_change":"2020-06-12T02:36:22.960768+0000","last_active":"2020-06-12T02:36:22.960661+0000","last_peered":"2020-06-12T02:36:22.960661+0000","last_clean":"2020-06-12T02:36:22.960661+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:22.960661+0000","last_undegraded":"2020-06-12T02:36:22.960661+0000","last_fullsized":"2020-06-12T02:36:22.960661+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"stat_sum":{"num_bytes":25701475,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":49,"num_read_kb":49665,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.4","version":"72'130","reported_seq":"301","reported_epoch":"72","state":"active+clean","last_fresh":"2020-06-12T02:36:19.264484+0000","last_change":"2020-06-12T02:36:19.115130+0000","last_active":"2020-06-12T02:36:19.264484+0000","last_peered":"2020-06-12T02:36:19.264484+0000","last_clean":"2020-06-12T02:36:19.264484+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:19.264484+0000","last_undegraded":"2020-06-12T02:36:19.264484+0000","last_fullsized":"2020-06-12T02:36:19.264484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":130,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20710938,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":54,"num_read_kb":64737,"num_write":65,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1d","length":"1"},{"start":"25","length":"2"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]},{"pgid":"1.5","version":"72'133","reported_seq":"302","reported_epoch":"73","state":"active+clean","last_fresh":"2020-06-12T02:36:19.941778+0000","last_change":"2020-06-12T02:36:19.130954+0000","last_active":"2020-06-12T02:36:19.941778+0000","last_peered":"2020-06-12T02:36:19.941778+0000","last_clean":"2020-06-12T02:36:19.941778+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:19.941778+0000","last_undegraded":"2020-06-12T02:36:19.941778+0000","last_fullsized":"2020-06-12T02:36:19.941778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":133,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24706334,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":38627,"num_write":71,"num_write_kb":23071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"25","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223479936,"num_objects":106,"num_object_clones":57,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":7,"num_read":470,"num_read_kb":461843,"num_write":606,"num_write_kb":211053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380358656,"data_stored":500477952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1247,"ondisk_log_size":1247,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088748,"kb_used_data":40164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283092,"statfs":{"total":96636764160,"available":95521886208,"internally_reserved":1073741824,"allocated":41127936,"data_stored":50602829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.147},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":1.819}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.9510000000000001},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":2.6859999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.423},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1429999999999998}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.74},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.4700000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.2959999999999998},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.5859999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.774},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.2890000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.6899999999999999},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":2.8420000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1092020,"kb_used_data":43436,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93279820,"statfs":{"total":96636764160,"available":95518535680,"internally_reserved":1073741824,"allocated":44478464,"data_stored":62354253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.831},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.139}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.2849999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":2.1219999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.466},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.7669999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.2370000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.5550000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.583},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.2970000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.9139999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":2.1680000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":2.6379999999999999},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":2.9409999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120508,"kb_used_data":71924,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251332,"statfs":{"total":96636764160,"available":95489363968,"internally_reserved":1073741824,"allocated":73650176,"data_stored":97871983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.3480000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.3860000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.8260000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1139999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.284}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":2.222},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.5409999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.851},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.0249999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.9279999999999999},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.6139999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":3.0819999999999999},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":3.109}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1070988,"kb_used_data":22404,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300852,"statfs":{"total":96636764160,"available":95540072448,"internally_reserved":1073741824,"allocated":22941696,"data_stored":29780079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.891},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.665}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.5590000000000002},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.8}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.4830000000000001},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.254}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":1.476},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.7869999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":3.0419999999999998},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":3.0990000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.0790000000000002},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.2690000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.4929999999999999},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.863}]}]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094408,"kb_used_data":45824,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277432,"statfs":{"total":96636764160,"available":95516090368,"internally_reserved":1073741824,"allocated":46923776,"data_stored":65621039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":4.0540000000000003},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":6.3129999999999997}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":6.9980000000000002},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.486}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":4.2400000000000002},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":8.1969999999999992}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":4.5579999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":6.4749999999999996}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":7.3929999999999998},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":4.4160000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":6.6369999999999996},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":1.653}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":1.9039999999999999},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":6.0449999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1109068,"kb_used_data":60484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93262772,"statfs":{"total":96636764160,"available":95501078528,"internally_reserved":1073741824,"allocated":61935616,"data_stored":79080495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.613},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.6870000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":1.843},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.3399999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.2759999999999998},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":2.7120000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.1930000000000001},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5640000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":3.2010000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":3.0510000000000002},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":3.117}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":2.8119999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":3.2909999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091944,"kb_used_data":43360,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93279896,"statfs":{"total":96636764160,"available":95518613504,"internally_reserved":1073741824,"allocated":44400640,"data_stored":60570671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.5509999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.5870000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.756},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":2.2440000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.1850000000000001},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.4900000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":3.3439999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.7629999999999999},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":3.1549999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":3.778},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":2.9809999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.907},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":4.2140000000000004}]}]}]}} 2020-06-12T02:36:25.178 INFO:tasks.thrashosds.thrasher:Setting 1.7 to [0, 3, 7] 2020-06-12T02:36:25.178 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.7', '0', '3', '7'] 2020-06-12T02:36:25.179 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap 1.7 0 3 7 2020-06-12T02:36:25.180 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:25.181 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:25.181 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:25.181 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:25.181 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:25.199 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:25.217 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:25.214+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:25.302 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:25.293+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:25.309 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:25.310 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:25.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:25.310 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:25.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.311 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:25.311 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:25.311 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.171925147000003, 2020-06-12T02:36:25.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:25.312 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.312 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.312 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.312 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.312 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.313 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:25.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.313 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:25.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:25.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:25.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:25.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:25.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:25.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:25.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:25.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:25.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:25.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:25.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:25.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:25.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:25.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:25.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:25.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:25.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:25.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:25.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:25.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:25.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:25.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:25.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:25.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:25.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:25.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:25.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:25.329 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.329 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.329 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.330 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:25.330 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:25.330 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.161033766000003, 2020-06-12T02:36:25.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:25.331 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.331 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.331 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.331 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.332 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:25.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.332 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:25.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:25.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:25.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:25.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:25.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:25.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:25.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:25.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:25.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:25.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:25.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:25.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:25.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:25.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:25.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:25.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:25.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:25.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:25.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:25.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:25.344 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.347 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.348 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.348 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:25.349 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:25.349 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.159901722000001, 2020-06-12T02:36:25.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:25.349 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.349 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.350 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:25.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:25.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:25.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:25.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:25.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:25.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:25.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:25.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:25.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:25.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:25.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:25.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:25.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:25.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:25.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:25.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:25.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:25.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:25.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:25.364 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:25.365 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.159646537, 2020-06-12T02:36:25.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:25.365 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.365 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.366 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:25.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.366 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:25.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:25.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:25.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:25.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:25.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:25.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:25.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:25.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:25.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:25.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:25.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:25.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:25.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:25.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:25.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:25.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:25.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:25.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:25.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:25.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:25.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.382 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:25.383 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.159487349999999, 2020-06-12T02:36:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.385 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.385 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:25.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.385 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:25.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:25.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:25.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:25.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:25.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:25.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:25.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:25.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:25.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:25.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:25.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:25.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:25.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:25.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:25.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.396 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.397 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:25.397 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:25.398 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.015164771999999, 2020-06-12T02:36:25.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:25.398 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.398 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.399 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.399 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.399 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:25.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.399 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:25.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:25.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:25.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:25.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:25.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:25.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:25.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:25.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:25.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:25.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:25.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:25.408 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.409 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.409 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:603 1.bs0 1:d6659338:::smithi14213939-43:head [write 430279~695389,stat] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:25.410 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:25.410 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.284264316000002, 2020-06-12T02:36:25.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882, 2020-06-12T02:36:25.415 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.416 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.416 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.416 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.416 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.416 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 603 2020-06-12T02:36:25.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.417 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:25.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.020458+0000", 2020-06-12T02:36:25.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0014668649999999999 2020-06-12T02:36:25.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021925+0000", 2020-06-12T02:36:25.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9837e-05 2020-06-12T02:36:25.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021944+0000", 2020-06-12T02:36:25.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4341e-05 2020-06-12T02:36:25.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021969+0000", 2020-06-12T02:36:25.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4333e-05 2020-06-12T02:36:25.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.021983+0000", 2020-06-12T02:36:25.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3517999999999995e-05 2020-06-12T02:36:25.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022077+0000", 2020-06-12T02:36:25.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000168954 2020-06-12T02:36:25.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.022246+0000", 2020-06-12T02:36:25.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035737379999999999 2020-06-12T02:36:25.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.025819+0000", 2020-06-12T02:36:25.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060458619999999999 2020-06-12T02:36:25.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031865+0000", 2020-06-12T02:36:25.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158689 2020-06-12T02:36:25.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.032024+0000", 2020-06-12T02:36:25.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00098174500000000001 2020-06-12T02:36:25.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033006+0000", 2020-06-12T02:36:25.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012547882 2020-06-12T02:36:25.432 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.432 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.432 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.433 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:25.434 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:25.434 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.274095275000001, 2020-06-12T02:36:25.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:25.434 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.434 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.435 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:25.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:25.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:25.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:25.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:25.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:25.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:25.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:25.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:25.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:25.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:25.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:25.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:25.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:25.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:25.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:25.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:25.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:25.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:25.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.451 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.452 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:25.452 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:25.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.336392874000001, 2020-06-12T02:36:25.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:25.453 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.453 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.454 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:25.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.454 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:25.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:25.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:25.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:25.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:25.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:25.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:25.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:25.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:25.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:25.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:25.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:25.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:25.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:25.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:25.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:25.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:25.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:25.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:25.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:25.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:25.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:25.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:25.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:25.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.473 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:25.473 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:25.473 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.354516793999998, 2020-06-12T02:36:25.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:25.473 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.474 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:25.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.475 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:25.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:25.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:25.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:25.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:25.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:25.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:25.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:25.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:25.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:25.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:25.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:25.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:25.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:25.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:25.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:25.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.487 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.488 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.488 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:25.488 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:25.489 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.354323478000001, 2020-06-12T02:36:25.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:25.489 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.489 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:25.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:25.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:25.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:25.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:25.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:25.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:25.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:25.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:25.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:25.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:25.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:25.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:25.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:25.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:25.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:25.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:25.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:25.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.506 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.507 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:25.507 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:25.507 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.354175023, 2020-06-12T02:36:25.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.508 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:25.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.509 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:25.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:25.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:25.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:25.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:25.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:25.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:25.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:25.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:25.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:25.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:25.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:25.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:25.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:25.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:25.519 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.520 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.520 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:25.521 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:25.521 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.346742073000001, 2020-06-12T02:36:25.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:25.521 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.521 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:25.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:25.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:25.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:25.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:25.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:25.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:25.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:25.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:25.529 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.529 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.529 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.344333573, 2020-06-12T02:36:25.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:25.531 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.531 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.531 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:25.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:25.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:25.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:25.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:25.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:25.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:25.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:25.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:25.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:25.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:25.540 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.541 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.541 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.541 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.342306428000001, 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.542 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:25.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:25.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:25.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:25.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:25.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:25.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:25.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:25.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:25.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:25.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:25.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:25.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:25.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.553 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=168, attrs_read=0))", 2020-06-12T02:36:25.553 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:25.553 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.340387953, 2020-06-12T02:36:25.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001, 2020-06-12T02:36:25.554 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.554 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.554 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964334+0000", 2020-06-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001626127 2020-06-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965960+0000", 2020-06-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3662999999999999e-05 2020-06-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965974+0000", 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4405e-05 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965988+0000", 2020-06-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5080000000000002e-06 2020-06-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965995+0000", 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0077934429999999997 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973788+0000", 2020-06-12T02:36:25.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002853216 2020-06-12T02:36:25.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976641+0000", 2020-06-12T02:36:25.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012307362000000001 2020-06-12T02:36:25.562 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.562 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.562 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.331256594999999, 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.563 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.564 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:25.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:25.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:25.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:25.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:25.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:25.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:25.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:25.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:25.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:25.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:25.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:25.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:25.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.573 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.327043578, 2020-06-12T02:36:25.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:25.575 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.575 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:25.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.576 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:25.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.576 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:25.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:25.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:25.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:25.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:25.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:25.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:25.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:25.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:25.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:25.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:25.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:25.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:25.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:25.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:25.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:25.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:25.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:25.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:25.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.588 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.588 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.588 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 10.326860378999999, 2020-06-12T02:36:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.589 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:25.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:25.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.604 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:25.604 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:25.604 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.8699423349999993, 2020-06-12T02:36:25.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:25.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:25.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:25.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:25.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:25.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:25.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:25.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:25.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:25.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:25.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:25.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:25.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:25.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:25.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:25.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:25.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:25.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:25.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:25.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:25.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:25.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:25.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:25.619 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.620 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.620 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.620 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:25.620 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:25.620 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:25.322+0000 7fa866605700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:25.622 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:25.342+0000 7fa866605700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:25.623 INFO:teuthology.orchestra.run.smithi142.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-06-12T02:36:25.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-06-12T02:36:25.623 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap, ignoring 2020-06-12T02:36:25.624 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:25.625 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:25.618+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:25.731 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:25.726+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:25.775 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:25.776 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:25.776 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:25.776 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:25.785 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:25.831 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:25.825+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:25.896 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:25.897 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:25.897 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:25.897 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:25.897 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:25.906 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:25.926 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:25.947 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:25.941+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:26.002 INFO:tasks.rados.rados.0.smithi142.stdout:358: done (1 left) 2020-06-12T02:36:26.002 INFO:tasks.rados.rados.0.smithi142.stdout:359: done (0 left) 2020-06-12T02:36:26.003 INFO:tasks.rados.rados.0.smithi142.stdout:360: write (excl) oid 11 current snap is 31 2020-06-12T02:36:26.003 INFO:tasks.rados.rados.0.smithi142.stdout:360: seq_num 160 ranges {689120=483253,1946413=679049} 2020-06-12T02:36:26.013 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:36:26.015 INFO:tasks.rados.rados.0.smithi142.stdout:360: writing smithi14213939-11 from 689120 to 1172373 tid 1 2020-06-12T02:36:26.020 INFO:tasks.rados.rados.0.smithi142.stdout:360: writing smithi14213939-11 from 1946413 to 2625462 tid 2 2020-06-12T02:36:26.021 INFO:tasks.rados.rados.0.smithi142.stdout:361: read oid 47 snap -1 2020-06-12T02:36:26.021 INFO:tasks.rados.rados.0.smithi142.stdout:361: expect (ObjNum 107 snap 23 seq_num 107) 2020-06-12T02:36:26.021 INFO:tasks.rados.rados.0.smithi142.stdout:362: snap_create 2020-06-12T02:36:26.037 INFO:tasks.rados.rados.0.smithi142.stdout:360: finishing write tid 1 to smithi14213939-11 2020-06-12T02:36:26.038 INFO:tasks.rados.rados.0.smithi142.stdout:360: finishing write tid 2 to smithi14213939-11 2020-06-12T02:36:26.038 INFO:tasks.rados.rados.0.smithi142.stdout:360: finishing write tid 4 to smithi14213939-11 2020-06-12T02:36:26.039 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:26.029+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:26.046 INFO:tasks.rados.rados.0.smithi142.stdout:360: finishing write tid 5 to smithi14213939-11 2020-06-12T02:36:26.046 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 11 v 158 (ObjNum 160 snap 31 seq_num 160) dirty exists 2020-06-12T02:36:26.047 INFO:tasks.rados.rados.0.smithi142.stdout:360: left oid 11 (ObjNum 160 snap 31 seq_num 160) 2020-06-12T02:36:26.047 INFO:tasks.rados.rados.0.smithi142.stdout:361: expect (ObjNum 107 snap 23 seq_num 107) 2020-06-12T02:36:26.047 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:26.038+0000 7f4c34e7f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:26.049 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:26.046+0000 7f4c2f59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:26.067 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:26.067 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:26.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:26.068 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:26.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.068 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:26.068 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:26.069 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.916319108000003, 2020-06-12T02:36:26.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:26.069 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.070 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:26.070 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:26.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:26.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:26.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:26.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:26.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:26.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:26.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:26.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:26.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:26.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:26.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:26.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:26.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:26.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:26.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:26.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.081 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:26.081 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:26.081 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.769805597000001, 2020-06-12T02:36:26.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:26.081 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:26.083 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:26.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:26.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:26.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:26.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:26.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:26.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:26.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:26.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:26.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:26.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:26.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:26.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:26.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:26.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:26.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:26.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:26.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.093 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.092256923000001, 2020-06-12T02:36:26.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:26.096 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.096 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.097 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:26.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.097 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:26.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:26.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:26.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:26.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:26.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:26.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:26.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:26.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:26.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:26.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:26.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:26.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:26.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:26.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:26.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:26.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.112 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:26.112 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:26.112 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.091492994999999, 2020-06-12T02:36:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:26.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:26.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:26.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:26.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:26.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:26.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:26.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:26.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:26.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:26.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:26.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:26.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:26.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:26.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:26.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:26.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.133 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:26.133 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:26.133 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.868687940000001, 2020-06-12T02:36:26.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:26.134 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.134 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.134 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.134 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.135 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.135 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:26.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.135 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:26.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:26.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:26.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:26.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:26.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:26.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:26.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:26.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:26.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:26.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:26.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:26.146 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.151 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:26.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:26.152 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.860401653, 2020-06-12T02:36:26.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:26.152 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.152 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.153 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:26.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:26.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:26.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:26.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:26.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:26.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:26.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:26.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:26.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:26.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:26.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:26.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:26.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:26.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:26.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:26.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:26.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:26.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:26.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:659 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 2706697~532054] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.854158176999999, 2020-06-12T02:36:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076657540000000003, 2020-06-12T02:36:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.167 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 659 2020-06-12T02:36:26.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207901+0000", 2020-06-12T02:36:26.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000595569 2020-06-12T02:36:26.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208496+0000", 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0293000000000002e-05 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208537+0000", 2020-06-12T02:36:26.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7671999999999999e-05 2020-06-12T02:36:26.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208564+0000", 2020-06-12T02:36:26.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6803000000000002e-05 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208581+0000", 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131323 2020-06-12T02:36:26.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208712+0000", 2020-06-12T02:36:26.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00027796400000000001 2020-06-12T02:36:26.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208990+0000", 2020-06-12T02:36:26.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0029075889999999999 2020-06-12T02:36:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211898+0000", 2020-06-12T02:36:26.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033717920000000002 2020-06-12T02:36:26.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215270+0000", 2020-06-12T02:36:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015060099999999999 2020-06-12T02:36:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215420+0000", 2020-06-12T02:36:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000146148 2020-06-12T02:36:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.215566+0000", 2020-06-12T02:36:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0076657540000000003 2020-06-12T02:36:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.853372408999999, 2020-06-12T02:36:26.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:26.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:26.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:26.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:26.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:26.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:26.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:26.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:26.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:26.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:26.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:26.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:26.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:26.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:26.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.199 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.199 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.853234958000002, 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.201 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:26.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.201 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:26.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:26.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:26.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:26.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:26.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:26.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:26.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:26.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:26.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:26.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:26.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:26.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:26.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:26.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:26.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:26.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.213 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:26.213 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:26.213 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.052447219000001, 2020-06-12T02:36:26.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:26.214 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.214 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.215 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:26.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:26.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:26.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:26.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:26.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:26.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:26.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:26.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:26.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:26.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:26.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:26.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:26.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:26.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:26.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:26.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:26.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:26.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:26.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:26.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.228 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 17.052300604999999, 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.231 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:26.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.231 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:26.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:26.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:26.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:26.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:26.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:26.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:26.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:26.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:26.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:26.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:26.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:26.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:26.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:26.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:26.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:26.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:26.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:26.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:26.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:26.244 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.245 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.245 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.245 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.096287731, 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.247 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:26.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.247 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:26.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:26.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:26.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:26.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:26.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:26.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:26.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:26.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:26.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:26.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:26.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:26.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:26.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:26.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:26.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:26.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:26.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.259 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.090556218, 2020-06-12T02:36:26.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:26.261 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.261 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.262 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:26.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.262 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:26.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:26.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:26.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:26.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:26.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:26.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:26.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:26.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:26.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:26.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:26.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:26.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:26.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:26.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:26.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:26.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:26.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:26.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:26.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.275 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:26.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:26.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.090062702000001, 2020-06-12T02:36:26.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.276 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:26.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:26.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:26.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:26.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:26.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:26.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:26.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:26.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:26.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:26.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:26.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:26.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:26.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:26.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:26.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:26.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:26.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:26.289 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.289 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.289 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.290 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:26.290 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:26.290 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.089968695, 2020-06-12T02:36:26.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:26.292 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.292 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.292 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.292 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.292 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.293 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:26.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.293 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:26.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:26.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:26.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:26.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:26.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:26.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:26.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:26.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:26.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:26.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:26.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:26.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:26.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:26.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:26.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:26.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:26.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:26.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:26.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:26.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:26.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:26.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.308 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:26.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:26.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 11.051807666, 2020-06-12T02:36:26.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:26.309 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:26.309 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:26.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:26.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:26.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:26.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:26.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:26.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:26.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:26.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:26.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:26.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:26.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:26.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:26.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:26.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:26.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:26.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:26.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:26.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:26.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.321 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.322 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:26.322 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:26.322 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.0110106730000004, 2020-06-12T02:36:26.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:26.323 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.323 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.324 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:26.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.324 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:26.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:26.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:26.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:26.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:26.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:26.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:26.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:26.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:26.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:26.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:26.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:26.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:26.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:26.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:26.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.335 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.335 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:26.336 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:26.336 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.0107686070000002, 2020-06-12T02:36:26.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:26.336 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.337 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.338 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.338 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.338 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:26.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:26.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:26.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:26.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:26.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:26.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:26.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:26.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:26.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:26.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:26.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:26.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:26.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:26.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:26.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:26.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:26.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:26.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.350 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:26.350 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:26.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.0105589159999999, 2020-06-12T02:36:26.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:26.351 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.351 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.351 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.352 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:26.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.352 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:26.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:26.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:26.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:26.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:26.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:26.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:26.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:26.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:26.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:26.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:26.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:26.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:26.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:26.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:26.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:26.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:26.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.365 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:26.366 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.9950247550000002, 2020-06-12T02:36:26.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:26.367 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:26.367 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:26.367 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:26.368 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:26.369 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:26.369 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:26.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.369 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:26.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:26.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:26.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:26.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:26.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:26.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:26.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:26.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:26.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:26.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:26.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:26.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:26.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:26.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:26.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:26.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:26.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:26.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:26.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:26.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:26.379 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:26.382 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:26.382 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:26.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:26.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:26.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:26.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:26.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:26.384 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:26.384 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:26.106+0000 7f96562c0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:26.384 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:26.118+0000 7f965505e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:26.384 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.384 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.385 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.385 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.385 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.385 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.385 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.386 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:26.386 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:26.377+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:26.387 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:26.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:26.477+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:26.542 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:26.542 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:26.551 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:26.583 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:26.578+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:26.684 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:26.677+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:26.705 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:26.705 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:26.715 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:26.787 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:26.782+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:26.871 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:26.872 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:26.882 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:26.927 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:26.921+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:26.985 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:26.986 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:26.988 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:26.982+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:26.995 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:27.015 INFO:tasks.rados.rados.0.smithi142.stdout:360: done (2 left) 2020-06-12T02:36:27.015 INFO:tasks.rados.rados.0.smithi142.stdout:361: done (1 left) 2020-06-12T02:36:27.015 INFO:tasks.rados.rados.0.smithi142.stdout:362: done (0 left) 2020-06-12T02:36:27.015 INFO:tasks.rados.rados.0.smithi142.stdout:363: delete oid 39 current snap is 32 2020-06-12T02:36:27.019 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:36:27.022 INFO:tasks.rados.rados.0.smithi142.stdout:363: done (0 left) 2020-06-12T02:36:27.022 INFO:tasks.rados.rados.0.smithi142.stdout:364: read oid 13 snap -1 2020-06-12T02:36:27.023 INFO:tasks.rados.rados.0.smithi142.stdout:364: expect (ObjNum 146 snap 30 seq_num 146) 2020-06-12T02:36:27.023 INFO:tasks.rados.rados.0.smithi142.stdout:365: snap_remove snap 20 2020-06-12T02:36:27.091 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:27.085+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:27.150 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.150 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.160 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:27.207 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:27.197+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:27.294 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:27.290+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:27.315 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.315 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.324 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:27.395 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:27.389+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:27.442 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.443 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.452 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:27.505 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:27.502+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:27.571 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.572 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.581 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:27.626 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:27.622+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:27.703 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:27.698+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:27.738 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.738 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.744 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:27.805 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:27.797+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:27.925 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:27.922+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:27.925 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:28.078 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:28.079 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:28.088 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:28.141 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:28.138+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:28.156 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:28.017+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:28.180 INFO:tasks.rados.rados.0.smithi142.stdout:365: done (1 left) 2020-06-12T02:36:28.181 INFO:tasks.rados.rados.0.smithi142.stdout:366: snap_create 2020-06-12T02:36:28.181 INFO:tasks.rados.rados.0.smithi142.stdout:364: expect (ObjNum 146 snap 30 seq_num 146) 2020-06-12T02:36:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:28.237 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:28.238 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:28.229+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:28.339 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:28.333+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:28.391 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:28.392 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:28.395 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:28.400 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:28.441 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:28.438+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:28.498 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:28.490+0000 7f94a8eca700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:28.502 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:28.498+0000 7f94a359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:28.531 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:28.543 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:28.538+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:28.546 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:28.547 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:28.550 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:28.556 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:28.569 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:28.592 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:28.613 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:28.644 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:28.645 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:28.642+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:28.671 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:28.678 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:28.678 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.516142168999998, 2020-06-12T02:36:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:28.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:28.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:28.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:28.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:28.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.515830665999999, 2020-06-12T02:36:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:28.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.723580099000003, 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:28.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.723063420000003, 2020-06-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.720556985999998, 2020-06-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.720376989999998, 2020-06-12T02:36:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.720241898000001, 2020-06-12T02:36:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.670651627000002, 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.662604837, 2020-06-12T02:36:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.662259472999999, 2020-06-12T02:36:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.66212792, 2020-06-12T02:36:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:799 1.8s0 1:16d20421:::smithi14213939-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.667674799, 2020-06-12T02:36:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001, 2020-06-12T02:36:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 799 2020-06-12T02:36:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.163e-05 2020-06-12T02:36:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005469+0000", 2020-06-12T02:36:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5200000000000003e-06 2020-06-12T02:36:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005478+0000", 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2224e-05 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005491+0000", 2020-06-12T02:36:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5619999999999997e-06 2020-06-12T02:36:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005495+0000", 2020-06-12T02:36:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001359306 2020-06-12T02:36:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006854+0000", 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109207 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006964+0000", 2020-06-12T02:36:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021167133000000001 2020-06-12T02:36:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028131+0000", 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000173494 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028304+0000", 2020-06-12T02:36:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055074019999999998 2020-06-12T02:36:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033812+0000", 2020-06-12T02:36:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014122200000000001 2020-06-12T02:36:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033953+0000", 2020-06-12T02:36:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012596910000000001 2020-06-12T02:36:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.035213+0000", 2020-06-12T02:36:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001 2020-06-12T02:36:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:830 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.294117112, 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998, 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 830 2020-06-12T02:36:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2907e-05 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379038+0000", 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5059999999999995e-06 2020-06-12T02:36:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379046+0000", 2020-06-12T02:36:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.521e-05 2020-06-12T02:36:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379062+0000", 2020-06-12T02:36:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9580000000000001e-06 2020-06-12T02:36:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379069+0000", 2020-06-12T02:36:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025736000000000001 2020-06-12T02:36:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381642+0000", 2020-06-12T02:36:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8594000000000001e-05 2020-06-12T02:36:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381711+0000", 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028781834999999999 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410493+0000", 2020-06-12T02:36:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998 2020-06-12T02:36:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:831 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.293983598000001, 2020-06-12T02:36:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003, 2020-06-12T02:36:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 831 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9319000000000002e-05 2020-06-12T02:36:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379148+0000", 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.464e-06 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379152+0000", 2020-06-12T02:36:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8990000000000001e-06 2020-06-12T02:36:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379160+0000", 2020-06-12T02:36:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4769999999999999e-06 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379164+0000", 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002823229 2020-06-12T02:36:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381987+0000", 2020-06-12T02:36:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010492699999999999 2020-06-12T02:36:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.382092+0000", 2020-06-12T02:36:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039092202999999999 2020-06-12T02:36:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.421184+0000", 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:842 1.5s0 1:a5b7af70:::smithi14213939-17:head [write 1799494~402223] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.271835721, 2020-06-12T02:36:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001, 2020-06-12T02:36:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 842 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215639 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401482+0000", 2020-06-12T02:36:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3623e-05 2020-06-12T02:36:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401496+0000", 2020-06-12T02:36:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2456e-05 2020-06-12T02:36:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401518+0000", 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1941e-05 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401530+0000", 2020-06-12T02:36:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0344000000000003e-05 2020-06-12T02:36:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401600+0000", 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146625 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401747+0000", 2020-06-12T02:36:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017748788000000001 2020-06-12T02:36:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419496+0000", 2020-06-12T02:36:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119141 2020-06-12T02:36:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419615+0000", 2020-06-12T02:36:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010974276999999999 2020-06-12T02:36:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.430589+0000", 2020-06-12T02:36:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025664110000000002 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433156+0000", 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054978220000000003 2020-06-12T02:36:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438653+0000", 2020-06-12T02:36:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3753999999999998e-05 2020-06-12T02:36:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438737+0000", 2020-06-12T02:36:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001 2020-06-12T02:36:28.923 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:843 1.5s0 1:a5b7af70:::smithi14213939-17:head [setxattr _header (57) in=7b,truncate 2201717] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:28.924 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.271505385999999, 2020-06-12T02:36:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003, 2020-06-12T02:36:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.925 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 843 2020-06-12T02:36:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.926 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1662000000000005e-05 2020-06-12T02:36:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401678+0000", 2020-06-12T02:36:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.742e-06 2020-06-12T02:36:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401685+0000", 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4080000000000001e-06 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401692+0000", 2020-06-12T02:36:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2159999999999997e-06 2020-06-12T02:36:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401698+0000", 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5162999999999998e-05 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401783+0000", 2020-06-12T02:36:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109722 2020-06-12T02:36:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401893+0000", 2020-06-12T02:36:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018128401999999998 2020-06-12T02:36:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420021+0000", 2020-06-12T02:36:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015958500000000001 2020-06-12T02:36:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420181+0000", 2020-06-12T02:36:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011980408999999999 2020-06-12T02:36:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432161+0000", 2020-06-12T02:36:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020040430000000001 2020-06-12T02:36:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.434165+0000", 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053184800000000004 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439483+0000", 2020-06-12T02:36:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015248599999999999 2020-06-12T02:36:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439636+0000", 2020-06-12T02:36:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003 2020-06-12T02:36:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:844 1.5s0 1:a5b7af70:::smithi14213939-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.271354187, 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998, 2020-06-12T02:36:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 844 2020-06-12T02:36:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5605000000000001e-05 2020-06-12T02:36:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401793+0000", 2020-06-12T02:36:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.331e-06 2020-06-12T02:36:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401800+0000", 2020-06-12T02:36:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2789000000000001e-05 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401813+0000", 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1390000000000003e-06 2020-06-12T02:36:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401818+0000", 2020-06-12T02:36:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109048 2020-06-12T02:36:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401927+0000", 2020-06-12T02:36:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010927 2020-06-12T02:36:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402036+0000", 2020-06-12T02:36:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018472145999999998 2020-06-12T02:36:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420508+0000", 2020-06-12T02:36:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9551999999999998e-05 2020-06-12T02:36:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420608+0000", 2020-06-12T02:36:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019833529999999999 2020-06-12T02:36:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440441+0000", 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012666700000000001 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440568+0000", 2020-06-12T02:36:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010441980000000001 2020-06-12T02:36:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.441612+0000", 2020-06-12T02:36:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998 2020-06-12T02:36:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:847 1.ds0 1:b3d4b74b:::smithi14213939-29:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.270990238, 2020-06-12T02:36:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664, 2020-06-12T02:36:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 847 2020-06-12T02:36:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4753000000000003e-05 2020-06-12T02:36:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402157+0000", 2020-06-12T02:36:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.55e-06 2020-06-12T02:36:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402163+0000", 2020-06-12T02:36:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1355000000000001e-05 2020-06-12T02:36:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402174+0000", 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8770000000000001e-06 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402179+0000", 2020-06-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020908300000000001 2020-06-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404270+0000", 2020-06-12T02:36:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5341999999999997e-05 2020-06-12T02:36:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404356+0000", 2020-06-12T02:36:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026823956999999999 2020-06-12T02:36:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.431179+0000", 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:898 1.ds0 1:b8c47ae9:::smithi14213939-24:head [copy-from ver 14] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5770357570000009, 2020-06-12T02:36:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999, 2020-06-12T02:36:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 898 2020-06-12T02:36:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1056000000000005e-05 2020-06-12T02:36:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096147+0000", 2020-06-12T02:36:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1107999999999999e-05 2020-06-12T02:36:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096158+0000", 2020-06-12T02:36:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8838000000000002e-05 2020-06-12T02:36:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096177+0000", 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.084e-05 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096188+0000", 2020-06-12T02:36:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206119 2020-06-12T02:36:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096394+0000", 2020-06-12T02:36:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0744000000000001e-05 2020-06-12T02:36:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096405+0000", 2020-06-12T02:36:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092680699999999998 2020-06-12T02:36:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105673+0000", 2020-06-12T02:36:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000149333 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105822+0000", 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018170888 2020-06-12T02:36:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.123993+0000", 2020-06-12T02:36:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084114589999999996 2020-06-12T02:36:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.132405+0000", 2020-06-12T02:36:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00440384 2020-06-12T02:36:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136809+0000", 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011938300000000001 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136928+0000", 2020-06-12T02:36:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999 2020-06-12T02:36:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:899 1.ds0 1:b8c47ae9:::smithi14213939-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.5768545500000002, 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997, 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 899 2020-06-12T02:36:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9157999999999999e-05 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096297+0000", 2020-06-12T02:36:28.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4880000000000001e-06 2020-06-12T02:36:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096304+0000", 2020-06-12T02:36:28.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4187e-05 2020-06-12T02:36:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096318+0000", 2020-06-12T02:36:28.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6979999999999993e-06 2020-06-12T02:36:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096328+0000", 2020-06-12T02:36:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014549100000000001 2020-06-12T02:36:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096474+0000", 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8830000000000006e-06 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096481+0000", 2020-06-12T02:36:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095279739999999998 2020-06-12T02:36:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106009+0000", 2020-06-12T02:36:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8401999999999999e-05 2020-06-12T02:36:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106088+0000", 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022632513 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128720+0000", 2020-06-12T02:36:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120066 2020-06-12T02:36:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:28.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128840+0000", 2020-06-12T02:36:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093085939999999999 2020-06-12T02:36:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:28.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138149+0000", 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134377 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138283+0000", 2020-06-12T02:36:29.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012817500000000001 2020-06-12T02:36:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138411+0000", 2020-06-12T02:36:29.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.002 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:29.005 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:29.005 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:29.006 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.006 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.006 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.006 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.006 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.007 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.007 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.007 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:29.007 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:28.998+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:29.034 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:36:29.106 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:29.102+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:29.158 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:29.158 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:29.159 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:29.159 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:29.150+0000 7fc5229f1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:29.175 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:29.176 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:29.162+0000 7fc5229f1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:29.184 INFO:tasks.rados.rados.0.smithi142.stdout:364: done (1 left) 2020-06-12T02:36:29.184 INFO:tasks.rados.rados.0.smithi142.stdout:366: done (0 left) 2020-06-12T02:36:29.184 INFO:tasks.rados.rados.0.smithi142.stdout:367: snap_create 2020-06-12T02:36:29.206 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:29.201+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:29.289 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:29.290 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:29.296 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:29.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:29.301+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.275963638999997, 2020-06-12T02:36:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.275740196999998, 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.233261087999999, 2020-06-12T02:36:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.232926194000001, 2020-06-12T02:36:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.032050311000001, 2020-06-12T02:36:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:36:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:36:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:36:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:36:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:36:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:36:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:36:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:36:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:36:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:36:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:36:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:36:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:36:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:36:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:36:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:36:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.031890497999999, 2020-06-12T02:36:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:36:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:36:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:36:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:36:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:36:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:36:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:36:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:36:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:36:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:36:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:36:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:36:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:36:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:36:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:36:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.031809785, 2020-06-12T02:36:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:36:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:36:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:36:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:36:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:36:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:36:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:36:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:36:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:36:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:36:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:36:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:36:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:36:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:36:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:36:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:36:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:36:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:36:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:36:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.031563232, 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:36:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:36:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:36:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:36:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:36:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:36:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:36:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:36:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:36:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:36:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:36:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:36:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.018212909000001, 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:36:29.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.540 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:36:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:36:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:36:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:36:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:36:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:36:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:36:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:36:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:36:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:36:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:36:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:36:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:36:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:36:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:36:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:36:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.018026655, 2020-06-12T02:36:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:36:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:36:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:36:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:36:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:36:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:36:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:36:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:36:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:36:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:36:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:36:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:36:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:36:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:36:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:36:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:36:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:36:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:36:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:36:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:36:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.017825944, 2020-06-12T02:36:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:36:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:36:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:36:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:36:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:36:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:36:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:36:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:36:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:36:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:36:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:36:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:36:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:36:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:36:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:36:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:36:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:36:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:36:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:36:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4253379830000004, 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:36:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:36:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:36:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:36:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:36:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:36:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:36:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:36:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:36:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:36:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:36:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:36:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:36:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:36:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:36:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:36:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4249142359999993, 2020-06-12T02:36:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:36:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:36:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:36:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:36:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:36:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:36:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:36:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:36:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:36:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:36:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:36:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:36:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:36:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:36:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:36:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:36:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4247603780000002, 2020-06-12T02:36:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:36:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:36:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:36:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:36:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:36:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:36:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:36:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:36:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:36:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:36:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:36:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:36:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4220295899999993, 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:36:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:36:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:36:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:36:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:36:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:36:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:36:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:36:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:36:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:36:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:36:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4216092630000006, 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:36:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:36:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:36:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:36:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:36:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:36:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:36:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:36:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:36:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:36:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4215144300000002, 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:36:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:36:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:36:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:36:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:36:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:36:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:36:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:36:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:36:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:36:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:36:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:36:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:36:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:36:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3917350759999998, 2020-06-12T02:36:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:36:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:36:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:36:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:36:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:36:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:36:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:36:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:36:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:36:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:36:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:36:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:36:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:36:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:36:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:36:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:36:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:36:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:36:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:36:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:36:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:36:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:36:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:36:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3912694630000004, 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:36:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:36:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:36:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:36:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:36:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:36:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:36:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:36:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:36:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:36:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:36:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:36:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:36:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:36:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:36:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:36:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:36:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:36:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:36:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3910955280000001, 2020-06-12T02:36:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:36:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:36:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:36:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:36:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:36:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:36:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:36:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:36:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:36:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:36:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:36:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:36:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:36:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:36:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:36:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:36:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:29.726 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:29.728 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:29.728 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:29.722+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:29.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:29.821+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:29.847 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:29.847 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:29.848 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:29.848 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:29.857 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:29.943 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:29.937+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:29.946 INFO:tasks.rados.rados.0.smithi142.stdout:367: done (0 left) 2020-06-12T02:36:29.947 INFO:tasks.rados.rados.0.smithi142.stdout:368: copy_from oid 20 from oid 48 current snap is 34 2020-06-12T02:36:29.949 INFO:tasks.rados.rados.0.smithi142.stdout:369: write oid 46 current snap is 34 2020-06-12T02:36:29.949 INFO:tasks.rados.rados.0.smithi142.stdout:369: seq_num 162 ranges {722734=633751,2063377=659357} 2020-06-12T02:36:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:36:29.957 INFO:tasks.rados.rados.0.smithi142.stdout:369: writing smithi14213939-46 from 722734 to 1356485 tid 1 2020-06-12T02:36:29.970 INFO:tasks.rados.rados.0.smithi142.stdout:369: writing smithi14213939-46 from 2063377 to 2722734 tid 2 2020-06-12T02:36:29.971 INFO:tasks.rados.rados.0.smithi142.stdout:370: copy_from oid 12 from oid 32 current snap is 34 2020-06-12T02:36:29.971 INFO:tasks.rados.rados.0.smithi142.stdout:368: finishing copy_from to smithi14213939-20 2020-06-12T02:36:29.971 INFO:tasks.rados.rados.0.smithi142.stdout:368: got expected ENOENT (src dne) 2020-06-12T02:36:29.971 INFO:tasks.rados.rados.0.smithi142.stdout:368: finishing copy_from racing read to smithi14213939-20 2020-06-12T02:36:29.971 INFO:tasks.rados.rados.0.smithi142.stdout:368: done (2 left) 2020-06-12T02:36:29.972 INFO:tasks.rados.rados.0.smithi142.stdout:371: read oid 42 snap -1 2020-06-12T02:36:29.972 INFO:tasks.rados.rados.0.smithi142.stdout:371: expect (ObjNum 123 snap 27 seq_num 123) 2020-06-12T02:36:29.972 INFO:tasks.rados.rados.0.smithi142.stdout:372: delete oid 10 current snap is 34 2020-06-12T02:36:29.973 INFO:tasks.rados.rados.0.smithi142.stdout:369: finishing write tid 1 to smithi14213939-46 2020-06-12T02:36:29.994 INFO:tasks.rados.rados.0.smithi142.stdout:372: done (3 left) 2020-06-12T02:36:29.994 INFO:tasks.rados.rados.0.smithi142.stdout:373: snap_remove snap 27 2020-06-12T02:36:30.020 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:30.020 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:30.021 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:30.021 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:30.021 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:30.029 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:30.071 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:30.065+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:30.137 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:30.130+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:30.189 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:30.190 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:30.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:30.191 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:30.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.191 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:30.191 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.049255332999998, 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.193 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.193 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:30.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.193 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:30.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:30.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:30.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:30.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:30.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:30.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:30.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:30.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:30.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:30.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:30.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:30.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:30.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:30.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:30.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:30.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:30.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:30.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:30.211 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.212 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:30.213 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:30.213 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.038363951999997, 2020-06-12T02:36:30.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:30.215 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.215 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.215 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.215 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.216 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:30.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.217 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:30.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:30.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:30.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:30.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:30.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:30.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:30.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:30.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:30.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:30.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:30.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:30.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:30.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:30.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:30.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:30.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:30.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:30.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:30.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:30.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:30.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:30.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.239 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.241 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:30.242 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:30.242 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.037231908000003, 2020-06-12T02:36:30.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:30.242 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.244 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.245 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:30.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.245 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:30.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:30.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:30.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:30.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:30.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:30.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:30.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:30.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:30.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:30.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:30.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:30.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:30.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:30.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:30.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:30.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:30.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:30.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:30.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.258 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.260 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:30.260 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:30.260 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.036976723000002, 2020-06-12T02:36:30.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:30.260 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:30.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.262 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:30.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:30.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:30.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:30.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:30.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:30.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:30.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:30.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:30.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:30.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:30.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:30.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:30.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:30.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:30.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:30.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:30.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:30.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:30.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:30.293 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.293 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.293 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.294 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:30.294 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:30.294 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.036817536000001, 2020-06-12T02:36:30.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:30.295 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.295 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.295 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.295 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.295 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:30.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:30.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:30.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:30.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:30.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:30.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:30.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:30.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:30.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:30.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:30.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:30.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:30.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 53.892494958, 2020-06-12T02:36:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.310 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.310 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:30.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.311 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:30.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:30.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:30.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:30.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:30.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:30.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:30.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:30.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:30.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:30.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:30.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:30.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:30.326 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.326 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.327 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:30.328 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:30.328 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.151425460999999, 2020-06-12T02:36:30.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:30.328 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.328 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.329 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.329 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.329 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.329 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:30.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.330 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:30.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:30.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:30.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:30.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:30.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:30.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:30.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:30.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:30.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:30.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:30.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:30.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:30.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:30.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:30.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:30.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:30.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:30.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:30.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:30.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:30.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:30.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:30.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:30.345 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.345 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.346 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:30.346 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.21372306, 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.347 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.348 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:30.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.348 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:30.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:30.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:30.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:30.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:30.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:30.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:30.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:30.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:30.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:30.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:30.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:30.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:30.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:30.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:30.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:30.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:30.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:30.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:30.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:30.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:30.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:30.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:30.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:30.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.364 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.364 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.364 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:30.365 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:30.365 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.23184698, 2020-06-12T02:36:30.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:30.365 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.365 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.366 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:30.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:30.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:30.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:30.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:30.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:30.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:30.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:30.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:30.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:30.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:30.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:30.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:30.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:30.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:30.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:30.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:30.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:30.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:30.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:30.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:30.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:30.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.379 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.231653664, 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.381 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:30.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.381 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:30.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:30.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:30.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:30.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:30.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:30.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:30.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:30.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:30.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:30.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:30.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:30.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:30.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:30.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:30.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:30.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:30.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:30.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.395 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.395 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:30.396 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:30.396 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.231505209000002, 2020-06-12T02:36:30.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:30.396 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.396 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.397 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:30.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.398 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:30.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:30.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:30.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:30.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:30.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:30.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:30.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:30.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:30.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:30.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:30.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:30.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:30.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:30.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:30.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:30.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.410 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:30.410 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:30.410 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.224072259, 2020-06-12T02:36:30.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:30.410 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.411 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:30.411 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:30.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:30.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:30.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:30.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:30.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:30.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:30.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:30.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:30.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:30.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.419 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.420 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:30.420 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:30.421 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.221663758999998, 2020-06-12T02:36:30.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:30.421 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.421 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:30.421 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:30.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:30.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:30.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:30.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:30.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:30.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:30.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:30.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:30.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:30.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:30.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:30.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:30.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:30.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:30.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:30.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:30.432 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.432 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.432 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.433 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:30.434 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:30.434 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.219636613999999, 2020-06-12T02:36:30.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:30.435 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.435 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:30.435 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:30.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:30.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:30.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:30.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:30.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:30.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:30.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:30.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:30.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:30.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:30.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:30.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:30.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:30.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.447 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.448 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:30.448 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:30.448 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.208586781000001, 2020-06-12T02:36:30.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:30.449 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.449 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:30.449 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:30.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:30.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:30.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:30.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:30.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:30.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:30.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:30.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:30.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:30.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:30.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:30.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:30.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:30.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:30.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:30.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:30.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.461 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.204373764, 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.462 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.463 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:30.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.464 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:30.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:30.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:30.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:30.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:30.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:30.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:30.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:30.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:30.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:30.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:30.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:30.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:30.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:30.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:30.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:30.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:30.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:30.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:30.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.477 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.478 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:30.478 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:30.478 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.204190564999999, 2020-06-12T02:36:30.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:30.479 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.479 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.480 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.480 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:30.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.480 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:30.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:30.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:30.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:30.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:30.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:30.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:30.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:30.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:30.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:30.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:30.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:30.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:30.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:30.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:30.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:30.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:30.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:30.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:30.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:30.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:30.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:30.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.495 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.496 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:30.496 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:30.497 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.747272520999999, 2020-06-12T02:36:30.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:30.497 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.497 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:30.497 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:30.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:30.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:30.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:30.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:30.508 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.508 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.508 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.509 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:36:30.509 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:30.509 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.21681092399999999, 2020-06-12T02:36:30.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:36:30.509 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.510 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:36:30.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.511 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:30.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:36:30.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:36:30.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:36:30.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:36:30.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:36:30.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:36:30.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:36:30.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:36:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:36:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:36:30.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:36:30.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:30.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:36:30.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:36:30.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:30.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:36:30.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:36:30.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:30.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:36:30.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:36:30.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:36:30.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:36:30.530 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.530 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:30.531 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 0.21655180500000001, 2020-06-12T02:36:30.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:36:30.532 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:30.532 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:30.532 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:30.532 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:30.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:30.533 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:36:30.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.533 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:30.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:30.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:30.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:30.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:30.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:30.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:36:30.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:30.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:36:30.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:36:30.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:30.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:36:30.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:36:30.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:30.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:36:30.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:36:30.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:36:30.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:36:30.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:30.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:36:30.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:36:30.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:36:30.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:36:30.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:30.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:36:30.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:36:30.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:30.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:36:30.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:36:30.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:30.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:30.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:30.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:36:30.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:36:30.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.548 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.548 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.548 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:30.549 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:30.549 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:30.550 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:30.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:30.545+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:30.624 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:36:30.625 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-06-12T02:36:30.625 INFO:tasks.thrashosds.thrasher:test_pool_min_size 2020-06-12T02:36:30.625 INFO:tasks.thrashosds.thrasher:inning osd 2020-06-12T02:36:30.625 INFO:tasks.thrashosds.thrasher:Adding osd 1 2020-06-12T02:36:30.627 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 1 2020-06-12T02:36:30.651 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:30.645+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:30.669 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:30.669 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:30.669 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:30.670 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:30.679 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:30.747 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:30.734+0000 7f47a9ceb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:30.752 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:30.746+0000 7f47a8a89700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:30.775 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:30.769+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:30.837 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:30.838 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:30.838 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:30.838 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:30.838 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:30.847 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:30.891 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:30.885+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:30.910 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:36:30.901+0000 7fab9fda4700 -1 mon.b@0(leader).osd e83 definitely_dead 0 2020-06-12T02:36:30.954 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:30.950+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:30.971 INFO:tasks.rados.rados.0.smithi142.stdout:373: done (3 left) 2020-06-12T02:36:30.972 INFO:tasks.rados.rados.0.smithi142.stdout:374: rollback oid 29 current snap is 34 2020-06-12T02:36:30.972 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 29 to 31 2020-06-12T02:36:30.972 INFO:tasks.rados.rados.0.smithi142.stdout:375: write (excl) oid 45 current snap is 34 2020-06-12T02:36:30.972 INFO:tasks.rados.rados.0.smithi142.stdout:375: seq_num 164 ranges {756348=784249,2063988=686387} 2020-06-12T02:36:30.992 INFO:tasks.rados.rados.0.smithi142.stdout:375: writing smithi14213939-45 from 756348 to 1540597 tid 1 2020-06-12T02:36:30.993 INFO:teuthology.orchestra.run.smithi142.stderr:marked in osd.1. 2020-06-12T02:36:31.002 INFO:tasks.rados.rados.0.smithi142.stdout:375: writing smithi14213939-45 from 2063988 to 2750375 tid 2 2020-06-12T02:36:31.002 INFO:tasks.rados.rados.0.smithi142.stdout:376: write (excl) oid 19 current snap is 34 2020-06-12T02:36:31.003 INFO:tasks.rados.rados.0.smithi142.stdout:376: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2020-06-12T02:36:31.003 INFO:tasks.thrashosds.thrasher:Added osd 1 2020-06-12T02:36:31.003 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2020-06-12T02:36:31.004 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:31.005 INFO:tasks.rados.rados.0.smithi142.stdout:376: writing smithi14213939-19 from 773155 to 1232653 tid 1 2020-06-12T02:36:31.009 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:31.010 INFO:tasks.rados.rados.0.smithi142.stdout:376: writing smithi14213939-19 from 1722470 to 2152515 tid 2 2020-06-12T02:36:31.013 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:31.013 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:31.014 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:31.015 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.862318135000002, 2020-06-12T02:36:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:31.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:31.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:31.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:31.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:31.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:31.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:31.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.715804624, 2020-06-12T02:36:31.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:31.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:31.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:31.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:31.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:31.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.042 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:31.044 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 27.03825595, 2020-06-12T02:36:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.045 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:31.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:31.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:31.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:31.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:31.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:31.062 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 27.037492021999999, 2020-06-12T02:36:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:31.081 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.814686967, 2020-06-12T02:36:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:31.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:31.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:31.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:31.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:31.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:31.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:31.096 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.806400679999999, 2020-06-12T02:36:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.098 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:31.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:31.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:31.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:31.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.112 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.799371436000001, 2020-06-12T02:36:31.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.115 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:31.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:31.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:31.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:31.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:31.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:31.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:31.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:31.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:31.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:31.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:31.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.799233985000001, 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.129 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:31.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:31.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:31.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:31.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:31.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:31.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:31.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:31.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:31.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:31.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:31.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.998446246, 2020-06-12T02:36:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:31.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:31.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:31.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:31.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:31.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:31.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:31.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:31.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:31.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:31.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:31.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:31.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:31.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:31.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:31.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:31.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:31.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:31.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:31.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.169 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.170 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:31.170 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:31.171 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.998299631999998, 2020-06-12T02:36:31.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:31.172 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.172 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.172 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.174 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:31.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.175 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:31.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:31.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:31.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:31.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:31.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:31.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:31.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:31.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:31.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:31.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:31.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:31.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:31.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:31.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:31.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:31.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:31.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:31.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:31.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:31.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:31.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:31.190 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.190 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.190 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.191 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:31.191 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:31.191 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.042286757999999, 2020-06-12T02:36:31.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:31.192 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.192 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.193 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.193 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:31.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.193 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:31.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:31.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:31.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:31.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:31.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:31.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:31.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:31.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:31.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:31.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:31.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:31.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:31.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:31.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:31.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:31.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:31.207 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.207 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.207 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.208 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:31.208 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:31.208 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.036555244999999, 2020-06-12T02:36:31.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:31.209 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.209 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.210 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:31.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.210 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:31.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:31.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:31.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:31.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:31.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:31.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:31.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:31.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:31.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:31.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:31.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:31.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:31.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:31.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:31.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:31.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:31.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:31.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:31.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.224 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.224 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.224 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:31.225 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:31.225 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.036061729, 2020-06-12T02:36:31.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:31.225 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.225 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:31.226 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.226 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.226 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.226 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:31.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.227 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:31.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:31.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:31.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:31.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:31.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:31.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:31.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:31.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:31.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:31.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:31.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:31.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:31.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:31.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:31.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:31.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:31.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:31.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:31.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:31.240 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:31.241 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.035967721999999, 2020-06-12T02:36:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.242 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.243 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.243 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.243 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:31.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.243 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:31.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:31.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:31.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:31.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:31.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:31.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:31.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:31.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:31.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:31.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:31.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:31.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:31.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:31.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:31.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:31.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:31.256 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:31.258 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:31.258 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 15.997806692999999, 2020-06-12T02:36:31.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:31.258 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.258 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:31.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:31.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:31.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:31.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:31.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:31.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:31.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:31.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:31.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:31.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:31.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:31.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:31.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:31.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:31.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.268 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.269 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.269 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:31.269 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:31.270 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.9570097000000004, 2020-06-12T02:36:31.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:31.270 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.270 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.270 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.271 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.271 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.271 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:31.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.271 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:31.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:31.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:31.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:31.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:31.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:31.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:31.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:31.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:31.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:31.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:31.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:31.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:31.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:31.281 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.281 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.281 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.9567676340000002, 2020-06-12T02:36:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:31.282 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.283 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.283 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.283 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.283 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.284 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:31.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.284 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:31.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:31.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:31.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:31.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:31.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:31.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:31.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:31.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:31.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:31.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:31.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.294 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.295 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:31.295 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:31.295 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.956557943, 2020-06-12T02:36:31.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.296 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:31.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.297 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:31.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:31.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:31.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:31.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:31.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:31.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:31.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:31.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:31.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:31.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:31.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:31.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:31.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:31.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:31.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.308 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:31.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:31.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.9410237820000003, 2020-06-12T02:36:31.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:31.309 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.310 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:31.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.311 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:31.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:31.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:31.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:31.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:31.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:31.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:31.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:31.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:31.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:31.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:31.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:31.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.321 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.322 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:36:31.322 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:31.322 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 1.042963748, 2020-06-12T02:36:31.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:36:31.323 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:31.324 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:31.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:31.325 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:31.325 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:31.325 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:36:31.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.340 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:31.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:31.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:31.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:31.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:31.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:31.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:36:31.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:31.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:36:31.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:36:31.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:31.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:36:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:36:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:31.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:36:31.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:36:31.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:31.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:36:31.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:36:31.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:31.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:36:31.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:36:31.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:31.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:31.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:31.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:36:31.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:31.356 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:31.361 INFO:tasks.rados.rados.0.smithi142.stdout:376: writing smithi14213939-19 from 2648676 to 2773155 tid 3 2020-06-12T02:36:31.361 INFO:tasks.rados.rados.0.smithi142.stdout:377: write (excl) oid 25 current snap is 34 2020-06-12T02:36:31.362 INFO:tasks.rados.rados.0.smithi142.stdout:377: seq_num 166 ranges {789962=534747,1780952=690056} 2020-06-12T02:36:31.362 INFO:tasks.rados.rados.0.smithi142.stdout:377: writing smithi14213939-25 from 789962 to 1324709 tid 1 2020-06-12T02:36:31.362 INFO:tasks.rados.rados.0.smithi142.stdout:377: writing smithi14213939-25 from 1780952 to 2471008 tid 2 2020-06-12T02:36:31.362 INFO:tasks.rados.rados.0.smithi142.stdout:378: snap_remove snap 33 2020-06-12T02:36:31.362 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.094+0000 7fc93a427700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.363 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.098+0000 7fc9391c5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.363 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:31.363 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:31.364 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2020-06-12T02:36:30.957030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7659332,"kb_used_data":319244,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652943548,"statfs":{"total":676457349120,"available":668614193152,"internally_reserved":7516192768,"allocated":326905856,"data_stored":418517595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15092249,"num_objects":-9,"num_object_clones":-9,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9,"num_whiteouts":2,"num_read":16,"num_read_kb":24729,"num_write":6,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.949314"},"pg_stats":[{"pgid":"1.f","version":"81'64","reported_seq":"258","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.204100+0000","last_change":"2020-06-12T02:36:28.205926+0000","last_active":"2020-06-12T02:36:28.204100+0000","last_peered":"2020-06-12T02:36:28.204100+0000","last_clean":"2020-06-12T02:36:28.204100+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:28.204100+0000","last_undegraded":"2020-06-12T02:36:28.204100+0000","last_fullsized":"2020-06-12T02:36:28.204100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13539670,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":14638,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.e","version":"77'86","reported_seq":"158","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.999588+0000","last_change":"2020-06-12T02:36:24.943776+0000","last_active":"2020-06-12T02:36:25.999588+0000","last_peered":"2020-06-12T02:36:25.999588+0000","last_clean":"2020-06-12T02:36:25.999588+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:25.999588+0000","last_undegraded":"2020-06-12T02:36:25.999588+0000","last_fullsized":"2020-06-12T02:36:25.999588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.d","version":"81'166","reported_seq":"416","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.224038+0000","last_change":"2020-06-12T02:36:28.224038+0000","last_active":"2020-06-12T02:36:28.224038+0000","last_peered":"2020-06-12T02:36:28.224038+0000","last_clean":"2020-06-12T02:36:28.224038+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:28.224038+0000","last_undegraded":"2020-06-12T02:36:28.224038+0000","last_fullsized":"2020-06-12T02:36:28.224038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32617364,"num_objects":14,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":75,"num_read_kb":78725,"num_write":72,"num_write_kb":35013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"223","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.179429+0000","last_change":"2020-06-12T02:36:28.179429+0000","last_active":"2020-06-12T02:36:28.179429+0000","last_peered":"2020-06-12T02:36:28.179429+0000","last_clean":"2020-06-12T02:36:28.179429+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:28.179429+0000","last_undegraded":"2020-06-12T02:36:28.179429+0000","last_fullsized":"2020-06-12T02:36:28.179429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.b","version":"77'63","reported_seq":"261","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.996923+0000","last_change":"2020-06-12T02:36:24.944403+0000","last_active":"2020-06-12T02:36:25.996923+0000","last_peered":"2020-06-12T02:36:25.996923+0000","last_clean":"2020-06-12T02:36:25.996923+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:25.996923+0000","last_undegraded":"2020-06-12T02:36:25.996923+0000","last_fullsized":"2020-06-12T02:36:25.996923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10375040,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.a","version":"81'19","reported_seq":"123","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.185385+0000","last_change":"2020-06-12T02:36:28.185385+0000","last_active":"2020-06-12T02:36:28.185385+0000","last_peered":"2020-06-12T02:36:28.185385+0000","last_clean":"2020-06-12T02:36:28.185385+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:28.185385+0000","last_undegraded":"2020-06-12T02:36:28.185385+0000","last_fullsized":"2020-06-12T02:36:28.185385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.9","version":"81'86","reported_seq":"159","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.191432+0000","last_change":"2020-06-12T02:36:28.194117+0000","last_active":"2020-06-12T02:36:28.191432+0000","last_peered":"2020-06-12T02:36:28.191432+0000","last_clean":"2020-06-12T02:36:28.191432+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:28.191432+0000","last_undegraded":"2020-06-12T02:36:28.191432+0000","last_fullsized":"2020-06-12T02:36:28.191432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10286221,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":9,"num_write":41,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.8","version":"81'75","reported_seq":"164","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.201254+0000","last_change":"2020-06-12T02:36:28.201254+0000","last_active":"2020-06-12T02:36:28.201254+0000","last_peered":"2020-06-12T02:36:28.201254+0000","last_clean":"2020-06-12T02:36:28.201254+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:28.201254+0000","last_undegraded":"2020-06-12T02:36:28.201254+0000","last_fullsized":"2020-06-12T02:36:28.201254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":75,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16967697,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":8036,"num_write":31,"num_write_kb":12914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.7","version":"81'165","reported_seq":"363","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.213632+0000","last_change":"2020-06-12T02:36:28.213632+0000","last_active":"2020-06-12T02:36:28.213632+0000","last_peered":"2020-06-12T02:36:28.213632+0000","last_clean":"2020-06-12T02:36:28.213632+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:28.213632+0000","last_undegraded":"2020-06-12T02:36:28.213632+0000","last_fullsized":"2020-06-12T02:36:28.213632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":165,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16581471,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":48924,"num_write":70,"num_write_kb":23034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"81'73","reported_seq":"268","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.202442+0000","last_change":"2020-06-12T02:36:28.203972+0000","last_active":"2020-06-12T02:36:28.202442+0000","last_peered":"2020-06-12T02:36:28.202442+0000","last_clean":"2020-06-12T02:36:28.202442+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:28.202442+0000","last_undegraded":"2020-06-12T02:36:28.202442+0000","last_fullsized":"2020-06-12T02:36:28.202442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8642849,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":28345,"num_write":30,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.1","version":"81'43","reported_seq":"244","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.188124+0000","last_change":"2020-06-12T02:36:28.189686+0000","last_active":"2020-06-12T02:36:28.188124+0000","last_peered":"2020-06-12T02:36:28.188124+0000","last_clean":"2020-06-12T02:36:28.188124+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:28.188124+0000","last_undegraded":"2020-06-12T02:36:28.188124+0000","last_fullsized":"2020-06-12T02:36:28.188124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"121","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.177940+0000","last_change":"2020-06-12T02:36:28.179669+0000","last_active":"2020-06-12T02:36:28.177940+0000","last_peered":"2020-06-12T02:36:28.177940+0000","last_clean":"2020-06-12T02:36:28.177940+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:28.177940+0000","last_undegraded":"2020-06-12T02:36:28.177940+0000","last_fullsized":"2020-06-12T02:36:28.177940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.2","version":"81'205","reported_seq":"434","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.209984+0000","last_change":"2020-06-12T02:36:28.209984+0000","last_active":"2020-06-12T02:36:28.209984+0000","last_peered":"2020-06-12T02:36:28.209984+0000","last_clean":"2020-06-12T02:36:28.209984+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:28.209984+0000","last_undegraded":"2020-06-12T02:36:28.209984+0000","last_fullsized":"2020-06-12T02:36:28.209984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22145079,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":37,"num_read_kb":27695,"num_write":79,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.3","version":"77'129","reported_seq":"353","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.997089+0000","last_change":"2020-06-12T02:36:24.944567+0000","last_active":"2020-06-12T02:36:25.997089+0000","last_peered":"2020-06-12T02:36:25.997089+0000","last_clean":"2020-06-12T02:36:25.997089+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:25.997089+0000","last_undegraded":"2020-06-12T02:36:25.997089+0000","last_fullsized":"2020-06-12T02:36:25.997089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23300378,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":53,"num_read_kb":56068,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"81'174","reported_seq":"373","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.205467+0000","last_change":"2020-06-12T02:36:28.206769+0000","last_active":"2020-06-12T02:36:28.205467+0000","last_peered":"2020-06-12T02:36:28.205467+0000","last_clean":"2020-06-12T02:36:28.205467+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:28.205467+0000","last_undegraded":"2020-06-12T02:36:28.205467+0000","last_fullsized":"2020-06-12T02:36:28.205467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":174,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22083191,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":65,"num_read_kb":85327,"num_write":73,"num_write_kb":15977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.5","version":"81'181","reported_seq":"369","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.220656+0000","last_change":"2020-06-12T02:36:28.220656+0000","last_active":"2020-06-12T02:36:28.220656+0000","last_peered":"2020-06-12T02:36:28.220656+0000","last_clean":"2020-06-12T02:36:28.220656+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:28.220656+0000","last_undegraded":"2020-06-12T02:36:28.220656+0000","last_fullsized":"2020-06-12T02:36:28.220656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":181,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26131369,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":45,"num_read_kb":38628,"num_write":79,"num_write_kb":24035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368570368,"data_stored":470769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089216,"kb_used_data":40632,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282624,"statfs":{"total":96636764160,"available":95521406976,"internally_reserved":1073741824,"allocated":41607168,"data_stored":51118939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.528}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.966},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1779999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.319},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.383}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.0899999999999999},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.625}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.8079999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.0699999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.4129999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.202}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087856,"kb_used_data":39272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283984,"statfs":{"total":96636764160,"available":95522799616,"internally_reserved":1073741824,"allocated":40214528,"data_stored":53946945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.222},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.9370000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.7450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.5299999999999998},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4609999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5660000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.8660000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.968},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1970000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":4.0289999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.274},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120132,"kb_used_data":71548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251708,"statfs":{"total":96636764160,"available":95489748992,"internally_reserved":1073741824,"allocated":73265152,"data_stored":94381399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.4910000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.319}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.004}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.667},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":2.411}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.583},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0870000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.2370000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":3.1429999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.7280000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.8340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":4.2309999999999999}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071184,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300656,"statfs":{"total":96636764160,"available":95539871744,"internally_reserved":1073741824,"allocated":23142400,"data_stored":29881687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.141}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.5870000000000002},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":3.8039999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":4.8819999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":5.2859999999999996},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":4.2460000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":4.1609999999999996},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":4.3019999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":4.7089999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095088,"kb_used_data":46504,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276752,"statfs":{"total":96636764160,"available":95515394048,"internally_reserved":1073741824,"allocated":47620096,"data_stored":58700635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":6.4800000000000004}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":4.0300000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.73}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":4.5549999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.831}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.554},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":3.7999999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.702}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104828,"kb_used_data":56244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267012,"statfs":{"total":96636764160,"available":95505420288,"internally_reserved":1073741824,"allocated":57593856,"data_stored":75993947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.887},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":2.1120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.778}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":4.5629999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":3.121},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5710000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":4.0650000000000004},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":4.1360000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.9830000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":4.6449999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":3.3199999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":4.4180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091028,"kb_used_data":42444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280812,"statfs":{"total":96636764160,"available":95519551488,"internally_reserved":1073741824,"allocated":43462656,"data_stored":54494043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":5.1210000000000004},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":5.4720000000000004}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":4.609}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.238},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":4.8810000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":7.0709999999999997},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.925}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":5.3819999999999997},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":6.6580000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.6379999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":7.2089999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":6.8159999999999998}]}]}]}} 2020-06-12T02:36:31.366 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:31.367 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:31.368 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:31.349+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:31.368 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.098+0000 7f86e7e2d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.369 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.106+0000 7f86e6bcb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.369 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.369 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.369 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.369 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.370 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.370 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.370 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.370 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:31.370 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:31.372 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:31.459 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:31.454+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:31.520 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.506+0000 7f095e004700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.522 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:31.522 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:31.525 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.522+0000 7f095cda2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.531 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:31.562 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:31.558+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:31.637 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:31.698 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:31.701 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:31.710 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2020-06-12T02:36:30.957030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7659332,"kb_used_data":319244,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652943548,"statfs":{"total":676457349120,"available":668614193152,"internally_reserved":7516192768,"allocated":326905856,"data_stored":418517595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15092249,"num_objects":-9,"num_object_clones":-9,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9,"num_whiteouts":2,"num_read":16,"num_read_kb":24729,"num_write":6,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.949314"},"pg_stats":[{"pgid":"1.f","version":"81'64","reported_seq":"258","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.204100+0000","last_change":"2020-06-12T02:36:28.205926+0000","last_active":"2020-06-12T02:36:28.204100+0000","last_peered":"2020-06-12T02:36:28.204100+0000","last_clean":"2020-06-12T02:36:28.204100+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:28.204100+0000","last_undegraded":"2020-06-12T02:36:28.204100+0000","last_fullsized":"2020-06-12T02:36:28.204100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13539670,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":14638,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.e","version":"77'86","reported_seq":"158","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.999588+0000","last_change":"2020-06-12T02:36:24.943776+0000","last_active":"2020-06-12T02:36:25.999588+0000","last_peered":"2020-06-12T02:36:25.999588+0000","last_clean":"2020-06-12T02:36:25.999588+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:25.999588+0000","last_undegraded":"2020-06-12T02:36:25.999588+0000","last_fullsized":"2020-06-12T02:36:25.999588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.d","version":"81'166","reported_seq":"416","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.224038+0000","last_change":"2020-06-12T02:36:28.224038+0000","last_active":"2020-06-12T02:36:28.224038+0000","last_peered":"2020-06-12T02:36:28.224038+0000","last_clean":"2020-06-12T02:36:28.224038+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:28.224038+0000","last_undegraded":"2020-06-12T02:36:28.224038+0000","last_fullsized":"2020-06-12T02:36:28.224038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32617364,"num_objects":14,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":75,"num_read_kb":78725,"num_write":72,"num_write_kb":35013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"223","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.179429+0000","last_change":"2020-06-12T02:36:28.179429+0000","last_active":"2020-06-12T02:36:28.179429+0000","last_peered":"2020-06-12T02:36:28.179429+0000","last_clean":"2020-06-12T02:36:28.179429+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:28.179429+0000","last_undegraded":"2020-06-12T02:36:28.179429+0000","last_fullsized":"2020-06-12T02:36:28.179429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.b","version":"77'63","reported_seq":"261","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.996923+0000","last_change":"2020-06-12T02:36:24.944403+0000","last_active":"2020-06-12T02:36:25.996923+0000","last_peered":"2020-06-12T02:36:25.996923+0000","last_clean":"2020-06-12T02:36:25.996923+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:25.996923+0000","last_undegraded":"2020-06-12T02:36:25.996923+0000","last_fullsized":"2020-06-12T02:36:25.996923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10375040,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.a","version":"81'19","reported_seq":"123","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.185385+0000","last_change":"2020-06-12T02:36:28.185385+0000","last_active":"2020-06-12T02:36:28.185385+0000","last_peered":"2020-06-12T02:36:28.185385+0000","last_clean":"2020-06-12T02:36:28.185385+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:28.185385+0000","last_undegraded":"2020-06-12T02:36:28.185385+0000","last_fullsized":"2020-06-12T02:36:28.185385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.9","version":"81'86","reported_seq":"159","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.191432+0000","last_change":"2020-06-12T02:36:28.194117+0000","last_active":"2020-06-12T02:36:28.191432+0000","last_peered":"2020-06-12T02:36:28.191432+0000","last_clean":"2020-06-12T02:36:28.191432+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:28.191432+0000","last_undegraded":"2020-06-12T02:36:28.191432+0000","last_fullsized":"2020-06-12T02:36:28.191432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10286221,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":9,"num_write":41,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.8","version":"81'75","reported_seq":"164","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.201254+0000","last_change":"2020-06-12T02:36:28.201254+0000","last_active":"2020-06-12T02:36:28.201254+0000","last_peered":"2020-06-12T02:36:28.201254+0000","last_clean":"2020-06-12T02:36:28.201254+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:28.201254+0000","last_undegraded":"2020-06-12T02:36:28.201254+0000","last_fullsized":"2020-06-12T02:36:28.201254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":75,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16967697,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":8036,"num_write":31,"num_write_kb":12914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.7","version":"81'165","reported_seq":"363","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.213632+0000","last_change":"2020-06-12T02:36:28.213632+0000","last_active":"2020-06-12T02:36:28.213632+0000","last_peered":"2020-06-12T02:36:28.213632+0000","last_clean":"2020-06-12T02:36:28.213632+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:28.213632+0000","last_undegraded":"2020-06-12T02:36:28.213632+0000","last_fullsized":"2020-06-12T02:36:28.213632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":165,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16581471,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":48924,"num_write":70,"num_write_kb":23034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"81'73","reported_seq":"268","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.202442+0000","last_change":"2020-06-12T02:36:28.203972+0000","last_active":"2020-06-12T02:36:28.202442+0000","last_peered":"2020-06-12T02:36:28.202442+0000","last_clean":"2020-06-12T02:36:28.202442+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:28.202442+0000","last_undegraded":"2020-06-12T02:36:28.202442+0000","last_fullsized":"2020-06-12T02:36:28.202442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8642849,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":28345,"num_write":30,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.1","version":"81'43","reported_seq":"244","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.188124+0000","last_change":"2020-06-12T02:36:28.189686+0000","last_active":"2020-06-12T02:36:28.188124+0000","last_peered":"2020-06-12T02:36:28.188124+0000","last_clean":"2020-06-12T02:36:28.188124+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:28.188124+0000","last_undegraded":"2020-06-12T02:36:28.188124+0000","last_fullsized":"2020-06-12T02:36:28.188124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"121","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.177940+0000","last_change":"2020-06-12T02:36:28.179669+0000","last_active":"2020-06-12T02:36:28.177940+0000","last_peered":"2020-06-12T02:36:28.177940+0000","last_clean":"2020-06-12T02:36:28.177940+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:28.177940+0000","last_undegraded":"2020-06-12T02:36:28.177940+0000","last_fullsized":"2020-06-12T02:36:28.177940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.2","version":"81'205","reported_seq":"434","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.209984+0000","last_change":"2020-06-12T02:36:28.209984+0000","last_active":"2020-06-12T02:36:28.209984+0000","last_peered":"2020-06-12T02:36:28.209984+0000","last_clean":"2020-06-12T02:36:28.209984+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:28.209984+0000","last_undegraded":"2020-06-12T02:36:28.209984+0000","last_fullsized":"2020-06-12T02:36:28.209984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22145079,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":37,"num_read_kb":27695,"num_write":79,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.3","version":"77'129","reported_seq":"353","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.997089+0000","last_change":"2020-06-12T02:36:24.944567+0000","last_active":"2020-06-12T02:36:25.997089+0000","last_peered":"2020-06-12T02:36:25.997089+0000","last_clean":"2020-06-12T02:36:25.997089+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:25.997089+0000","last_undegraded":"2020-06-12T02:36:25.997089+0000","last_fullsized":"2020-06-12T02:36:25.997089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23300378,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":53,"num_read_kb":56068,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"81'174","reported_seq":"373","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.205467+0000","last_change":"2020-06-12T02:36:28.206769+0000","last_active":"2020-06-12T02:36:28.205467+0000","last_peered":"2020-06-12T02:36:28.205467+0000","last_clean":"2020-06-12T02:36:28.205467+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:28.205467+0000","last_undegraded":"2020-06-12T02:36:28.205467+0000","last_fullsized":"2020-06-12T02:36:28.205467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":174,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22083191,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":65,"num_read_kb":85327,"num_write":73,"num_write_kb":15977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.5","version":"81'181","reported_seq":"369","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.220656+0000","last_change":"2020-06-12T02:36:28.220656+0000","last_active":"2020-06-12T02:36:28.220656+0000","last_peered":"2020-06-12T02:36:28.220656+0000","last_clean":"2020-06-12T02:36:28.220656+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:28.220656+0000","last_undegraded":"2020-06-12T02:36:28.220656+0000","last_fullsized":"2020-06-12T02:36:28.220656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":181,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26131369,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":45,"num_read_kb":38628,"num_write":79,"num_write_kb":24035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368570368,"data_stored":470769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089216,"kb_used_data":40632,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282624,"statfs":{"total":96636764160,"available":95521406976,"internally_reserved":1073741824,"allocated":41607168,"data_stored":51118939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.528}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.966},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1779999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.319},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.383}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.0899999999999999},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.625}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.8079999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.0699999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.4129999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.202}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087856,"kb_used_data":39272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283984,"statfs":{"total":96636764160,"available":95522799616,"internally_reserved":1073741824,"allocated":40214528,"data_stored":53946945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.222},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.9370000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.7450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.5299999999999998},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4609999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5660000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.8660000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.968},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1970000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":4.0289999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.274},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120132,"kb_used_data":71548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251708,"statfs":{"total":96636764160,"available":95489748992,"internally_reserved":1073741824,"allocated":73265152,"data_stored":94381399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.4910000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.319}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.004}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.667},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":2.411}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.583},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0870000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.2370000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":3.1429999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.7280000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.8340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":4.2309999999999999}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071184,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300656,"statfs":{"total":96636764160,"available":95539871744,"internally_reserved":1073741824,"allocated":23142400,"data_stored":29881687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.141}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.5870000000000002},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":3.8039999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":4.8819999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":5.2859999999999996},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":4.2460000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":4.1609999999999996},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":4.3019999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":4.7089999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095088,"kb_used_data":46504,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276752,"statfs":{"total":96636764160,"available":95515394048,"internally_reserved":1073741824,"allocated":47620096,"data_stored":58700635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":6.4800000000000004}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":4.0300000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.73}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":4.5549999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.831}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.554},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":3.7999999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.702}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104828,"kb_used_data":56244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267012,"statfs":{"total":96636764160,"available":95505420288,"internally_reserved":1073741824,"allocated":57593856,"data_stored":75993947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.887},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":2.1120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.778}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":4.5629999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":3.121},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5710000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":4.0650000000000004},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":4.1360000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.9830000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":4.6449999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":3.3199999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":4.4180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091028,"kb_used_data":42444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280812,"statfs":{"total":96636764160,"available":95519551488,"internally_reserved":1073741824,"allocated":43462656,"data_stored":54494043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":5.1210000000000004},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":5.4720000000000004}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":4.609}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.238},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":4.8810000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":7.0709999999999997},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.925}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":5.3819999999999997},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":6.6580000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.6379999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":7.2089999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":6.8159999999999998}]}]}]}} 2020-06-12T02:36:31.711 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:31.718 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2020-06-12T02:36:31.718 INFO:tasks.thrashosds.thrasher:doing min_size thrashing 2020-06-12T02:36:31.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-06-12T02:36:31.719 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:31.720 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:31.694+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:31.720 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:31.800 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:31.798+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:31.833 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:31.834 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:31.841 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:31.866 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.854+0000 7f0d70281700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.869 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:31.866+0000 7f0d6f01f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:31.904 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:31.897+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:31.962 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:31.963 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:31.974 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:31.981 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:36:31.983 INFO:tasks.rados.rados.0.smithi142.stdout:378: done (7 left) 2020-06-12T02:36:31.983 INFO:tasks.rados.rados.0.smithi142.stdout:379: copy_from oid 7 from oid 22 current snap is 34 2020-06-12T02:36:31.983 INFO:tasks.rados.rados.0.smithi142.stdout:380: rollback oid 48 current snap is 34 2020-06-12T02:36:31.983 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 48 to 30 2020-06-12T02:36:31.983 INFO:tasks.rados.rados.0.smithi142.stdout:381: write oid 50 current snap is 34 2020-06-12T02:36:31.984 INFO:tasks.rados.rados.0.smithi142.stdout:381: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2020-06-12T02:36:31.984 INFO:tasks.rados.rados.0.smithi142.stdout:381: writing smithi14213939-50 from 406769 to 1016765 tid 1 2020-06-12T02:36:31.992 INFO:tasks.rados.rados.0.smithi142.stdout:381: writing smithi14213939-50 from 1439434 to 1873148 tid 2 2020-06-12T02:36:31.996 INFO:tasks.rados.rados.0.smithi142.stdout:381: writing smithi14213939-50 from 2303522 to 2806769 tid 3 2020-06-12T02:36:31.996 INFO:tasks.rados.rados.0.smithi142.stdout:382: read oid 26 snap 32 2020-06-12T02:36:31.996 INFO:tasks.rados.rados.0.smithi142.stdout:382: expect (ObjNum 138 snap 28 seq_num 138) 2020-06-12T02:36:31.996 INFO:tasks.rados.rados.0.smithi142.stdout:369: finishing write tid 2 to smithi14213939-46 2020-06-12T02:36:31.997 INFO:tasks.rados.rados.0.smithi142.stdout:369: finishing write tid 4 to smithi14213939-46 2020-06-12T02:36:31.997 INFO:tasks.rados.rados.0.smithi142.stdout:371: expect (ObjNum 123 snap 27 seq_num 123) 2020-06-12T02:36:32.015 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:32.009+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:32.048 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:32.054 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2020-06-12T02:36:31.960285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7659332,"kb_used_data":319244,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652943548,"statfs":{"total":676457349120,"available":668614193152,"internally_reserved":7516192768,"allocated":326905856,"data_stored":418517595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12691152,"num_objects":-7,"num_object_clones":-7,"num_object_copies":-21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":2,"num_read":12,"num_read_kb":18326,"num_write":6,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.789014"},"pg_stats":[{"pgid":"1.f","version":"81'64","reported_seq":"258","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.204100+0000","last_change":"2020-06-12T02:36:28.205926+0000","last_active":"2020-06-12T02:36:28.204100+0000","last_peered":"2020-06-12T02:36:28.204100+0000","last_clean":"2020-06-12T02:36:28.204100+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:28.204100+0000","last_undegraded":"2020-06-12T02:36:28.204100+0000","last_fullsized":"2020-06-12T02:36:28.204100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13539670,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":14638,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.e","version":"77'86","reported_seq":"158","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.999588+0000","last_change":"2020-06-12T02:36:24.943776+0000","last_active":"2020-06-12T02:36:25.999588+0000","last_peered":"2020-06-12T02:36:25.999588+0000","last_clean":"2020-06-12T02:36:25.999588+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:25.999588+0000","last_undegraded":"2020-06-12T02:36:25.999588+0000","last_fullsized":"2020-06-12T02:36:25.999588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.d","version":"81'166","reported_seq":"416","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.224038+0000","last_change":"2020-06-12T02:36:28.224038+0000","last_active":"2020-06-12T02:36:28.224038+0000","last_peered":"2020-06-12T02:36:28.224038+0000","last_clean":"2020-06-12T02:36:28.224038+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:28.224038+0000","last_undegraded":"2020-06-12T02:36:28.224038+0000","last_fullsized":"2020-06-12T02:36:28.224038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32617364,"num_objects":14,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":75,"num_read_kb":78725,"num_write":72,"num_write_kb":35013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"223","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.179429+0000","last_change":"2020-06-12T02:36:28.179429+0000","last_active":"2020-06-12T02:36:28.179429+0000","last_peered":"2020-06-12T02:36:28.179429+0000","last_clean":"2020-06-12T02:36:28.179429+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:28.179429+0000","last_undegraded":"2020-06-12T02:36:28.179429+0000","last_fullsized":"2020-06-12T02:36:28.179429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.b","version":"77'63","reported_seq":"261","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.996923+0000","last_change":"2020-06-12T02:36:24.944403+0000","last_active":"2020-06-12T02:36:25.996923+0000","last_peered":"2020-06-12T02:36:25.996923+0000","last_clean":"2020-06-12T02:36:25.996923+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:25.996923+0000","last_undegraded":"2020-06-12T02:36:25.996923+0000","last_fullsized":"2020-06-12T02:36:25.996923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10375040,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.a","version":"81'19","reported_seq":"123","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.185385+0000","last_change":"2020-06-12T02:36:28.185385+0000","last_active":"2020-06-12T02:36:28.185385+0000","last_peered":"2020-06-12T02:36:28.185385+0000","last_clean":"2020-06-12T02:36:28.185385+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:28.185385+0000","last_undegraded":"2020-06-12T02:36:28.185385+0000","last_fullsized":"2020-06-12T02:36:28.185385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.9","version":"81'86","reported_seq":"159","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.191432+0000","last_change":"2020-06-12T02:36:28.194117+0000","last_active":"2020-06-12T02:36:28.191432+0000","last_peered":"2020-06-12T02:36:28.191432+0000","last_clean":"2020-06-12T02:36:28.191432+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:28.191432+0000","last_undegraded":"2020-06-12T02:36:28.191432+0000","last_fullsized":"2020-06-12T02:36:28.191432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10286221,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":9,"num_write":41,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.8","version":"81'75","reported_seq":"164","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.201254+0000","last_change":"2020-06-12T02:36:28.201254+0000","last_active":"2020-06-12T02:36:28.201254+0000","last_peered":"2020-06-12T02:36:28.201254+0000","last_clean":"2020-06-12T02:36:28.201254+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:28.201254+0000","last_undegraded":"2020-06-12T02:36:28.201254+0000","last_fullsized":"2020-06-12T02:36:28.201254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":75,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16967697,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":8036,"num_write":31,"num_write_kb":12914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.7","version":"81'165","reported_seq":"363","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.213632+0000","last_change":"2020-06-12T02:36:28.213632+0000","last_active":"2020-06-12T02:36:28.213632+0000","last_peered":"2020-06-12T02:36:28.213632+0000","last_clean":"2020-06-12T02:36:28.213632+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:28.213632+0000","last_undegraded":"2020-06-12T02:36:28.213632+0000","last_fullsized":"2020-06-12T02:36:28.213632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":165,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16581471,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":48924,"num_write":70,"num_write_kb":23034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"81'73","reported_seq":"268","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.202442+0000","last_change":"2020-06-12T02:36:28.203972+0000","last_active":"2020-06-12T02:36:28.202442+0000","last_peered":"2020-06-12T02:36:28.202442+0000","last_clean":"2020-06-12T02:36:28.202442+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:28.202442+0000","last_undegraded":"2020-06-12T02:36:28.202442+0000","last_fullsized":"2020-06-12T02:36:28.202442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8642849,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":28345,"num_write":30,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.1","version":"81'43","reported_seq":"244","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.188124+0000","last_change":"2020-06-12T02:36:28.189686+0000","last_active":"2020-06-12T02:36:28.188124+0000","last_peered":"2020-06-12T02:36:28.188124+0000","last_clean":"2020-06-12T02:36:28.188124+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:28.188124+0000","last_undegraded":"2020-06-12T02:36:28.188124+0000","last_fullsized":"2020-06-12T02:36:28.188124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"121","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.177940+0000","last_change":"2020-06-12T02:36:28.179669+0000","last_active":"2020-06-12T02:36:28.177940+0000","last_peered":"2020-06-12T02:36:28.177940+0000","last_clean":"2020-06-12T02:36:28.177940+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:28.177940+0000","last_undegraded":"2020-06-12T02:36:28.177940+0000","last_fullsized":"2020-06-12T02:36:28.177940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.2","version":"81'205","reported_seq":"434","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.209984+0000","last_change":"2020-06-12T02:36:28.209984+0000","last_active":"2020-06-12T02:36:28.209984+0000","last_peered":"2020-06-12T02:36:28.209984+0000","last_clean":"2020-06-12T02:36:28.209984+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:28.209984+0000","last_undegraded":"2020-06-12T02:36:28.209984+0000","last_fullsized":"2020-06-12T02:36:28.209984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22145079,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":37,"num_read_kb":27695,"num_write":79,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.3","version":"77'129","reported_seq":"353","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.997089+0000","last_change":"2020-06-12T02:36:24.944567+0000","last_active":"2020-06-12T02:36:25.997089+0000","last_peered":"2020-06-12T02:36:25.997089+0000","last_clean":"2020-06-12T02:36:25.997089+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:25.997089+0000","last_undegraded":"2020-06-12T02:36:25.997089+0000","last_fullsized":"2020-06-12T02:36:25.997089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23300378,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":53,"num_read_kb":56068,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"81'174","reported_seq":"373","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.205467+0000","last_change":"2020-06-12T02:36:28.206769+0000","last_active":"2020-06-12T02:36:28.205467+0000","last_peered":"2020-06-12T02:36:28.205467+0000","last_clean":"2020-06-12T02:36:28.205467+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:28.205467+0000","last_undegraded":"2020-06-12T02:36:28.205467+0000","last_fullsized":"2020-06-12T02:36:28.205467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":174,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22083191,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":65,"num_read_kb":85327,"num_write":73,"num_write_kb":15977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.5","version":"81'181","reported_seq":"369","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.220656+0000","last_change":"2020-06-12T02:36:28.220656+0000","last_active":"2020-06-12T02:36:28.220656+0000","last_peered":"2020-06-12T02:36:28.220656+0000","last_clean":"2020-06-12T02:36:28.220656+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:28.220656+0000","last_undegraded":"2020-06-12T02:36:28.220656+0000","last_fullsized":"2020-06-12T02:36:28.220656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":181,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26131369,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":45,"num_read_kb":38628,"num_write":79,"num_write_kb":24035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368570368,"data_stored":470769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089216,"kb_used_data":40632,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282624,"statfs":{"total":96636764160,"available":95521406976,"internally_reserved":1073741824,"allocated":41607168,"data_stored":51118939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.528}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.966},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1779999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.319},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.383}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.0899999999999999},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.625}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.8079999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.0699999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.4129999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.202}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087856,"kb_used_data":39272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283984,"statfs":{"total":96636764160,"available":95522799616,"internally_reserved":1073741824,"allocated":40214528,"data_stored":53946945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.222},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.9370000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.7450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.5299999999999998},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4609999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5660000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.8660000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.968},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1970000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":4.0289999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.274},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120132,"kb_used_data":71548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251708,"statfs":{"total":96636764160,"available":95489748992,"internally_reserved":1073741824,"allocated":73265152,"data_stored":94381399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.4910000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.319}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.004}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.667},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":2.411}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.583},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0870000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.2370000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":3.1429999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.7280000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.8340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":4.2309999999999999}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071184,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300656,"statfs":{"total":96636764160,"available":95539871744,"internally_reserved":1073741824,"allocated":23142400,"data_stored":29881687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.141}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.5870000000000002},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":3.8039999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":4.8819999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":5.2859999999999996},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":4.2460000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":4.1609999999999996},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":4.3019999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":4.7089999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095088,"kb_used_data":46504,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276752,"statfs":{"total":96636764160,"available":95515394048,"internally_reserved":1073741824,"allocated":47620096,"data_stored":58700635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":6.4800000000000004}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":4.0300000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.73}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":4.5549999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.831}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.554},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":3.7999999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.702}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104828,"kb_used_data":56244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267012,"statfs":{"total":96636764160,"available":95505420288,"internally_reserved":1073741824,"allocated":57593856,"data_stored":75993947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.887},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":2.1120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.778}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":4.5629999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":3.121},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5710000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":4.0650000000000004},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":4.1360000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.9830000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":4.6449999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":3.3199999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":4.4180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091028,"kb_used_data":42444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280812,"statfs":{"total":96636764160,"available":95519551488,"internally_reserved":1073741824,"allocated":43462656,"data_stored":54494043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":5.1210000000000004},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":5.4720000000000004}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":4.609}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.238},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":4.8810000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":7.0709999999999997},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.925}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":5.3819999999999997},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":6.6580000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.6379999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":7.2089999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":6.8159999999999998}]}]}]}} 2020-06-12T02:36:32.072 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:32.115 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:32.110+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:32.118 INFO:tasks.rados.rados.0.smithi142.stdout:369: finishing write tid 5 to smithi14213939-46 2020-06-12T02:36:32.118 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 46 v 169 (ObjNum 162 snap 34 seq_num 162) dirty exists 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:369: left oid 46 (ObjNum 162 snap 34 seq_num 162) 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:369: done (10 left) 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:371: done (9 left) 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:383: delete oid 17 current snap is 34 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:370: finishing copy_from to smithi14213939-12 2020-06-12T02:36:32.119 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 12 v 61 (ObjNum 122 snap 27 seq_num 122) dirty exists 2020-06-12T02:36:32.120 INFO:tasks.rados.rados.0.smithi142.stdout:370: finishing copy_from racing read to smithi14213939-12 2020-06-12T02:36:32.120 INFO:tasks.rados.rados.0.smithi142.stdout:380: finishing rollback tid 1 to smithi14213939-48 2020-06-12T02:36:32.120 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 39 (ObjNum 1 snap 21999 seq_num 3852606384) dirty dne 2020-06-12T02:36:32.120 INFO:tasks.rados.rados.0.smithi142.stdout:375: finishing write tid 1 to smithi14213939-45 2020-06-12T02:36:32.120 INFO:tasks.rados.rados.0.smithi142.stdout:375: finishing write tid 2 to smithi14213939-45 2020-06-12T02:36:32.121 INFO:tasks.rados.rados.0.smithi142.stdout:375: finishing write tid 4 to smithi14213939-45 2020-06-12T02:36:32.121 INFO:tasks.rados.rados.0.smithi142.stdout:375: finishing write tid 5 to smithi14213939-45 2020-06-12T02:36:32.121 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 45 v 79 (ObjNum 164 snap 34 seq_num 164) dirty exists 2020-06-12T02:36:32.121 INFO:tasks.rados.rados.0.smithi142.stdout:375: left oid 45 (ObjNum 164 snap 34 seq_num 164) 2020-06-12T02:36:32.121 INFO:tasks.rados.rados.0.smithi142.stdout:379: finishing copy_from to smithi14213939-7 2020-06-12T02:36:32.122 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 7 v 52 (ObjNum 104 snap 22 seq_num 104) dirty exists 2020-06-12T02:36:32.122 INFO:tasks.rados.rados.0.smithi142.stdout:379: finishing copy_from racing read to smithi14213939-7 2020-06-12T02:36:32.122 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.106+0000 7f6ae8ad6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.128 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.122+0000 7f6ae8ad6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.128 INFO:tasks.rados.rados.0.smithi142.stdout:382: expect (ObjNum 138 snap 28 seq_num 138) 2020-06-12T02:36:32.131 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.131 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.140 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:32.216 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:32.209+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:32.226 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.214+0000 7f6fb29b0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.236 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.222+0000 7f6fb174e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.239 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.240 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.263 INFO:tasks.rados.rados.0.smithi142.stdout:370: done (9 left) 2020-06-12T02:36:32.264 INFO:tasks.rados.rados.0.smithi142.stdout:375: done (8 left) 2020-06-12T02:36:32.268 INFO:tasks.rados.rados.0.smithi142.stdout:379: done (7 left) 2020-06-12T02:36:32.269 INFO:tasks.rados.rados.0.smithi142.stdout:380: done (6 left) 2020-06-12T02:36:32.269 INFO:tasks.rados.rados.0.smithi142.stdout:382: done (5 left) 2020-06-12T02:36:32.269 INFO:tasks.rados.rados.0.smithi142.stdout:383: done (4 left) 2020-06-12T02:36:32.269 INFO:tasks.rados.rados.0.smithi142.stdout:384: read oid 37 snap -1 2020-06-12T02:36:32.269 INFO:tasks.rados.rados.0.smithi142.stdout:384: expect (ObjNum 140 snap 28 seq_num 140) 2020-06-12T02:36:32.273 INFO:tasks.rados.rados.0.smithi142.stdout:385: write (excl) oid 18 current snap is 34 2020-06-12T02:36:32.273 INFO:tasks.rados.rados.0.smithi142.stdout:385: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2020-06-12T02:36:32.273 INFO:tasks.rados.rados.0.smithi142.stdout:385: writing smithi14213939-18 from 440383 to 917230 tid 1 2020-06-12T02:36:32.274 INFO:tasks.rados.rados.0.smithi142.stdout:385: writing smithi14213939-18 from 1556398 to 1993781 tid 2 2020-06-12T02:36:32.278 INFO:tasks.rados.rados.0.smithi142.stdout:385: writing smithi14213939-18 from 2474721 to 2840383 tid 3 2020-06-12T02:36:32.278 INFO:tasks.rados.rados.0.smithi142.stdout:386: rollback oid 48 current snap is 34 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 48 to 31 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:387: snap_create 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:385: finishing write tid 1 to smithi14213939-18 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:386: finishing rollback tid 1 to smithi14213939-48 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 48 v 39 (ObjNum 1 snap 21999 seq_num 3852606384) dirty dne 2020-06-12T02:36:32.279 INFO:tasks.rados.rados.0.smithi142.stdout:385: finishing write tid 2 to smithi14213939-18 2020-06-12T02:36:32.280 INFO:tasks.rados.rados.0.smithi142.stdout:385: finishing write tid 3 to smithi14213939-18 2020-06-12T02:36:32.280 INFO:tasks.rados.rados.0.smithi142.stdout:385: finishing write tid 5 to smithi14213939-18 2020-06-12T02:36:32.280 INFO:tasks.rados.rados.0.smithi142.stdout:385: finishing write tid 6 to smithi14213939-18 2020-06-12T02:36:32.281 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 18 v 193 (ObjNum 169 snap 34 seq_num 169) dirty exists 2020-06-12T02:36:32.281 INFO:tasks.rados.rados.0.smithi142.stdout:385: left oid 18 (ObjNum 169 snap 34 seq_num 169) 2020-06-12T02:36:32.281 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:32.318 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:32.313+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:32.383 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:32.384 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.385 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.385 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2020-06-12T02:36:31.960285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7659332,"kb_used_data":319244,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652943548,"statfs":{"total":676457349120,"available":668614193152,"internally_reserved":7516192768,"allocated":326905856,"data_stored":418517595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12691152,"num_objects":-7,"num_object_clones":-7,"num_object_copies":-21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":2,"num_read":12,"num_read_kb":18326,"num_write":6,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.789014"},"pg_stats":[{"pgid":"1.f","version":"81'64","reported_seq":"258","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.204100+0000","last_change":"2020-06-12T02:36:28.205926+0000","last_active":"2020-06-12T02:36:28.204100+0000","last_peered":"2020-06-12T02:36:28.204100+0000","last_clean":"2020-06-12T02:36:28.204100+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:28.204100+0000","last_undegraded":"2020-06-12T02:36:28.204100+0000","last_fullsized":"2020-06-12T02:36:28.204100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13539670,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":14638,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.e","version":"77'86","reported_seq":"158","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.999588+0000","last_change":"2020-06-12T02:36:24.943776+0000","last_active":"2020-06-12T02:36:25.999588+0000","last_peered":"2020-06-12T02:36:25.999588+0000","last_clean":"2020-06-12T02:36:25.999588+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:25.999588+0000","last_undegraded":"2020-06-12T02:36:25.999588+0000","last_fullsized":"2020-06-12T02:36:25.999588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.d","version":"81'166","reported_seq":"416","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.224038+0000","last_change":"2020-06-12T02:36:28.224038+0000","last_active":"2020-06-12T02:36:28.224038+0000","last_peered":"2020-06-12T02:36:28.224038+0000","last_clean":"2020-06-12T02:36:28.224038+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:28.224038+0000","last_undegraded":"2020-06-12T02:36:28.224038+0000","last_fullsized":"2020-06-12T02:36:28.224038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32617364,"num_objects":14,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":75,"num_read_kb":78725,"num_write":72,"num_write_kb":35013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"223","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.179429+0000","last_change":"2020-06-12T02:36:28.179429+0000","last_active":"2020-06-12T02:36:28.179429+0000","last_peered":"2020-06-12T02:36:28.179429+0000","last_clean":"2020-06-12T02:36:28.179429+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:28.179429+0000","last_undegraded":"2020-06-12T02:36:28.179429+0000","last_fullsized":"2020-06-12T02:36:28.179429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.b","version":"77'63","reported_seq":"261","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.996923+0000","last_change":"2020-06-12T02:36:24.944403+0000","last_active":"2020-06-12T02:36:25.996923+0000","last_peered":"2020-06-12T02:36:25.996923+0000","last_clean":"2020-06-12T02:36:25.996923+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:25.996923+0000","last_undegraded":"2020-06-12T02:36:25.996923+0000","last_fullsized":"2020-06-12T02:36:25.996923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10375040,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.a","version":"81'19","reported_seq":"123","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.185385+0000","last_change":"2020-06-12T02:36:28.185385+0000","last_active":"2020-06-12T02:36:28.185385+0000","last_peered":"2020-06-12T02:36:28.185385+0000","last_clean":"2020-06-12T02:36:28.185385+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:28.185385+0000","last_undegraded":"2020-06-12T02:36:28.185385+0000","last_fullsized":"2020-06-12T02:36:28.185385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.9","version":"81'86","reported_seq":"159","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.191432+0000","last_change":"2020-06-12T02:36:28.194117+0000","last_active":"2020-06-12T02:36:28.191432+0000","last_peered":"2020-06-12T02:36:28.191432+0000","last_clean":"2020-06-12T02:36:28.191432+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:28.191432+0000","last_undegraded":"2020-06-12T02:36:28.191432+0000","last_fullsized":"2020-06-12T02:36:28.191432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10286221,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":9,"num_write":41,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.8","version":"81'75","reported_seq":"164","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.201254+0000","last_change":"2020-06-12T02:36:28.201254+0000","last_active":"2020-06-12T02:36:28.201254+0000","last_peered":"2020-06-12T02:36:28.201254+0000","last_clean":"2020-06-12T02:36:28.201254+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:28.201254+0000","last_undegraded":"2020-06-12T02:36:28.201254+0000","last_fullsized":"2020-06-12T02:36:28.201254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":75,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16967697,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":8036,"num_write":31,"num_write_kb":12914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.7","version":"81'165","reported_seq":"363","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.213632+0000","last_change":"2020-06-12T02:36:28.213632+0000","last_active":"2020-06-12T02:36:28.213632+0000","last_peered":"2020-06-12T02:36:28.213632+0000","last_clean":"2020-06-12T02:36:28.213632+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:28.213632+0000","last_undegraded":"2020-06-12T02:36:28.213632+0000","last_fullsized":"2020-06-12T02:36:28.213632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":165,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16581471,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":48924,"num_write":70,"num_write_kb":23034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"81'73","reported_seq":"268","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.202442+0000","last_change":"2020-06-12T02:36:28.203972+0000","last_active":"2020-06-12T02:36:28.202442+0000","last_peered":"2020-06-12T02:36:28.202442+0000","last_clean":"2020-06-12T02:36:28.202442+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:28.202442+0000","last_undegraded":"2020-06-12T02:36:28.202442+0000","last_fullsized":"2020-06-12T02:36:28.202442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8642849,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":28345,"num_write":30,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.1","version":"81'43","reported_seq":"244","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.188124+0000","last_change":"2020-06-12T02:36:28.189686+0000","last_active":"2020-06-12T02:36:28.188124+0000","last_peered":"2020-06-12T02:36:28.188124+0000","last_clean":"2020-06-12T02:36:28.188124+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:28.188124+0000","last_undegraded":"2020-06-12T02:36:28.188124+0000","last_fullsized":"2020-06-12T02:36:28.188124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"121","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.177940+0000","last_change":"2020-06-12T02:36:28.179669+0000","last_active":"2020-06-12T02:36:28.177940+0000","last_peered":"2020-06-12T02:36:28.177940+0000","last_clean":"2020-06-12T02:36:28.177940+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:28.177940+0000","last_undegraded":"2020-06-12T02:36:28.177940+0000","last_fullsized":"2020-06-12T02:36:28.177940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.2","version":"81'205","reported_seq":"434","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.209984+0000","last_change":"2020-06-12T02:36:28.209984+0000","last_active":"2020-06-12T02:36:28.209984+0000","last_peered":"2020-06-12T02:36:28.209984+0000","last_clean":"2020-06-12T02:36:28.209984+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:28.209984+0000","last_undegraded":"2020-06-12T02:36:28.209984+0000","last_fullsized":"2020-06-12T02:36:28.209984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22145079,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":37,"num_read_kb":27695,"num_write":79,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.3","version":"77'129","reported_seq":"353","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.997089+0000","last_change":"2020-06-12T02:36:24.944567+0000","last_active":"2020-06-12T02:36:25.997089+0000","last_peered":"2020-06-12T02:36:25.997089+0000","last_clean":"2020-06-12T02:36:25.997089+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:25.997089+0000","last_undegraded":"2020-06-12T02:36:25.997089+0000","last_fullsized":"2020-06-12T02:36:25.997089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23300378,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":53,"num_read_kb":56068,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"81'174","reported_seq":"373","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.205467+0000","last_change":"2020-06-12T02:36:28.206769+0000","last_active":"2020-06-12T02:36:28.205467+0000","last_peered":"2020-06-12T02:36:28.205467+0000","last_clean":"2020-06-12T02:36:28.205467+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:28.205467+0000","last_undegraded":"2020-06-12T02:36:28.205467+0000","last_fullsized":"2020-06-12T02:36:28.205467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":174,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22083191,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":65,"num_read_kb":85327,"num_write":73,"num_write_kb":15977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.5","version":"81'181","reported_seq":"369","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.220656+0000","last_change":"2020-06-12T02:36:28.220656+0000","last_active":"2020-06-12T02:36:28.220656+0000","last_peered":"2020-06-12T02:36:28.220656+0000","last_clean":"2020-06-12T02:36:28.220656+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:28.220656+0000","last_undegraded":"2020-06-12T02:36:28.220656+0000","last_fullsized":"2020-06-12T02:36:28.220656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":181,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26131369,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":45,"num_read_kb":38628,"num_write":79,"num_write_kb":24035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368570368,"data_stored":470769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089216,"kb_used_data":40632,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282624,"statfs":{"total":96636764160,"available":95521406976,"internally_reserved":1073741824,"allocated":41607168,"data_stored":51118939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.528}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.966},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1779999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.319},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.383}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.0899999999999999},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.625}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.8079999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.0699999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.4129999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.202}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087856,"kb_used_data":39272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283984,"statfs":{"total":96636764160,"available":95522799616,"internally_reserved":1073741824,"allocated":40214528,"data_stored":53946945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.222},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.9370000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.7450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.5299999999999998},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4609999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5660000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.8660000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.968},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1970000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":4.0289999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.274},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120132,"kb_used_data":71548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251708,"statfs":{"total":96636764160,"available":95489748992,"internally_reserved":1073741824,"allocated":73265152,"data_stored":94381399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.4910000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.319}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.004}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.667},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":2.411}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.583},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0870000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.2370000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":3.1429999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.7280000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.8340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":4.2309999999999999}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071184,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300656,"statfs":{"total":96636764160,"available":95539871744,"internally_reserved":1073741824,"allocated":23142400,"data_stored":29881687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.141}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.5870000000000002},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":3.8039999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":4.8819999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":5.2859999999999996},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":4.2460000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":4.1609999999999996},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":4.3019999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":4.7089999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095088,"kb_used_data":46504,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276752,"statfs":{"total":96636764160,"available":95515394048,"internally_reserved":1073741824,"allocated":47620096,"data_stored":58700635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":6.4800000000000004}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":4.0300000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.73}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":4.5549999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.831}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.554},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":3.7999999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.702}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104828,"kb_used_data":56244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267012,"statfs":{"total":96636764160,"available":95505420288,"internally_reserved":1073741824,"allocated":57593856,"data_stored":75993947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.887},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":2.1120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.778}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":4.5629999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":3.121},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5710000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":4.0650000000000004},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":4.1360000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.9830000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":4.6449999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":3.3199999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":4.4180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091028,"kb_used_data":42444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280812,"statfs":{"total":96636764160,"available":95519551488,"internally_reserved":1073741824,"allocated":43462656,"data_stored":54494043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":5.1210000000000004},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":5.4720000000000004}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":4.609}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.238},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":4.8810000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":7.0709999999999997},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.925}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":5.3819999999999997},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":6.6580000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.6379999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":7.2089999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":6.8159999999999998}]}]}]}} 2020-06-12T02:36:32.398 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-06-12T02:36:32.399 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:32.401 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:32.419 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:32.413+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:32.520 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:32.514+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:32.554 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.542+0000 7faead4cf700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.554 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.555 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.560 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.554+0000 7faead4cf700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.585 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:32.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:32.613+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:32.705 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:32.706 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:32.717 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2020-06-12T02:36:31.960285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7659332,"kb_used_data":319244,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652943548,"statfs":{"total":676457349120,"available":668614193152,"internally_reserved":7516192768,"allocated":326905856,"data_stored":418517595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12691152,"num_objects":-7,"num_object_clones":-7,"num_object_copies":-21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":2,"num_read":12,"num_read_kb":18326,"num_write":6,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.789014"},"pg_stats":[{"pgid":"1.f","version":"81'64","reported_seq":"258","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.204100+0000","last_change":"2020-06-12T02:36:28.205926+0000","last_active":"2020-06-12T02:36:28.204100+0000","last_peered":"2020-06-12T02:36:28.204100+0000","last_clean":"2020-06-12T02:36:28.204100+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:28.204100+0000","last_undegraded":"2020-06-12T02:36:28.204100+0000","last_fullsized":"2020-06-12T02:36:28.204100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13539670,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":14638,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.e","version":"77'86","reported_seq":"158","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.999588+0000","last_change":"2020-06-12T02:36:24.943776+0000","last_active":"2020-06-12T02:36:25.999588+0000","last_peered":"2020-06-12T02:36:25.999588+0000","last_clean":"2020-06-12T02:36:25.999588+0000","last_became_active":"2020-06-12T02:35:58.961682+0000","last_became_peered":"2020-06-12T02:35:58.961682+0000","last_unstale":"2020-06-12T02:36:25.999588+0000","last_undegraded":"2020-06-12T02:36:25.999588+0000","last_fullsized":"2020-06-12T02:36:25.999588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":8420208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4],"acting":[5,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.d","version":"81'166","reported_seq":"416","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.224038+0000","last_change":"2020-06-12T02:36:28.224038+0000","last_active":"2020-06-12T02:36:28.224038+0000","last_peered":"2020-06-12T02:36:28.224038+0000","last_clean":"2020-06-12T02:36:28.224038+0000","last_became_active":"2020-06-12T02:35:58.968135+0000","last_became_peered":"2020-06-12T02:35:58.968135+0000","last_unstale":"2020-06-12T02:36:28.224038+0000","last_undegraded":"2020-06-12T02:36:28.224038+0000","last_fullsized":"2020-06-12T02:36:28.224038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":166,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32617364,"num_objects":14,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":75,"num_read_kb":78725,"num_write":72,"num_write_kb":35013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":24117781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.c","version":"68'27","reported_seq":"223","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.179429+0000","last_change":"2020-06-12T02:36:28.179429+0000","last_active":"2020-06-12T02:36:28.179429+0000","last_peered":"2020-06-12T02:36:28.179429+0000","last_clean":"2020-06-12T02:36:28.179429+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:28.179429+0000","last_undegraded":"2020-06-12T02:36:28.179429+0000","last_fullsized":"2020-06-12T02:36:28.179429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2151296,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12611,"num_write":11,"num_write_kb":1732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.b","version":"77'63","reported_seq":"261","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.996923+0000","last_change":"2020-06-12T02:36:24.944403+0000","last_active":"2020-06-12T02:36:25.996923+0000","last_peered":"2020-06-12T02:36:25.996923+0000","last_clean":"2020-06-12T02:36:25.996923+0000","last_became_active":"2020-06-12T02:35:25.070996+0000","last_became_peered":"2020-06-12T02:35:25.070996+0000","last_unstale":"2020-06-12T02:36:25.996923+0000","last_undegraded":"2020-06-12T02:36:25.996923+0000","last_fullsized":"2020-06-12T02:36:25.996923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10375040,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":30,"num_read_kb":34289,"num_write":35,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.a","version":"81'19","reported_seq":"123","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.185385+0000","last_change":"2020-06-12T02:36:28.185385+0000","last_active":"2020-06-12T02:36:28.185385+0000","last_peered":"2020-06-12T02:36:28.185385+0000","last_clean":"2020-06-12T02:36:28.185385+0000","last_became_active":"2020-06-12T02:35:58.970151+0000","last_became_peered":"2020-06-12T02:35:58.970151+0000","last_unstale":"2020-06-12T02:36:28.185385+0000","last_undegraded":"2020-06-12T02:36:28.185385+0000","last_fullsized":"2020-06-12T02:36:28.185385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2386561,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.9","version":"81'86","reported_seq":"159","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.191432+0000","last_change":"2020-06-12T02:36:28.194117+0000","last_active":"2020-06-12T02:36:28.191432+0000","last_peered":"2020-06-12T02:36:28.191432+0000","last_clean":"2020-06-12T02:36:28.191432+0000","last_became_active":"2020-06-12T02:35:58.962042+0000","last_became_peered":"2020-06-12T02:35:58.962042+0000","last_unstale":"2020-06-12T02:36:28.191432+0000","last_undegraded":"2020-06-12T02:36:28.191432+0000","last_fullsized":"2020-06-12T02:36:28.191432+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":86,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10286221,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":9,"num_write":41,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":10924418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.8","version":"81'75","reported_seq":"164","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.201254+0000","last_change":"2020-06-12T02:36:28.201254+0000","last_active":"2020-06-12T02:36:28.201254+0000","last_peered":"2020-06-12T02:36:28.201254+0000","last_clean":"2020-06-12T02:36:28.201254+0000","last_became_active":"2020-06-12T02:35:58.965059+0000","last_became_peered":"2020-06-12T02:35:58.965059+0000","last_unstale":"2020-06-12T02:36:28.201254+0000","last_undegraded":"2020-06-12T02:36:28.201254+0000","last_fullsized":"2020-06-12T02:36:28.201254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":75,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16967697,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":8036,"num_write":31,"num_write_kb":12914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":5663893,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.7","version":"81'165","reported_seq":"363","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.213632+0000","last_change":"2020-06-12T02:36:28.213632+0000","last_active":"2020-06-12T02:36:28.213632+0000","last_peered":"2020-06-12T02:36:28.213632+0000","last_clean":"2020-06-12T02:36:28.213632+0000","last_became_active":"2020-06-12T02:36:01.954495+0000","last_became_peered":"2020-06-12T02:36:01.954495+0000","last_unstale":"2020-06-12T02:36:28.213632+0000","last_undegraded":"2020-06-12T02:36:28.213632+0000","last_fullsized":"2020-06-12T02:36:28.213632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":165,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16581471,"num_objects":9,"num_object_clones":4,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":48924,"num_write":70,"num_write_kb":23034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"81'73","reported_seq":"268","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.202442+0000","last_change":"2020-06-12T02:36:28.203972+0000","last_active":"2020-06-12T02:36:28.202442+0000","last_peered":"2020-06-12T02:36:28.202442+0000","last_clean":"2020-06-12T02:36:28.202442+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:28.202442+0000","last_undegraded":"2020-06-12T02:36:28.202442+0000","last_fullsized":"2020-06-12T02:36:28.202442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8642849,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":28345,"num_write":30,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.1","version":"81'43","reported_seq":"244","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.188124+0000","last_change":"2020-06-12T02:36:28.189686+0000","last_active":"2020-06-12T02:36:28.188124+0000","last_peered":"2020-06-12T02:36:28.188124+0000","last_clean":"2020-06-12T02:36:28.188124+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:28.188124+0000","last_undegraded":"2020-06-12T02:36:28.188124+0000","last_fullsized":"2020-06-12T02:36:28.188124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"121","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.177940+0000","last_change":"2020-06-12T02:36:28.179669+0000","last_active":"2020-06-12T02:36:28.177940+0000","last_peered":"2020-06-12T02:36:28.177940+0000","last_clean":"2020-06-12T02:36:28.177940+0000","last_became_active":"2020-06-12T02:35:58.965766+0000","last_became_peered":"2020-06-12T02:35:58.965766+0000","last_unstale":"2020-06-12T02:36:28.177940+0000","last_undegraded":"2020-06-12T02:36:28.177940+0000","last_fullsized":"2020-06-12T02:36:28.177940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.2","version":"81'205","reported_seq":"434","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.209984+0000","last_change":"2020-06-12T02:36:28.209984+0000","last_active":"2020-06-12T02:36:28.209984+0000","last_peered":"2020-06-12T02:36:28.209984+0000","last_clean":"2020-06-12T02:36:28.209984+0000","last_became_active":"2020-06-12T02:36:01.954009+0000","last_became_peered":"2020-06-12T02:36:01.954009+0000","last_unstale":"2020-06-12T02:36:28.209984+0000","last_undegraded":"2020-06-12T02:36:28.209984+0000","last_fullsized":"2020-06-12T02:36:28.209984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22145079,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":37,"num_read_kb":27695,"num_write":79,"num_write_kb":28317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":26067393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.3","version":"77'129","reported_seq":"353","reported_epoch":"79","state":"active+clean","last_fresh":"2020-06-12T02:36:25.997089+0000","last_change":"2020-06-12T02:36:24.944567+0000","last_active":"2020-06-12T02:36:25.997089+0000","last_peered":"2020-06-12T02:36:25.997089+0000","last_clean":"2020-06-12T02:36:25.997089+0000","last_became_active":"2020-06-12T02:35:58.968690+0000","last_became_peered":"2020-06-12T02:35:58.968690+0000","last_unstale":"2020-06-12T02:36:25.997089+0000","last_undegraded":"2020-06-12T02:36:25.997089+0000","last_fullsized":"2020-06-12T02:36:25.997089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":129,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23300378,"num_objects":13,"num_object_clones":7,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":53,"num_read_kb":56068,"num_write":52,"num_write_kb":18935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":14588278,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"1"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"81'174","reported_seq":"373","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.205467+0000","last_change":"2020-06-12T02:36:28.206769+0000","last_active":"2020-06-12T02:36:28.205467+0000","last_peered":"2020-06-12T02:36:28.205467+0000","last_clean":"2020-06-12T02:36:28.205467+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:28.205467+0000","last_undegraded":"2020-06-12T02:36:28.205467+0000","last_fullsized":"2020-06-12T02:36:28.205467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":174,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22083191,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":1,"num_read":65,"num_read_kb":85327,"num_write":73,"num_write_kb":15977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.5","version":"81'181","reported_seq":"369","reported_epoch":"81","state":"active+clean","last_fresh":"2020-06-12T02:36:28.220656+0000","last_change":"2020-06-12T02:36:28.220656+0000","last_active":"2020-06-12T02:36:28.220656+0000","last_peered":"2020-06-12T02:36:28.220656+0000","last_clean":"2020-06-12T02:36:28.220656+0000","last_became_active":"2020-06-12T02:35:25.070312+0000","last_became_peered":"2020-06-12T02:35:25.070312+0000","last_unstale":"2020-06-12T02:36:28.220656+0000","last_undegraded":"2020-06-12T02:36:28.220656+0000","last_fullsized":"2020-06-12T02:36:28.220656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":181,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26131369,"num_objects":12,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":45,"num_read_kb":38628,"num_write":79,"num_write_kb":24035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1e","length":"1"},{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":223477011,"num_objects":108,"num_object_clones":59,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":12,"num_read":526,"num_read_kb":527875,"num_write":661,"num_write_kb":223820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":92168532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368570368,"data_stored":470769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1556,"ondisk_log_size":1556,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089216,"kb_used_data":40632,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282624,"statfs":{"total":96636764160,"available":95521406976,"internally_reserved":1073741824,"allocated":41607168,"data_stored":51118939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.528}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.966},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":2.1779999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.319},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.383}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.0899999999999999},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.625}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.8079999999999998},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.0699999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.4129999999999998},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.202}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087856,"kb_used_data":39272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283984,"statfs":{"total":96636764160,"available":95522799616,"internally_reserved":1073741824,"allocated":40214528,"data_stored":53946945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.222},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.9370000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.7450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":2.5299999999999998},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":2.4609999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5660000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.8660000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.968},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":3.1970000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":4.0289999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.274},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1120132,"kb_used_data":71548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93251708,"statfs":{"total":96636764160,"available":95489748992,"internally_reserved":1073741824,"allocated":73265152,"data_stored":94381399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.4910000000000001},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.319}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.004}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":1.667},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":2.411}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.583},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0870000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.2370000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":3.1429999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.7280000000000002},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.8340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":4.2309999999999999}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071184,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300656,"statfs":{"total":96636764160,"available":95539871744,"internally_reserved":1073741824,"allocated":23142400,"data_stored":29881687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":2.2559999999999998},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.141}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.5870000000000002},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":3.8039999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":4.8819999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":5.2859999999999996},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":4.2460000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":4.1609999999999996},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":4.3019999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":4.7089999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095088,"kb_used_data":46504,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276752,"statfs":{"total":96636764160,"available":95515394048,"internally_reserved":1073741824,"allocated":47620096,"data_stored":58700635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":6.4800000000000004}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":4.0300000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.73}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":4.5549999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.831}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.554},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":3.7999999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.702}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1104828,"kb_used_data":56244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93267012,"statfs":{"total":96636764160,"available":95505420288,"internally_reserved":1073741824,"allocated":57593856,"data_stored":75993947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":2.032,"15min":2.032},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.887},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":11.132999999999999,"5min":11.132999999999999,"15min":11.132999999999999},"last":2.1120000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"min":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":7.4509999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":2.778}]},{"osd":3,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":2.6560000000000001,"15min":2.6560000000000001},"min":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"max":{"1min":8.4350000000000005,"5min":8.4350000000000005,"15min":8.4350000000000005},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.637,"5min":2.637,"15min":2.637},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":7.8339999999999996,"5min":7.8339999999999996,"15min":7.8339999999999996},"last":4.5629999999999997}]},{"osd":4,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.9390000000000001,"15min":2.9390000000000001},"min":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":3.121},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"max":{"1min":7.5949999999999998,"5min":7.5949999999999998,"15min":7.5949999999999998},"last":2.5710000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":3.4079999999999999,"15min":3.4079999999999999},"min":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"max":{"1min":7.6139999999999999,"5min":7.6139999999999999,"15min":7.6139999999999999},"last":4.0650000000000004},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"max":{"1min":8.625,"5min":8.625,"15min":8.625},"last":4.1360000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"min":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"max":{"1min":9.8339999999999996,"5min":9.8339999999999996,"15min":9.8339999999999996},"last":2.9830000000000001},{"interface":"front","average":{"1min":3.2829999999999999,"5min":3.2829999999999999,"15min":3.2829999999999999},"min":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"max":{"1min":7.4260000000000002,"5min":7.4260000000000002,"15min":7.4260000000000002},"last":4.6449999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:11 2020","interfaces":[{"interface":"back","average":{"1min":3.702,"5min":3.702,"15min":3.702},"min":{"1min":1.837,"5min":1.837,"15min":1.837},"max":{"1min":9.6219999999999999,"5min":9.6219999999999999,"15min":9.6219999999999999},"last":3.3199999999999998},{"interface":"front","average":{"1min":3.5350000000000001,"5min":3.5350000000000001,"15min":3.5350000000000001},"min":{"1min":2.016,"5min":2.016,"15min":2.016},"max":{"1min":7.7530000000000001,"5min":7.7530000000000001,"15min":7.7530000000000001},"last":4.4180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091028,"kb_used_data":42444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93280812,"statfs":{"total":96636764160,"available":95519551488,"internally_reserved":1073741824,"allocated":43462656,"data_stored":54494043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":5.1210000000000004},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":5.4720000000000004}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":4.609}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":2.238},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":4.8810000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":7.0709999999999997},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.925}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":5.3819999999999997},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":6.6580000000000004}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.6379999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":7.2089999999999996}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":6.8159999999999998}]}]}]}} 2020-06-12T02:36:32.720 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T02:36:32.723 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:32.718+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:32.731 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.731 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.741 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:32.831 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:32.821+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.818+0000 7f0b63050700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.835 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:32.830+0000 7f0b61dee700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:32.907 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:32.907 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:32.916 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:32.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:32.925+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:32.986 INFO:tasks.rados.rados.0.smithi142.stdout:385: done (7 left) 2020-06-12T02:36:32.986 INFO:tasks.rados.rados.0.smithi142.stdout:386: done (6 left) 2020-06-12T02:36:32.986 INFO:tasks.rados.rados.0.smithi142.stdout:387: done (5 left) 2020-06-12T02:36:32.986 INFO:tasks.rados.rados.0.smithi142.stdout:388: read oid 17 snap -1 2020-06-12T02:36:32.987 INFO:tasks.rados.rados.0.smithi142.stdout:388: expect deleted 2020-06-12T02:36:32.987 INFO:tasks.rados.rados.0.smithi142.stdout:389: write (excl) oid 8 current snap is 35 2020-06-12T02:36:32.987 INFO:tasks.rados.rados.0.smithi142.stdout:389: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2020-06-12T02:36:32.987 INFO:tasks.rados.rados.0.smithi142.stdout:389: writing smithi14213939-8 from 457190 to 1009286 tid 1 2020-06-12T02:36:32.987 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:36:32.992 INFO:tasks.rados.rados.0.smithi142.stdout:389: writing smithi14213939-8 from 1614880 to 2195921 tid 2 2020-06-12T02:36:32.996 INFO:tasks.rados.rados.0.smithi142.stdout:389: writing smithi14213939-8 from 2785791 to 2857190 tid 3 2020-06-12T02:36:32.997 INFO:tasks.rados.rados.0.smithi142.stdout:390: copy_from oid 24 from oid 6 current snap is 35 2020-06-12T02:36:32.997 INFO:tasks.rados.rados.0.smithi142.stdout:388: done (7 left) 2020-06-12T02:36:32.997 INFO:tasks.rados.rados.0.smithi142.stdout:391: write oid 36 current snap is 35 2020-06-12T02:36:32.997 INFO:tasks.rados.rados.0.smithi142.stdout:391: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2020-06-12T02:36:33.003 INFO:tasks.rados.rados.0.smithi142.stdout:391: writing smithi14213939-36 from 473997 to 1101342 tid 1 2020-06-12T02:36:33.009 INFO:tasks.rados.rados.0.smithi142.stdout:391: writing smithi14213939-36 from 1673362 to 2114414 tid 2 2020-06-12T02:36:33.014 INFO:tasks.rados.rados.0.smithi142.stdout:391: writing smithi14213939-36 from 2529567 to 2873997 tid 3 2020-06-12T02:36:33.014 INFO:tasks.rados.rados.0.smithi142.stdout:392: write (excl) oid 28 current snap is 35 2020-06-12T02:36:33.015 INFO:tasks.rados.rados.0.smithi142.stdout:392: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2020-06-12T02:36:33.023 INFO:tasks.rados.rados.0.smithi142.stdout:392: writing smithi14213939-28 from 490804 to 1193398 tid 1 2020-06-12T02:36:33.029 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:33.021+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:33.031 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:36:32.956979+0000","last_up_change":"2020-06-12T02:35:08.937742+0000","last_in_change":"2020-06-12T02:36:30.945456+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2020-06-12T02:35:23.053307+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists","up"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.988040+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.578658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.294920+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:08.017776+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:06.919687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.053961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.210941+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.971670+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[{"pgid":"1.2","osds":[0,4,2147483647]},{"pgid":"1.3","osds":[4,2147483647,2]},{"pgid":"1.7","osds":[2147483647,6,2]},{"pgid":"1.d","osds":[2,2147483647,7]}],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":35,"length":2},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":62,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:36:33.034 INFO:tasks.rados.rados.0.smithi142.stdout:392: writing smithi14213939-28 from 1615491 to 2200201 tid 2 2020-06-12T02:36:33.040 INFO:tasks.rados.rados.0.smithi142.stdout:392: writing smithi14213939-28 from 2724284 to 2890804 tid 3 2020-06-12T02:36:33.041 INFO:tasks.rados.rados.0.smithi142.stdout:393: copy_from oid 30 from oid 47 current snap is 35 2020-06-12T02:36:33.041 INFO:tasks.rados.rados.0.smithi142.stdout:391: finishing write tid 1 to smithi14213939-36 2020-06-12T02:36:33.042 INFO:tasks.rados.rados.0.smithi142.stdout:394: write (excl) oid 1 current snap is 35 2020-06-12T02:36:33.042 INFO:tasks.rados.rados.0.smithi142.stdout:394: seq_num 173 ranges {507611=777843,2073973=444721} 2020-06-12T02:36:33.047 INFO:tasks.rados.rados.0.smithi142.stdout:394: writing smithi14213939-1 from 507611 to 1285454 tid 1 2020-06-12T02:36:33.049 INFO:tasks.thrashosds.thrasher:pool unique_pool_0 min_size is 2 2020-06-12T02:36:33.050 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get unique_pool_0 erasure_code_profile 2020-06-12T02:36:33.054 INFO:tasks.rados.rados.0.smithi142.stdout:394: writing smithi14213939-1 from 2073973 to 2518694 tid 2 2020-06-12T02:36:33.054 INFO:tasks.rados.rados.0.smithi142.stdout:395: snap_remove snap 34 2020-06-12T02:36:33.072 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:33.072 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:33.084 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:33.130 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:33.125+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:33.161 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.142+0000 7fa942d70700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.166 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.162+0000 7fa941b0e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.231 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:33.225+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:33.232 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:33.234 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:33.242 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-06-12T02:36:33.340 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:33.334+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:33.349 INFO:teuthology.orchestra.run.smithi142.stdout:erasure_code_profile: teuthologyprofile 2020-06-12T02:36:33.366 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile get teuthologyprofile --format=json 2020-06-12T02:36:33.376 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:33.422 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:33.423 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:33.433 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:33.425+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:33.438 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-06-12T02:36:33.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.526+0000 7f8eba6e6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.535 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:33.530+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.526+0000 7f53a0eb8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.542 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.538+0000 7f8eb9484700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.543 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:33.538+0000 7f539b59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:33.583 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:33.613 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:33.614 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:33.614 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:33.626 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-06-12T02:36:33.638 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2: {} 2020-06-12T02:36:33.639 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:33.634+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:33.674 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:33.709 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:33.719 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:33.739 INFO:tasks.ceph.osd.2.smithi142.stderr:2020-06-12T02:36:33.734+0000 7fb64ab45700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12035) UID: 0 2020-06-12T02:36:33.741 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:33.741 INFO:teuthology.orchestra.run.smithi142.stdout:{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"} 2020-06-12T02:36:33.748 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:33.750 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:33.750 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:33.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:33.751 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:33.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.751 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:287 1.5s0 1:aa8c60b3:::smithi14213939-31:head [copy-from ver 6] snapc 8=[8,7,4] ondisk+write+known_if_redirected e28)", 2020-06-12T02:36:33.751 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:33.752 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.589167091999997, 2020-06-12T02:36:33.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997, 2020-06-12T02:36:33.752 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.752 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.753 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 287 2020-06-12T02:36:33.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.754 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:33.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.156960+0000", 2020-06-12T02:36:33.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015397699999999999 2020-06-12T02:36:33.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157114+0000", 2020-06-12T02:36:33.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9548999999999999e-05 2020-06-12T02:36:33.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157133+0000", 2020-06-12T02:36:33.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2159999999999997e-05 2020-06-12T02:36:33.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157166+0000", 2020-06-12T02:36:33.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7574000000000001e-05 2020-06-12T02:36:33.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157183+0000", 2020-06-12T02:36:33.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141657 2020-06-12T02:36:33.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157325+0000", 2020-06-12T02:36:33.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8093000000000001e-05 2020-06-12T02:36:33.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:33.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157343+0000", 2020-06-12T02:36:33.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0034386439999999998 2020-06-12T02:36:33.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160782+0000", 2020-06-12T02:36:33.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9946999999999998e-05 2020-06-12T02:36:33.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.160871+0000", 2020-06-12T02:36:33.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021307990999999998 2020-06-12T02:36:33.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.182179+0000", 2020-06-12T02:36:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01029352 2020-06-12T02:36:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192473+0000", 2020-06-12T02:36:33.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5259000000000004e-05 2020-06-12T02:36:33.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.192568+0000", 2020-06-12T02:36:33.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087323999999999995 2020-06-12T02:36:33.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193441+0000", 2020-06-12T02:36:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036481610999999997 2020-06-12T02:36:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.774 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:288 1.5s0 1:aa8c60b3:::smithi14213939-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e28)", 2020-06-12T02:36:33.774 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:33.774 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.588855588999998, 2020-06-12T02:36:33.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999, 2020-06-12T02:36:33.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.775 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.775 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.775 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.775 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.776 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 288 2020-06-12T02:36:33.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.776 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:33.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157271+0000", 2020-06-12T02:36:33.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6596999999999997e-05 2020-06-12T02:36:33.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157368+0000", 2020-06-12T02:36:33.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7963000000000001e-05 2020-06-12T02:36:33.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157386+0000", 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1520000000000001e-05 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157407+0000", 2020-06-12T02:36:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9600000000000003e-06 2020-06-12T02:36:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157414+0000", 2020-06-12T02:36:33.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3106e-05 2020-06-12T02:36:33.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157498+0000", 2020-06-12T02:36:33.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1160000000000001e-06 2020-06-12T02:36:33.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:33.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.157505+0000", 2020-06-12T02:36:33.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035192740000000002 2020-06-12T02:36:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161024+0000", 2020-06-12T02:36:33.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2332000000000001e-05 2020-06-12T02:36:33.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:33.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.161066+0000", 2020-06-12T02:36:33.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027121138999999999 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188187+0000", 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116043 2020-06-12T02:36:33.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.188303+0000", 2020-06-12T02:36:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056702269999999999 2020-06-12T02:36:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.193974+0000", 2020-06-12T02:36:33.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067902100000000003 2020-06-12T02:36:33.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194653+0000", 2020-06-12T02:36:33.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143564 2020-06-12T02:36:33.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:35.194796+0000", 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037524861999999999 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.799 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:547 1.ds0 1:bf884b7b:::smithi14213939-5:head [copy-from ver 69] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:33.799 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:33.799 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.796605022000001, 2020-06-12T02:36:33.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972, 2020-06-12T02:36:33.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.800 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 547 2020-06-12T02:36:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:33.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949522+0000", 2020-06-12T02:36:33.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024516700000000002 2020-06-12T02:36:33.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949767+0000", 2020-06-12T02:36:33.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6254e-05 2020-06-12T02:36:33.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:33.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7707999999999997e-05 2020-06-12T02:36:33.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949851+0000", 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1616999999999999e-05 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949883+0000", 2020-06-12T02:36:33.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016263599999999999 2020-06-12T02:36:33.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950045+0000", 2020-06-12T02:36:33.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1164999999999997e-05 2020-06-12T02:36:33.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:33.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950076+0000", 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057542030000000003 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955831+0000", 2020-06-12T02:36:33.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150648 2020-06-12T02:36:33.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955981+0000", 2020-06-12T02:36:33.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016872148 2020-06-12T02:36:33.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.972853+0000", 2020-06-12T02:36:33.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073934150000000004 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.980247+0000", 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045430089999999998 2020-06-12T02:36:33.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984790+0000", 2020-06-12T02:36:33.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011600200000000001 2020-06-12T02:36:33.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.984906+0000", 2020-06-12T02:36:33.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035383972 2020-06-12T02:36:33.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:548 1.ds0 1:bf884b7b:::smithi14213939-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e47)", 2020-06-12T02:36:33.816 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.796088343000001, 2020-06-12T02:36:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529, 2020-06-12T02:36:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.817 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.818 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.818 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.818 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 548 2020-06-12T02:36:33.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.818 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950039+0000", 2020-06-12T02:36:33.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013928700000000001 2020-06-12T02:36:33.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950178+0000", 2020-06-12T02:36:33.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1512e-05 2020-06-12T02:36:33.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950199+0000", 2020-06-12T02:36:33.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8914e-05 2020-06-12T02:36:33.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950238+0000", 2020-06-12T02:36:33.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4763000000000001e-05 2020-06-12T02:36:33.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950253+0000", 2020-06-12T02:36:33.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010666 2020-06-12T02:36:33.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950360+0000", 2020-06-12T02:36:33.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5638000000000001e-05 2020-06-12T02:36:33.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950385+0000", 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062131119999999998 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956599+0000", 2020-06-12T02:36:33.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100951 2020-06-12T02:36:33.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:33.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956699+0000", 2020-06-12T02:36:33.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020346889999999999 2020-06-12T02:36:33.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977046+0000", 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109986 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.977156+0000", 2020-06-12T02:36:33.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085963020000000001 2020-06-12T02:36:33.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985753+0000", 2020-06-12T02:36:33.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7044000000000002e-05 2020-06-12T02:36:33.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985840+0000", 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010547 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.985945+0000", 2020-06-12T02:36:33.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035906529 2020-06-12T02:36:33.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.833 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.834 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:570 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:33.834 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:33.834 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.793581908999997, 2020-06-12T02:36:33.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411, 2020-06-12T02:36:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 570 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:33.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952545+0000", 2020-06-12T02:36:33.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2472999999999995e-05 2020-06-12T02:36:33.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952628+0000", 2020-06-12T02:36:33.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0746e-05 2020-06-12T02:36:33.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952638+0000", 2020-06-12T02:36:33.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861999999999999e-05 2020-06-12T02:36:33.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952655+0000", 2020-06-12T02:36:33.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0801999999999999e-05 2020-06-12T02:36:33.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952666+0000", 2020-06-12T02:36:33.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085523299999999995 2020-06-12T02:36:33.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953521+0000", 2020-06-12T02:36:33.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3104e-05 2020-06-12T02:36:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953534+0000", 2020-06-12T02:36:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039549800000000003 2020-06-12T02:36:33.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957489+0000", 2020-06-12T02:36:33.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7579999999999998e-06 2020-06-12T02:36:33.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:33.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957493+0000", 2020-06-12T02:36:33.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01169331 2020-06-12T02:36:33.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969186+0000", 2020-06-12T02:36:33.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025233100000000001 2020-06-12T02:36:33.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969439+0000", 2020-06-12T02:36:33.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011780812 2020-06-12T02:36:33.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.981219+0000", 2020-06-12T02:36:33.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028674411 2020-06-12T02:36:33.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.850 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.851 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:571 1.ds0 1:b752a38e:::smithi14213939-37:head [sparse-read 0~2823543] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:33.851 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:33.851 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.793401912999997, 2020-06-12T02:36:33.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415, 2020-06-12T02:36:33.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 571 2020-06-12T02:36:33.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.853 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:33.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952725+0000", 2020-06-12T02:36:33.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8022000000000002e-05 2020-06-12T02:36:33.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952773+0000", 2020-06-12T02:36:33.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8460000000000008e-06 2020-06-12T02:36:33.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952781+0000", 2020-06-12T02:36:33.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4294000000000001e-05 2020-06-12T02:36:33.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952795+0000", 2020-06-12T02:36:33.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5320000000000003e-06 2020-06-12T02:36:33.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952802+0000", 2020-06-12T02:36:33.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082437600000000004 2020-06-12T02:36:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953626+0000", 2020-06-12T02:36:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6080000000000002e-06 2020-06-12T02:36:33.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:33.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953636+0000", 2020-06-12T02:36:33.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040554900000000001 2020-06-12T02:36:33.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957691+0000", 2020-06-12T02:36:33.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.458e-06 2020-06-12T02:36:33.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:33.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957694+0000", 2020-06-12T02:36:33.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012194412 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.969888+0000", 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167718 2020-06-12T02:36:33.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.970056+0000", 2020-06-12T02:36:33.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014075659000000001 2020-06-12T02:36:33.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.984131+0000", 2020-06-12T02:36:33.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031406415 2020-06-12T02:36:33.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:572 1.ds0 1:b752a38e:::smithi14213939-37:head [read 0~2823543,checksum] snapc 0=[] ondisk+read+known_if_redirected e52)", 2020-06-12T02:36:33.867 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:33.868 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.793266821000003, 2020-06-12T02:36:33.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309, 2020-06-12T02:36:33.868 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.868 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.868 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 572 2020-06-12T02:36:33.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.869 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:33.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952860+0000", 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5882000000000002e-05 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952946+0000", 2020-06-12T02:36:33.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5609999999999999e-06 2020-06-12T02:36:33.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952955+0000", 2020-06-12T02:36:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5461999999999999e-05 2020-06-12T02:36:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952970+0000", 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1469999999999998e-06 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.952976+0000", 2020-06-12T02:36:33.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00068413800000000004 2020-06-12T02:36:33.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953660+0000", 2020-06-12T02:36:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0819999999999999e-06 2020-06-12T02:36:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.953668+0000", 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040503199999999996 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957719+0000", 2020-06-12T02:36:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2020-06-12T02:36:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:33.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.957720+0000", 2020-06-12T02:36:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014783556999999999 2020-06-12T02:36:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972503+0000", 2020-06-12T02:36:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017928400000000001 2020-06-12T02:36:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.972682+0000", 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013415099 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:58.986097+0000", 2020-06-12T02:36:33.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033237309 2020-06-12T02:36:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:596 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 1818036~510700] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.743676550000004, 2020-06-12T02:36:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999, 2020-06-12T02:36:33.883 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 596 2020-06-12T02:36:33.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:33.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002450+0000", 2020-06-12T02:36:33.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028867999999999998 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002739+0000", 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3023999999999999e-05 2020-06-12T02:36:33.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002752+0000", 2020-06-12T02:36:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2095000000000001e-05 2020-06-12T02:36:33.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002774+0000", 2020-06-12T02:36:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7819999999999994e-06 2020-06-12T02:36:33.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002782+0000", 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142999999999997e-05 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002825+0000", 2020-06-12T02:36:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100276 2020-06-12T02:36:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.002925+0000", 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.208954693 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.211880+0000", 2020-06-12T02:36:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059608159999999999 2020-06-12T02:36:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217841+0000", 2020-06-12T02:36:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011818130000000001 2020-06-12T02:36:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219023+0000", 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2768e-05 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219076+0000", 2020-06-12T02:36:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21662508999999999 2020-06-12T02:36:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:597 1.5s0 1:a5c622c8:::smithi14213939-18:head [write 3120019~493453] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.735629760000002, 2020-06-12T02:36:33.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135, 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.898 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 597 2020-06-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010497+0000", 2020-06-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025616300000000001 2020-06-12T02:36:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010753+0000", 2020-06-12T02:36:33.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0152999999999999e-05 2020-06-12T02:36:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010764+0000", 2020-06-12T02:36:33.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5800000000000001e-05 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010779+0000", 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3370000000000002e-06 2020-06-12T02:36:33.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010787+0000", 2020-06-12T02:36:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5009999999999997e-05 2020-06-12T02:36:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010842+0000", 2020-06-12T02:36:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001506 2020-06-12T02:36:33.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010992+0000", 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20383591300000001 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.214828+0000", 2020-06-12T02:36:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030160230000000001 2020-06-12T02:36:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217844+0000", 2020-06-12T02:36:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020347519999999999 2020-06-12T02:36:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219879+0000", 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8384000000000002e-05 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.219937+0000", 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.209440135 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:598 1.5s0 1:a5c622c8:::smithi14213939-18:head [setxattr _header (57) in=7b,truncate 3613472] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.735284395999997, 2020-06-12T02:36:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999, 2020-06-12T02:36:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 598 2020-06-12T02:36:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010843+0000", 2020-06-12T02:36:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7810000000000003e-05 2020-06-12T02:36:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010910+0000", 2020-06-12T02:36:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0739999999999998e-06 2020-06-12T02:36:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010916+0000", 2020-06-12T02:36:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0740000000000001e-05 2020-06-12T02:36:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010927+0000", 2020-06-12T02:36:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7790000000000002e-06 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010931+0000", 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000415389 2020-06-12T02:36:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011346+0000", 2020-06-12T02:36:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114361 2020-06-12T02:36:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011461+0000", 2020-06-12T02:36:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20597469600000001 2020-06-12T02:36:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.217435+0000", 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087728100000000005 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.218313+0000", 2020-06-12T02:36:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024806870000000001 2020-06-12T02:36:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220793+0000", 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7261000000000004e-05 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.220881+0000", 2020-06-12T02:36:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21003807799999999 2020-06-12T02:36:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:599 1.5s0 1:a5c622c8:::smithi14213939-18:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e53)", 2020-06-12T02:36:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.735152843000002, 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999, 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 599 2020-06-12T02:36:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.010974+0000", 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0713999999999997e-05 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011015+0000", 2020-06-12T02:36:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3419999999999998e-06 2020-06-12T02:36:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011020+0000", 2020-06-12T02:36:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1474000000000001e-05 2020-06-12T02:36:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011032+0000", 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8330000000000004e-06 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011035+0000", 2020-06-12T02:36:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070944300000000003 2020-06-12T02:36:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011745+0000", 2020-06-12T02:36:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9925000000000003e-05 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.011845+0000", 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.20958259700000001 2020-06-12T02:36:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221427+0000", 2020-06-12T02:36:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010508100000000001 2020-06-12T02:36:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.221533+0000", 2020-06-12T02:36:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001263471 2020-06-12T02:36:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.222796+0000", 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.21182187999999999 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:799 1.8s0 1:16d20421:::smithi14213939-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.740699721999999, 2020-06-12T02:36:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001, 2020-06-12T02:36:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 799 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:33.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005427+0000", 2020-06-12T02:36:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.163e-05 2020-06-12T02:36:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005469+0000", 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5200000000000003e-06 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005478+0000", 2020-06-12T02:36:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2224e-05 2020-06-12T02:36:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005491+0000", 2020-06-12T02:36:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5619999999999997e-06 2020-06-12T02:36:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.005495+0000", 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001359306 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006854+0000", 2020-06-12T02:36:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109207 2020-06-12T02:36:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.006964+0000", 2020-06-12T02:36:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021167133000000001 2020-06-12T02:36:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028131+0000", 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000173494 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.028304+0000", 2020-06-12T02:36:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055074019999999998 2020-06-12T02:36:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033812+0000", 2020-06-12T02:36:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014122200000000001 2020-06-12T02:36:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.033953+0000", 2020-06-12T02:36:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012596910000000001 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.035213+0000", 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029785391000000001 2020-06-12T02:36:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:830 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.367142035000001, 2020-06-12T02:36:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998, 2020-06-12T02:36:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 830 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378985+0000", 2020-06-12T02:36:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2907e-05 2020-06-12T02:36:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379038+0000", 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5059999999999995e-06 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379046+0000", 2020-06-12T02:36:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.521e-05 2020-06-12T02:36:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379062+0000", 2020-06-12T02:36:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9580000000000001e-06 2020-06-12T02:36:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379069+0000", 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025736000000000001 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381642+0000", 2020-06-12T02:36:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8594000000000001e-05 2020-06-12T02:36:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381711+0000", 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028781834999999999 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410493+0000", 2020-06-12T02:36:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031507609999999998 2020-06-12T02:36:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:831 1.ds0 1:bf884b7b:::smithi14213939-5:head [sparse-read 0~3479016] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.367008520999999, 2020-06-12T02:36:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003, 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 831 2020-06-12T02:36:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379118+0000", 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9319000000000002e-05 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379148+0000", 2020-06-12T02:36:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.464e-06 2020-06-12T02:36:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379152+0000", 2020-06-12T02:36:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8990000000000001e-06 2020-06-12T02:36:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379160+0000", 2020-06-12T02:36:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4769999999999999e-06 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379164+0000", 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002823229 2020-06-12T02:36:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381987+0000", 2020-06-12T02:36:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010492699999999999 2020-06-12T02:36:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.382092+0000", 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039092202999999999 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.421184+0000", 2020-06-12T02:36:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042065518000000003 2020-06-12T02:36:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:842 1.5s0 1:a5b7af70:::smithi14213939-17:head [write 1799494~402223] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.344860644000001, 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001, 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 842 2020-06-12T02:36:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401266+0000", 2020-06-12T02:36:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215639 2020-06-12T02:36:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401482+0000", 2020-06-12T02:36:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3623e-05 2020-06-12T02:36:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401496+0000", 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2456e-05 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401518+0000", 2020-06-12T02:36:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1941e-05 2020-06-12T02:36:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401530+0000", 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0344000000000003e-05 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401600+0000", 2020-06-12T02:36:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146625 2020-06-12T02:36:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401747+0000", 2020-06-12T02:36:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017748788000000001 2020-06-12T02:36:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419496+0000", 2020-06-12T02:36:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119141 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.419615+0000", 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010974276999999999 2020-06-12T02:36:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.430589+0000", 2020-06-12T02:36:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025664110000000002 2020-06-12T02:36:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433156+0000", 2020-06-12T02:36:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054978220000000003 2020-06-12T02:36:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438653+0000", 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3753999999999998e-05 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.438737+0000", 2020-06-12T02:36:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037470821000000001 2020-06-12T02:36:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:843 1.5s0 1:a5b7af70:::smithi14213939-17:head [setxattr _header (57) in=7b,truncate 2201717] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.344530309, 2020-06-12T02:36:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003, 2020-06-12T02:36:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 843 2020-06-12T02:36:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401597+0000", 2020-06-12T02:36:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1662000000000005e-05 2020-06-12T02:36:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401678+0000", 2020-06-12T02:36:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.742e-06 2020-06-12T02:36:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401685+0000", 2020-06-12T02:36:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4080000000000001e-06 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401692+0000", 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2159999999999997e-06 2020-06-12T02:36:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401698+0000", 2020-06-12T02:36:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5162999999999998e-05 2020-06-12T02:36:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401783+0000", 2020-06-12T02:36:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109722 2020-06-12T02:36:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401893+0000", 2020-06-12T02:36:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018128401999999998 2020-06-12T02:36:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420021+0000", 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015958500000000001 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420181+0000", 2020-06-12T02:36:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011980408999999999 2020-06-12T02:36:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432161+0000", 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020040430000000001 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.434165+0000", 2020-06-12T02:36:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053184800000000004 2020-06-12T02:36:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439483+0000", 2020-06-12T02:36:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015248599999999999 2020-06-12T02:36:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439636+0000", 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038039318000000003 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:844 1.5s0 1:a5b7af70:::smithi14213939-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.344379109999998, 2020-06-12T02:36:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998, 2020-06-12T02:36:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 844 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401748+0000", 2020-06-12T02:36:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5605000000000001e-05 2020-06-12T02:36:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401793+0000", 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.331e-06 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401800+0000", 2020-06-12T02:36:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2789000000000001e-05 2020-06-12T02:36:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401813+0000", 2020-06-12T02:36:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1390000000000003e-06 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401818+0000", 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109048 2020-06-12T02:36:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.401927+0000", 2020-06-12T02:36:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010927 2020-06-12T02:36:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402036+0000", 2020-06-12T02:36:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018472145999999998 2020-06-12T02:36:34.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420508+0000", 2020-06-12T02:36:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9551999999999998e-05 2020-06-12T02:36:34.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.420608+0000", 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019833529999999999 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440441+0000", 2020-06-12T02:36:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012666700000000001 2020-06-12T02:36:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.440568+0000", 2020-06-12T02:36:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010441980000000001 2020-06-12T02:36:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.441612+0000", 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.039864274999999998 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:847 1.ds0 1:b3d4b74b:::smithi14213939-29:head [sparse-read 0~2470596] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:34.031 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.344015161000002, 2020-06-12T02:36:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664, 2020-06-12T02:36:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:34.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 847 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402112+0000", 2020-06-12T02:36:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4753000000000003e-05 2020-06-12T02:36:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402157+0000", 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.55e-06 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:34.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402163+0000", 2020-06-12T02:36:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1355000000000001e-05 2020-06-12T02:36:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:34.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402174+0000", 2020-06-12T02:36:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8770000000000001e-06 2020-06-12T02:36:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402179+0000", 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020908300000000001 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404270+0000", 2020-06-12T02:36:34.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5341999999999997e-05 2020-06-12T02:36:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404356+0000", 2020-06-12T02:36:34.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026823956999999999 2020-06-12T02:36:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.431179+0000", 2020-06-12T02:36:34.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029067664 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.042 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:898 1.ds0 1:b8c47ae9:::smithi14213939-24:head [copy-from ver 14] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.650060679999999, 2020-06-12T02:36:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999, 2020-06-12T02:36:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:34.043 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 898 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.044 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:34.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096066+0000", 2020-06-12T02:36:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1056000000000005e-05 2020-06-12T02:36:34.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096147+0000", 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1107999999999999e-05 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096158+0000", 2020-06-12T02:36:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8838000000000002e-05 2020-06-12T02:36:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096177+0000", 2020-06-12T02:36:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.084e-05 2020-06-12T02:36:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096188+0000", 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206119 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096394+0000", 2020-06-12T02:36:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0744000000000001e-05 2020-06-12T02:36:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096405+0000", 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092680699999999998 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105673+0000", 2020-06-12T02:36:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000149333 2020-06-12T02:36:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:34.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.105822+0000", 2020-06-12T02:36:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018170888 2020-06-12T02:36:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.123993+0000", 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084114589999999996 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.132405+0000", 2020-06-12T02:36:34.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00440384 2020-06-12T02:36:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136809+0000", 2020-06-12T02:36:34.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011938300000000001 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.136928+0000", 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.040861677999999999 2020-06-12T02:36:34.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.058 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:899 1.ds0 1:b8c47ae9:::smithi14213939-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.649879473, 2020-06-12T02:36:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997, 2020-06-12T02:36:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:34.059 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 899 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.060 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:34.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096247+0000", 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9157999999999999e-05 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096297+0000", 2020-06-12T02:36:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4880000000000001e-06 2020-06-12T02:36:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096304+0000", 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4187e-05 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096318+0000", 2020-06-12T02:36:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6979999999999993e-06 2020-06-12T02:36:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096328+0000", 2020-06-12T02:36:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014549100000000001 2020-06-12T02:36:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096474+0000", 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8830000000000006e-06 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.096481+0000", 2020-06-12T02:36:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095279739999999998 2020-06-12T02:36:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106009+0000", 2020-06-12T02:36:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8401999999999999e-05 2020-06-12T02:36:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:34.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.106088+0000", 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022632513 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128720+0000", 2020-06-12T02:36:34.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120066 2020-06-12T02:36:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.128840+0000", 2020-06-12T02:36:34.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093085939999999999 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138149+0000", 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134377 2020-06-12T02:36:34.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138283+0000", 2020-06-12T02:36:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012817500000000001 2020-06-12T02:36:34.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.138411+0000", 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.042164005999999997 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:34.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:34.075 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:34.078 INFO:tasks.thrashosds.thrasher:pool unique_pool_0 local_k=2 local_m=1 2020-06-12T02:36:34.078 INFO:tasks.thrashosds.thrasher:setting k=2 from previous 0 2020-06-12T02:36:34.078 INFO:tasks.thrashosds.thrasher:setting m=1 from previous 99 2020-06-12T02:36:34.079 INFO:tasks.thrashosds.thrasher:using k=2, m=1 2020-06-12T02:36:34.079 INFO:tasks.thrashosds.thrasher:forced to out an osd 2020-06-12T02:36:34.079 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2020-06-12T02:36:34.079 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-06-12T02:36:34.080 INFO:teuthology.orchestra.run:waiting for 300 2020-06-12T02:36:34.080 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:34.081 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:34.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.082 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.082 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.082 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.082 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.082 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.083 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.083 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:34.083 INFO:tasks.rados.rados.0.smithi142.stdout:395: done (11 left) 2020-06-12T02:36:34.083 INFO:tasks.rados.rados.0.smithi142.stdout:396: write oid 14 current snap is 35 2020-06-12T02:36:34.083 INFO:tasks.rados.rados.0.smithi142.stdout:396: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2020-06-12T02:36:34.084 INFO:tasks.rados.rados.0.smithi142.stdout:396: writing smithi14213939-14 from 524418 to 977510 tid 1 2020-06-12T02:36:34.084 INFO:tasks.rados.rados.0.smithi142.stdout:396: writing smithi14213939-14 from 1732455 to 2320834 tid 2 2020-06-12T02:36:34.084 INFO:tasks.rados.rados.0.smithi142.stdout:396: writing smithi14213939-14 from 2779130 to 2924418 tid 3 2020-06-12T02:36:34.084 INFO:tasks.rados.rados.0.smithi142.stdout:397: read oid 39 snap 31 2020-06-12T02:36:34.084 INFO:tasks.rados.rados.0.smithi142.stdout:397: expect (ObjNum 85 snap 12 seq_num 85) 2020-06-12T02:36:34.085 INFO:tasks.rados.rados.0.smithi142.stdout:398: snap_remove snap 30 2020-06-12T02:36:34.085 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:34.074+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:34.177 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:34.169+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:34.213 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:34.213 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:34.214 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:34.214 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:34.220 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:34.306 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:34.301+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:34.375 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:34.375 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:34.376 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:34.376 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:34.379 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:34.374+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:34.491 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:34.485+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:34.564 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:34.564 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:34.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:34.565 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:34.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.565 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:34.565 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.425155875999998, 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.566 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.567 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:34.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.567 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:34.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:34.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:34.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:34.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:34.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:34.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:34.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:34.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:34.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:34.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:34.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:34.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:34.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:34.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:34.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:34.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:34.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:34.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.592 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.593 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:34.593 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:34.594 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.414264494999998, 2020-06-12T02:36:34.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:34.594 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.594 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:34.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:34.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:34.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:34.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:34.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:34.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:34.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:34.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:34.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:34.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:34.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:34.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:34.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:34.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:34.607 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.612 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.413132451000003, 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:34.613 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.614 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.614 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:34.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.615 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:34.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:34.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:34.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:34.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:34.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:34.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:34.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:34.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:34.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:34.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:34.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:34.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:34.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:34.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:34.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:34.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:34.626 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.627 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.627 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.627 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:34.628 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:34.628 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.412877266000002, 2020-06-12T02:36:34.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:34.628 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.628 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.629 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:34.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:34.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:34.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:34.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:34.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:34.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:34.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:34.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:34.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:34.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:34.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:34.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:34.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:34.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:34.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:34.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:34.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:34.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.642 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.643 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:34.643 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:34.643 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.412718079000001, 2020-06-12T02:36:34.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:34.644 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.644 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.644 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.644 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.644 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.645 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:34.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.645 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:34.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:34.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:34.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:34.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:34.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:34.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:34.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:34.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:34.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:34.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:34.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:34.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.656 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:34.657 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:34.657 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.268395501000001, 2020-06-12T02:36:34.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:34.657 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.657 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.658 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:34.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.659 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:34.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:34.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:34.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:34.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:34.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:34.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:34.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:34.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:34.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:34.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:34.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:34.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:34.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:34.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:34.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.668 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.669 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:34.669 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:34.670 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.527326004000003, 2020-06-12T02:36:34.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:34.670 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.670 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.670 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:34.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:34.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:34.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:34.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:34.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:34.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:34.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:34.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:34.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:34.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:34.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:34.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:34.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:34.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:34.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:34.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:34.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:34.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:34.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:34.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:34.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:34.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:34.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:34.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:34.690 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.690 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.690 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.691 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:34.691 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:34.691 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.589623603, 2020-06-12T02:36:34.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:34.691 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:34.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.693 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:34.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:34.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:34.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:34.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:34.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:34.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:34.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:34.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:34.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:34.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:34.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:34.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:34.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:34.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:34.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:34.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:34.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:34.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:34.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:34.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:34.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:34.708 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.708 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.709 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.709 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:34.709 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:34.710 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.607747523, 2020-06-12T02:36:34.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:34.710 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.710 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.710 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:34.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:34.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:34.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:34.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:34.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:34.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:34.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:34.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:34.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:34.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:34.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:34.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:34.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:34.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:34.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:34.722 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.723 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.723 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.723 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:34.724 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:34.724 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.607554207, 2020-06-12T02:36:34.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:34.724 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.724 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.725 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.725 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.725 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.726 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:34.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:34.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:34.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:34.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:34.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:34.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:34.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:34.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:34.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:34.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:34.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:34.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:34.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:34.737 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.737 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.737 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.607405751999998, 2020-06-12T02:36:34.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:34.739 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.739 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.740 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:34.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.740 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:34.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:34.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:34.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:34.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:34.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:34.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:34.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:34.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:34.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:34.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:34.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:34.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:34.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:34.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:34.750 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.751 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:34.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:34.753 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.599972802, 2020-06-12T02:36:34.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:34.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:34.753 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:34.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:34.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:34.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:34.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:34.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:34.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:34.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:34.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:34.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:34.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:34.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.764 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:34.764 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:34.764 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.597564301999999, 2020-06-12T02:36:34.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:34.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:34.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:34.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:34.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:34.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:34.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:34.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:34.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:34.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:34.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:34.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:34.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:34.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:34.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:34.776 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:34.777 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.595537156999999, 2020-06-12T02:36:34.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:34.777 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.777 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:34.777 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:34.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:34.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:34.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:34.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:34.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:34.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:34.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:34.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:34.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:34.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:34.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:34.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:34.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.787 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:34.788 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.584487324000001, 2020-06-12T02:36:34.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:34.789 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.789 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:34.789 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:34.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:34.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:34.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:34.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:34.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:34.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:34.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:34.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:34.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:34.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:34.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:34.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:34.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:34.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:34.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:34.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:34.804 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.804 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.804 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.805 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:34.805 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:34.806 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.580274307, 2020-06-12T02:36:34.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:34.806 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.806 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.806 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:34.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:34.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:34.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:34.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:34.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:34.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:34.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:34.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:34.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:34.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:34.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:34.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:34.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:34.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:34.823 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.823 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.823 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.580091108000001, 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:34.824 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.825 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:34.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.826 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:34.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:34.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:34.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:34.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:34.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:34.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:34.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:34.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:34.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:34.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:34.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:34.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:34.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:34.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:34.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:34.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:34.838 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.838 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:34.839 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.123173063999999, 2020-06-12T02:36:34.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:34.840 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.840 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:34.840 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:34.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:34.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:34.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:34.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:34.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:34.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:34.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:34.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:34.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:34.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:34.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:34.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:34.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.851 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:36:34.851 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:34.851 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.592711467, 2020-06-12T02:36:34.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:36:34.851 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.852 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:34.852 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.852 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.853 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.853 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:36:34.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.853 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:34.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:34.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:36:34.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:36:34.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:36:34.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:36:34.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:36:34.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:36:34.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:36:34.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:34.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:36:34.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:36:34.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:34.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:36:34.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:36:34.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:36:34.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:36:34.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.865 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.866 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:36:34.866 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:34.866 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 4.5924523480000001, 2020-06-12T02:36:34.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:34.867 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:36:34.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.868 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:34.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:34.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:34.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:34.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:34.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:34.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:36:34.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:34.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:36:34.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:36:34.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:34.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:36:34.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:36:34.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:34.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:36:34.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:36:34.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:34.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:36:34.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:36:34.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:34.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:36:34.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:36:34.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:34.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:36:34.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:36:34.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:34.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:34.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:36:34.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:36:34.880 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.880 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.880 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:34.881 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:34.881 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:34.883 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:34.877+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:34.883 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:34.956 INFO:tasks.rados.rados.0.smithi142.stdout:398: done (13 left) 2020-06-12T02:36:34.957 INFO:tasks.rados.rados.0.smithi142.stdout:399: read oid 12 snap 31 2020-06-12T02:36:34.957 INFO:tasks.rados.rados.0.smithi142.stdout:399: expect deleted 2020-06-12T02:36:34.957 INFO:tasks.rados.rados.0.smithi142.stdout:400: rollback oid 13 current snap is 35 2020-06-12T02:36:34.958 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 13 to 29 2020-06-12T02:36:34.958 INFO:tasks.rados.rados.0.smithi142.stdout:401: snap_create 2020-06-12T02:36:34.958 INFO:tasks.rados.rados.0.smithi142.stdout:391: finishing write tid 2 to smithi14213939-36 2020-06-12T02:36:34.958 INFO:tasks.rados.rados.0.smithi142.stdout:391: finishing write tid 3 to smithi14213939-36 2020-06-12T02:36:34.958 INFO:tasks.rados.rados.0.smithi142.stdout:391: finishing write tid 5 to smithi14213939-36 2020-06-12T02:36:34.959 INFO:tasks.rados.rados.0.smithi142.stdout:391: finishing write tid 6 to smithi14213939-36 2020-06-12T02:36:34.959 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 36 v 185 (ObjNum 171 snap 35 seq_num 171) dirty exists 2020-06-12T02:36:34.959 INFO:tasks.rados.rados.0.smithi142.stdout:391: left oid 36 (ObjNum 171 snap 35 seq_num 171) 2020-06-12T02:36:34.959 INFO:tasks.rados.rados.0.smithi142.stdout:392: finishing write tid 1 to smithi14213939-28 2020-06-12T02:36:34.959 INFO:tasks.rados.rados.0.smithi142.stdout:392: finishing write tid 2 to smithi14213939-28 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:392: finishing write tid 3 to smithi14213939-28 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:392: finishing write tid 5 to smithi14213939-28 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:392: finishing write tid 6 to smithi14213939-28 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 28 v 190 (ObjNum 172 snap 35 seq_num 172) dirty exists 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:392: left oid 28 (ObjNum 172 snap 35 seq_num 172) 2020-06-12T02:36:34.960 INFO:tasks.rados.rados.0.smithi142.stdout:394: finishing write tid 1 to smithi14213939-1 2020-06-12T02:36:34.961 INFO:tasks.rados.rados.0.smithi142.stdout:394: finishing write tid 2 to smithi14213939-1 2020-06-12T02:36:34.961 INFO:tasks.rados.rados.0.smithi142.stdout:394: finishing write tid 4 to smithi14213939-1 2020-06-12T02:36:34.961 INFO:tasks.rados.rados.0.smithi142.stdout:394: finishing write tid 5 to smithi14213939-1 2020-06-12T02:36:34.961 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 1 v 31 (ObjNum 173 snap 35 seq_num 173) dirty exists 2020-06-12T02:36:34.961 INFO:tasks.rados.rados.0.smithi142.stdout:394: left oid 1 (ObjNum 173 snap 35 seq_num 173) 2020-06-12T02:36:34.962 INFO:tasks.rados.rados.0.smithi142.stdout:374: finishing rollback tid 0 to smithi14213939-29 2020-06-12T02:36:34.962 INFO:tasks.rados.rados.0.smithi142.stdout:389: finishing write tid 1 to smithi14213939-8 2020-06-12T02:36:34.962 INFO:tasks.rados.rados.0.smithi142.stdout:376: finishing write tid 1 to smithi14213939-19 2020-06-12T02:36:34.962 INFO:tasks.rados.rados.0.smithi142.stdout:377: finishing write tid 1 to smithi14213939-25 2020-06-12T02:36:34.962 INFO:tasks.rados.rados.0.smithi142.stdout:381: finishing write tid 1 to smithi14213939-50 2020-06-12T02:36:34.963 INFO:tasks.rados.rados.0.smithi142.stdout:384: expect (ObjNum 140 snap 28 seq_num 140) 2020-06-12T02:36:34.983 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:34.978+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:34.992 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:36:35.049 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:35.049 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:35.050 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:35.050 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:35.058 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:35.067 INFO:tasks.rados.rados.0.smithi142.stdout:381: finishing write tid 2 to smithi14213939-50 2020-06-12T02:36:35.067 INFO:tasks.rados.rados.0.smithi142.stdout:381: finishing write tid 3 to smithi14213939-50 2020-06-12T02:36:35.067 INFO:tasks.rados.rados.0.smithi142.stdout:389: finishing write tid 2 to smithi14213939-8 2020-06-12T02:36:35.068 INFO:tasks.rados.rados.0.smithi142.stdout:389: finishing write tid 3 to smithi14213939-8 2020-06-12T02:36:35.068 INFO:tasks.rados.rados.0.smithi142.stdout:389: finishing write tid 5 to smithi14213939-8 2020-06-12T02:36:35.068 INFO:tasks.rados.rados.0.smithi142.stdout:376: finishing write tid 2 to smithi14213939-19 2020-06-12T02:36:35.068 INFO:tasks.rados.rados.0.smithi142.stdout:393: finishing copy_from to smithi14213939-30 2020-06-12T02:36:35.068 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 30 v 18 (ObjNum 107 snap 23 seq_num 107) dirty exists 2020-06-12T02:36:35.069 INFO:tasks.rados.rados.0.smithi142.stdout:393: finishing copy_from racing read to smithi14213939-30 2020-06-12T02:36:35.069 INFO:tasks.rados.rados.0.smithi142.stdout:376: finishing write tid 3 to smithi14213939-19 2020-06-12T02:36:35.069 INFO:tasks.rados.rados.0.smithi142.stdout:376: finishing write tid 5 to smithi14213939-19 2020-06-12T02:36:35.069 INFO:tasks.rados.rados.0.smithi142.stdout:390: finishing copy_from to smithi14213939-24 2020-06-12T02:36:35.069 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 24 v 151 (ObjNum 156 snap 30 seq_num 156) dirty exists 2020-06-12T02:36:35.070 INFO:tasks.rados.rados.0.smithi142.stdout:389: finishing write tid 6 to smithi14213939-8 2020-06-12T02:36:35.070 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 8 v 210 (ObjNum 170 snap 35 seq_num 170) dirty exists 2020-06-12T02:36:35.070 INFO:tasks.rados.rados.0.smithi142.stdout:389: left oid 8 (ObjNum 170 snap 35 seq_num 170) 2020-06-12T02:36:35.070 INFO:tasks.rados.rados.0.smithi142.stdout:390: finishing copy_from racing read to smithi14213939-24 2020-06-12T02:36:35.071 INFO:tasks.rados.rados.0.smithi142.stdout:376: finishing write tid 6 to smithi14213939-19 2020-06-12T02:36:35.071 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 19 v 170 (ObjNum 165 snap 34 seq_num 165) dirty exists 2020-06-12T02:36:35.071 INFO:tasks.rados.rados.0.smithi142.stdout:376: left oid 19 (ObjNum 165 snap 34 seq_num 165) 2020-06-12T02:36:35.071 INFO:tasks.rados.rados.0.smithi142.stdout:381: finishing write tid 5 to smithi14213939-50 2020-06-12T02:36:35.071 INFO:tasks.rados.rados.0.smithi142.stdout:377: finishing write tid 2 to smithi14213939-25 2020-06-12T02:36:35.072 INFO:tasks.rados.rados.0.smithi142.stdout:377: finishing write tid 4 to smithi14213939-25 2020-06-12T02:36:35.072 INFO:tasks.rados.rados.0.smithi142.stdout:381: finishing write tid 6 to smithi14213939-50 2020-06-12T02:36:35.072 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 50 v 146 (ObjNum 167 snap 34 seq_num 167) dirty exists 2020-06-12T02:36:35.072 INFO:tasks.rados.rados.0.smithi142.stdout:381: left oid 50 (ObjNum 167 snap 34 seq_num 167) 2020-06-12T02:36:35.073 INFO:tasks.rados.rados.0.smithi142.stdout:377: finishing write tid 5 to smithi14213939-25 2020-06-12T02:36:35.073 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 25 v 148 (ObjNum 166 snap 34 seq_num 166) dirty exists 2020-06-12T02:36:35.073 INFO:tasks.rados.rados.0.smithi142.stdout:377: left oid 25 (ObjNum 166 snap 34 seq_num 166) 2020-06-12T02:36:35.073 INFO:tasks.rados.rados.0.smithi142.stdout:374: finishing rollback tid 1 to smithi14213939-29 2020-06-12T02:36:35.073 INFO:tasks.rados.rados.0.smithi142.stdout:374: finishing rollback tid 2 to smithi14213939-29 2020-06-12T02:36:35.074 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 29 v 174 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-06-12T02:36:35.074 INFO:tasks.rados.rados.0.smithi142.stdout:397: expect (ObjNum 85 snap 12 seq_num 85) 2020-06-12T02:36:35.085 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:35.082+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:35.100 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:35.086+0000 7f6a76daf700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:35.161 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:35.161 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:35.162 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:35.162 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:35.163 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:35.173 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:35.186 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:35.182+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:35.232 INFO:tasks.rados.rados.0.smithi142.stdout:400: finishing rollback tid 0 to smithi14213939-13 2020-06-12T02:36:35.232 INFO:tasks.rados.rados.0.smithi142.stdout:400: finishing rollback tid 1 to smithi14213939-13 2020-06-12T02:36:35.233 INFO:tasks.rados.rados.0.smithi142.stdout:400: finishing rollback tid 2 to smithi14213939-13 2020-06-12T02:36:35.234 INFO:tasks.rados.rados.0.smithi142.stdout:update_object_version oid 13 v 79 (ObjNum 129 snap 27 seq_num 129) dirty exists 2020-06-12T02:36:35.282 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:35.283 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:35.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:35.283 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:35.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.132860676999996, 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.284 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:35.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:35.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:35.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:35.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:35.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:35.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:35.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:35.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:35.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:35.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:35.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:35.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:35.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:35.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:35.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:35.295 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.295 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.295 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.296 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:35.296 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:35.296 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.986347166000002, 2020-06-12T02:36:35.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:35.297 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.297 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:35.297 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:35.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:35.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:35.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:35.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:35.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:35.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:35.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:35.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:35.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:35.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:35.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:35.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.308 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:35.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:35.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.308798492000001, 2020-06-12T02:36:35.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:35.308 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.309 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:35.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:35.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:35.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:35.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:35.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:35.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:35.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:35.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:35.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:35.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:35.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:35.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:35.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:35.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:35.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:35.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:35.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:35.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:35.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:35.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.324 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:35.324 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:35.324 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.308034564, 2020-06-12T02:36:35.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:35.325 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.325 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.325 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.325 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.325 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:35.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:35.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:35.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:35.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:35.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:35.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:35.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:35.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:35.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:35.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:35.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:35.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:35.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:35.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:35.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:35.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:35.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:35.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:35.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:35.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:35.340 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.340 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.341 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.341 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:35.341 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.085229509000001, 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.342 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.343 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.343 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:35.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.343 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:35.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:35.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:35.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:35.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:35.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:35.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:35.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:35.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:35.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:35.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:35.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:35.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:35.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:35.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.354 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.355 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.355 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:35.355 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:35.356 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.076943222000001, 2020-06-12T02:36:35.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:35.356 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.356 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.356 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.357 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.357 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.357 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:35.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.357 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:35.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:35.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:35.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:35.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:35.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:35.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:35.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:35.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:35.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:35.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:35.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:35.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:35.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:35.368 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.369 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.369 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.069913977999999, 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.370 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.371 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:35.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.371 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:35.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:35.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:35.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:35.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:35.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:35.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:35.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:35.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:35.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:35.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:35.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:35.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.383 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.383 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.383 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 31.069776526999998, 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.385 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.385 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.385 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:35.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.385 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:35.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:35.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:35.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:35.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:35.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:35.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:35.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:35.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:35.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:35.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:35.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.396 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:35.397 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:35.397 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.268988788000001, 2020-06-12T02:36:35.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:35.397 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.397 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.398 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:35.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:35.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:35.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:35.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:35.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:35.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:35.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:35.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:35.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:35.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:35.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:35.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:35.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:35.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:35.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:35.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:35.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:35.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:35.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.412 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 26.268842174, 2020-06-12T02:36:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.413 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.414 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.414 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.414 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.414 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:35.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:35.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:35.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:35.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:35.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:35.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:35.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:35.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:35.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:35.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:35.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:35.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:35.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:35.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:35.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:35.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:35.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:35.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:35.433 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.433 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.433 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.434 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:35.434 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:35.434 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.312829300000001, 2020-06-12T02:36:35.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:35.434 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:35.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.436 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:35.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:35.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:35.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:35.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:35.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:35.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:35.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:35.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:35.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:35.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:35.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:35.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:35.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:35.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:35.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:35.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:35.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:35.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:35.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:35.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:35.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:35.452 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.452 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.453 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.453 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:35.454 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:35.454 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.307097787, 2020-06-12T02:36:35.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:35.455 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.455 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.456 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:35.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.456 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:35.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:35.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:35.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:35.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:35.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:35.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:35.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:35.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:35.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:35.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:35.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:35.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:35.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:35.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:35.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:35.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:35.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:35.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:35.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:35.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:35.473 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.473 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.473 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.474 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:35.475 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:35.475 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.306604271000001, 2020-06-12T02:36:35.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:35.476 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.476 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:35.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.477 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:35.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:35.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:35.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:35.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:35.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:35.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:35.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:35.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:35.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:35.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:35.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:35.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:35.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:35.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.491 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:35.492 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.306510264, 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:35.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:35.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:35.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.506 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:35.507 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.268349234999999, 2020-06-12T02:36:35.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:35.508 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.508 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:35.508 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:35.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:35.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:35.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:35.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:35.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:35.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:35.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:35.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:35.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:35.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:35.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:35.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:35.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:35.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:35.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:35.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:35.518 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.519 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.519 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.519 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:35.520 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:35.520 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.227552242, 2020-06-12T02:36:35.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:35.520 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.520 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.522 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:35.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.522 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:35.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:35.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:35.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:35.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:35.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:35.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.227310176, 2020-06-12T02:36:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:35.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:35.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:35.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:35.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:35.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:35.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:35.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:35.543 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.544 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.227100484999999, 2020-06-12T02:36:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.545 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:35.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:35.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:35.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:35.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:35.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:35.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:35.555 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:35.556 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 14.211566324, 2020-06-12T02:36:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.557 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.558 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:35.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.558 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:35.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:35.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:35.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:36:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:35.568 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 5.3135062900000003, 2020-06-12T02:36:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:36:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:35.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:36:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:36:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:36:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:36:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:36:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:36:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:36:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:36:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:36:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:35.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:36:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:36:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:35.580 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:35.580 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:35.581 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:35.302+0000 7f6a7534c700 0 --2- 172.21.15.142:0/3723788076 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7005f100 0x7f6a70133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-06-12T02:36:35.581 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:35.302+0000 7f6a75b4d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:35.582 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:35.584 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:35.578+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:35.682 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:35.677+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:35.703 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:35.703 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:35.704 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:35.704 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:35.713 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:35.784 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:35.778+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:35.866 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:35.867 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:35.867 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:35.867 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:35.868 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:35.876 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:35.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:35.917+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:35.953 INFO:tasks.rados.rados.0.smithi142.stdout:374: done (15 left) 2020-06-12T02:36:35.954 INFO:tasks.rados.rados.0.smithi142.stdout:376: done (14 left) 2020-06-12T02:36:35.954 INFO:tasks.rados.rados.0.smithi142.stdout:377: done (13 left) 2020-06-12T02:36:35.954 INFO:tasks.rados.rados.0.smithi142.stdout:381: done (12 left) 2020-06-12T02:36:35.954 INFO:tasks.rados.rados.0.smithi142.stdout:384: done (11 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:389: done (10 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:390: done (9 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:391: done (8 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:392: done (7 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:393: done (6 left) 2020-06-12T02:36:35.955 INFO:tasks.rados.rados.0.smithi142.stdout:394: done (5 left) 2020-06-12T02:36:35.956 INFO:tasks.rados.rados.0.smithi142.stdout:397: done (4 left) 2020-06-12T02:36:35.956 INFO:tasks.rados.rados.0.smithi142.stdout:400: done (3 left) 2020-06-12T02:36:35.956 INFO:tasks.rados.rados.0.smithi142.stdout:401: done (2 left) 2020-06-12T02:36:35.956 INFO:tasks.rados.rados.0.smithi142.stdout:402: snap_create 2020-06-12T02:36:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:36:36.001 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.866306098999999, 2020-06-12T02:36:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:36:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:36:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:36:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:36:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:36:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:36:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:36:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:36:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:36:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:36:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:36:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:36:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:36:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:36:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:36:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:36:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:36:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:36:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:36:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:36:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:36:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:36:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:36:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:36:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:36:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:36:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:36:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.866167163, 2020-06-12T02:36:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:36:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.065 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:36:36.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:36.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:36:36.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:36:36.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:36:36.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:36:36.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:36.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:36:36.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:36:36.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:36:36.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:36:36.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:36:36.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:36.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:36:36.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:36:36.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:36:36.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:36:36.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:36:36.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:36:36.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:36:36.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:36:36.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:36:36.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:36:36.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:36:36.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:36:36.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.084 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.085 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:36.085 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:36.085 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.866031324999994, 2020-06-12T02:36:36.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:36:36.087 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.087 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.089 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:36:36.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:36.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:36.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:36:36.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:36:36.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:36:36.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:36:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:36:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:36:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:36:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:36:36.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:36:36.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:36:36.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:36:36.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:36:36.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:36:36.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:36:36.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:36:36.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:36:36.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:36:36.106 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.106 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.107 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.107 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:36.107 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.842366476999999, 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:36:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:36:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:36:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:36:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:36:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:36:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:36:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:36:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:36:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:36:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:36:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:36:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:36:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 56.794922567, 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:36:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:36.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:36:36.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:36:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:36:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:36:36.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:36:36.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:36:36.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:36:36.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:36.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:36:36.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:36:36.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:36:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:36:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:36:36.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:36:36.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:36:36.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:36:36.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:36:36.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:36:36.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:36:36.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:36:36.136 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.137 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.137 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:36.138 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:36.138 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.051185523999997, 2020-06-12T02:36:36.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:36:36.138 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.138 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.139 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:36.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:36.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:36:36.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:36:36.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:36:36.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:36:36.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:36:36.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:36:36.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:36:36.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:36:36.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:36:36.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:36:36.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:36:36.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:36.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:36.152 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.050212154, 2020-06-12T02:36:36.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:36:36.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.153 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:36.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:36.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:36:36.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:36:36.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:36:36.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:36:36.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:36:36.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:36:36.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:36:36.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:36:36.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:36:36.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:36:36.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:36:36.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:36:36.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:36:36.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:36:36.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:36:36.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.165 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.049003034000002, 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:36:36.166 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.167 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.167 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:36.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:36:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:36:36.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:36:36.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:36:36.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:36:36.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:36:36.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:36:36.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:36:36.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:36:36.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:36:36.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:36:36.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:36:36.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:36:36.177 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.177 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.177 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.178 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:36.178 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:36.178 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 51.047740048999998, 2020-06-12T02:36:36.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:36:36.178 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.179 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.179 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:36.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:36.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:36:36.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:36:36.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:36:36.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:36:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:36:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:36:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:36:36.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:36:36.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:36:36.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:36:36.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:36:36.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:36:36.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:36:36.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.036281922000001, 2020-06-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:36:36.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:36:36.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:36:36.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:36:36.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:36:36.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:36:36.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:36:36.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:36:36.204 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.204 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.205 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:36:36.205 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.033280882, 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:36.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:36.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:36:36.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:36:36.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:36:36.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:36:36.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:36:36.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:36:36.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:36:36.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:36:36.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:36:36.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:36:36.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:36:36.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:36:36.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:36:36.216 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.217 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.217 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.218 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:36.218 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:36.218 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.010454883000001, 2020-06-12T02:36:36.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:36:36.218 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.219 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:36.219 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.219 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.219 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.219 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:36:36.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.220 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:36.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:36.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:36:36.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:36:36.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:36:36.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:36:36.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:36:36.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:36:36.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:36:36.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:36:36.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:36:36.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:36:36.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:36.238 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:36.238 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.010309491000001, 2020-06-12T02:36:36.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:36:36.238 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.238 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.239 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:36:36.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.240 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:36.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:36.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:36:36.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:36:36.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:36:36.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:36:36.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:36:36.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:36:36.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:36:36.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:36:36.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:36:36.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:36:36.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:36.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:36:36.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:36:36.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:36:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:36:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:36:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:36:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:36:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:36:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.253 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.254 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.255 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.978168212, 2020-06-12T02:36:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:36:36.256 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.257 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:36:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:36:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:36:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:36:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:36:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:36:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:36:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:36:36.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:36:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:36:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:36:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:36:36.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:36:36.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:36:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:36:36.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:36:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:36:36.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:36:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:36:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:36:36.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:36:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:36:36.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.973041577, 2020-06-12T02:36:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:36:36.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:36:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:36:36.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:36:36.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:36:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:36:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:36:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:36:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:36:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:36:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:36:36.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:36:36.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:36:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:36:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:36:36.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:36:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:36:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:36:36.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:36:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:36:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:36:36.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:36:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.297 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.298 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:36.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.972662567, 2020-06-12T02:36:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:36:36.300 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:36:36.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:36:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:36:36.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:36:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:36:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:36:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:36:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:36:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:36:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:36:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:36:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:36:36.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:36:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:36:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:36:36.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:36:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:36:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:36:36.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:36:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:36:36.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:36:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:36:36.323 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.325 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.972445111999999, 2020-06-12T02:36:36.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:36:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:36.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.328 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.328 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.328 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:36:36.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.329 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:36.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:36.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:36:36.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:36:36.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:36:36.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:36:36.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:36:36.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:36:36.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:36:36.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:36:36.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:36:36.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:36:36.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:36:36.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:36.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:36:36.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:36:36.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:36:36.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:36:36.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:36:36.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:36:36.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:36:36.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:36:36.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.351 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.351 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.352 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:36.352 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:36.353 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.608502866999999, 2020-06-12T02:36:36.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:36:36.353 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.354 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:36.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.355 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.355 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:36:36.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.355 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:36.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:36.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:36:36.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:36:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:36:36.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:36:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:36:36.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:36:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:36:36.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:36:36.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:36:36.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:36:36.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:36:36.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:36:36.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:36:36.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.365 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.019450079999999, 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:36:36.366 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.367 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:36.367 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:36.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:36.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:36:36.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:36:36.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:36:36.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:36:36.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:36:36.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:36:36.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:36:36.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:36:36.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:36:36.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:36:36.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:36:36.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:36:36.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 16.016416506999999, 2020-06-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:36:36.383 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:36.384 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:36:36.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:36.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:36:36.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:36:36.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:36:36.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:36:36.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:36:36.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:36.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:36:36.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:36:36.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:36:36.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:36.400 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:36.401 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:36.404 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:36.010+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:36.404 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:36.405 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:36.398+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:36.504 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:36.497+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:36.515 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:36.510+0000 7fb50c63a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:36.520 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:36.514+0000 7fb50c63a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:36.554 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:36.569 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:36.570 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:36.579 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:36.598 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:36.604 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:36.602+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:36.623 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:36.645 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:36.670 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:36.693 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:36.697 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:36.698 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:36.738 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:36.739 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:36.741 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:36.738+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:36.753 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:36.810 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:36.801+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:36.865 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:36.866 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:36.875 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:36.928 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:36.918+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:36.959 INFO:tasks.rados.rados.0.smithi142.stdout:402: done (2 left) 2020-06-12T02:36:36.960 INFO:tasks.rados.rados.0.smithi142.stdout:403: rollback oid 6 current snap is 37 2020-06-12T02:36:36.960 INFO:tasks.rados.rados.0.smithi142.stdout:rollback oid 6 to 29 2020-06-12T02:36:36.960 INFO:tasks.rados.rados.0.smithi142.stdout:404: snap_remove snap 36 2020-06-12T02:36:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.013 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:37.014 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:37.009+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:37.115 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:37.109+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.182 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:37.229 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:37.226+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.298 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:37.317 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:37.309+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:37.418 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:37.409+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:37.451 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.451 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.461 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:37.519 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:37.514+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:37.583 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.583 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.592 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:37.633 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:37.630+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:37.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:37.721+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:37.743 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.743 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.753 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:37.833 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:37.822+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:37.861 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:37.862 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:37.873 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:37.929 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:37.921+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:37.975 INFO:tasks.rados.rados.0.smithi142.stdout:404: done (3 left) 2020-06-12T02:36:37.980 INFO:tasks.rados.rados.0.smithi142.stdout:405: delete oid 48 current snap is 37 2020-06-12T02:36:37.980 INFO:tasks.rados.rados.0.smithi142.stdout:405: done (3 left) 2020-06-12T02:36:37.980 INFO:tasks.rados.rados.0.smithi142.stdout:406: delete oid 13 current snap is 37 2020-06-12T02:36:37.987 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:36:37.990 INFO:tasks.rados.rados.0.smithi142.stdout:406: done (3 left) 2020-06-12T02:36:37.990 INFO:tasks.rados.rados.0.smithi142.stdout:407: copy_from oid 20 from oid 2 current snap is 37 2020-06-12T02:36:37.990 INFO:tasks.rados.rados.0.smithi142.stdout:408: delete oid 38 current snap is 37 2020-06-12T02:36:38.030 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:38.021+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:38.034 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.035 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.044 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:38.095 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:38.082+0000 7fc3e4ac3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:38.099 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:38.094+0000 7fc3df59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:38.130 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:38.126+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:38.194 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.194 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.219 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:38.261 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:38.258+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:38.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:38.329+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:38.345 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.345 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.354 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:38.456 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:38.441+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:38.508 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.508 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.531 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:38.548 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:38.542+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:38.649 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:38.641+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:38.684 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.684 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.694 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:38.707 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:38.773 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:38.766+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:38.830 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:38.822+0000 7f429d5f7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:38.837 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:38.834+0000 7f4297fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:38.843 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.843 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.851 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:38.846+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:38.852 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:38.870 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:38.896 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:38.924 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:38.948 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:38.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:38.945+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:38.957 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:38.957 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:38.967 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:38.972 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:39.004 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:39.024 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:39.025 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.025 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.025 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.026 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.027 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:39.032 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:39.032 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:39.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2020-06-12T02:36:39.073 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:39.070+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:39.137 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:39.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 67.972396564999997, 2020-06-12T02:36:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:39.158 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 62.825883054000002, 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.148334380000001, 2020-06-12T02:36:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.147570451999997, 2020-06-12T02:36:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.924765397000002, 2020-06-12T02:36:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.916479109999997, 2020-06-12T02:36:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.909449866000003, 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.909312415000002, 2020-06-12T02:36:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.108524675999998, 2020-06-12T02:36:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 30.108378062, 2020-06-12T02:36:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.152365188000001, 2020-06-12T02:36:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:39.299 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:39.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:39.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.146633675, 2020-06-12T02:36:39.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.146140159000002, 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:39.335 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.336 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:39.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:39.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:39.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:39.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:39.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:39.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:39.348 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.349 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.146046152, 2020-06-12T02:36:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.351 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:39.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:39.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:39.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:39.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:39.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:39.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:39.366 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.107885122999999, 2020-06-12T02:36:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.367 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:39.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:39.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:39.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.067088129999998, 2020-06-12T02:36:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.382 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:39.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:39.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.066846064, 2020-06-12T02:36:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:39.394 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:39.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:39.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:39.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:39.404 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.405 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.066636373000001, 2020-06-12T02:36:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.406 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:39.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:39.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:39.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:39.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:39.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.416 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.418 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:39.418 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:39.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 18.051102212, 2020-06-12T02:36:39.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:39.418 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:39.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.420 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:39.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:39.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:39.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:39.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:39.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:39.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:39.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:39.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:39.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:39.428 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.429 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.429 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.429 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 9.1530421779999998, 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:39.430 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.431 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.431 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.431 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:36:39.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.431 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:36:39.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:36:39.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:36:39.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:36:39.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:36:39.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:36:39.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:36:39.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:36:39.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:36:39.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:36:39.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.440 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.441 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.441 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.441 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.441 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:39.442 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:39.444 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:36:39.444 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:39.441+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:39.544 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:39.538+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:39.558 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:39.559 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:39.568 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:39.646 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:39.642+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:39.680 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:39.682 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:39.689 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:39.755 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:39.750+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:39.824 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:39.825 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:39.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:39.825 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:39.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.826 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:39.826 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:39.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.696899377999998, 2020-06-12T02:36:39.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:36:39.831 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.831 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.831 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.833 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:36:39.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.833 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:39.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:36:39.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:36:39.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:36:39.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:36:39.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:36:39.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:36:39.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:36:39.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:36:39.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:36:39.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:36:39.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:36:39.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:39.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:36:39.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:36:39.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:36:39.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:36:39.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:36:39.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:36:39.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:36:39.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:36:39.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:36:39.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:36:39.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.850 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.850 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.851 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:39.851 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:39.851 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.696760441999999, 2020-06-12T02:36:39.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:36:39.852 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.852 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.852 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.852 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.852 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.853 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:36:39.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.853 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:39.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:36:39.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:36:39.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:36:39.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:36:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:36:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:39.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:36:39.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:36:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:36:39.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:36:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:36:39.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:36:39.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:36:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:36:39.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:36:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:36:39.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:36:39.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:36:39.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:36:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:36:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:36:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.868 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.869 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.696624603999993, 2020-06-12T02:36:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:36:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.870 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.871 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:36:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.872 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:39.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:36:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:36:39.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:36:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:36:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:36:39.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:36:39.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:36:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:36:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:36:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:36:39.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:36:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:39.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:36:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:36:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:36:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:36:39.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:36:39.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:36:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:36:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:36:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:36:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:36:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:36:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:36:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:36:39.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:36:39.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.892 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:39.894 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:39.894 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 68.672959755999997, 2020-06-12T02:36:39.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:36:39.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.895 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.895 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:39.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:36:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:36:39.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:36:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:36:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:36:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:36:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:36:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:36:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:36:39.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:36:39.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:36:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:36:39.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:36:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:36:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:36:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:36:39.910 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.625515845999999, 2020-06-12T02:36:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:36:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.911 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:36:39.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:36:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:36:39.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:36:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:36:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:36:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:36:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:36:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:36:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:36:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:36:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:36:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:36:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:36:39.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:36:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:36:39.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:36:39.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:36:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:36:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:36:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:36:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:36:39.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:36:39.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:36:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:36:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:36:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.932 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:39.933 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.881778803000003, 2020-06-12T02:36:39.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:36:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:39.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:36:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:36:39.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:36:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:36:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:36:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:36:39.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:36:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:36:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:36:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:36:39.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:36:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:36:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:36:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:36:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:36:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:36:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:36:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.948 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:39.949 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.880805432999999, 2020-06-12T02:36:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:36:39.950 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:36:39.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:36:39.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:36:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:36:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:36:39.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:36:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:36:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:36:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:36:39.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:36:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:36:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:36:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:36:39.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:36:39.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:36:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:36:39.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:36:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.965 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:39.966 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.879596313, 2020-06-12T02:36:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:36:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.967 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:39.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:36:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:36:39.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:36:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:36:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:36:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:36:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:36:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:36:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:36:39.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:36:39.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:36:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:36:39.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:36:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:36:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:36:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:36:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:36:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.878333327999997, 2020-06-12T02:36:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:36:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:39.984 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:39.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:39.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:36:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:39.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:36:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:36:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:36:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:36:39.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:36:39.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:36:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:36:39.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:36:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:39.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:36:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:36:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:39.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:36:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:36:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:39.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:36:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:36:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:36:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:36:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.998 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:36:39.999 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.866875200999999, 2020-06-12T02:36:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:36:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.000 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:40.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:36:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:36:40.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:36:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:36:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:36:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:36:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:36:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:36:40.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:36:40.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:36:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:36:40.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:36:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:36:40.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:36:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:36:40.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:36:40.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.863874160999998, 2020-06-12T02:36:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:36:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:40.015 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:36:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:36:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:36:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:36:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:36:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:36:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:36:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:36:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:36:40.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:36:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:36:40.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:36:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:36:40.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:36:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.841048162, 2020-06-12T02:36:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:36:40.028 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.029 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:36:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:36:40.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:36:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:36:40.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:36:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:36:40.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:36:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:36:40.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:36:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:36:40.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:36:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:36:40.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:36:40.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:36:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:36:40.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:36:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:36:40.040 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.041 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.84090277, 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:40.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.044 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:36:40.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:36:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:36:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:36:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:36:40.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:36:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:36:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:36:40.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:36:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:36:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:36:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:36:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:40.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:36:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:36:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:36:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:36:40.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:40.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:36:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:36:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:36:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:36:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:36:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:36:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:40.065 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.808761490999999, 2020-06-12T02:36:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:36:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.066 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:36:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.067 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:40.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:36:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:36:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:36:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:36:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:36:40.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:36:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:36:40.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:36:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:36:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:36:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:36:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:36:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:36:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:36:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:36:40.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:36:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:36:40.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:36:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:36:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:36:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:36:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:40.083 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.803634855999999, 2020-06-12T02:36:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:36:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.084 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.085 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:36:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:36:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:36:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:36:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:36:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:36:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:36:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:36:40.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:36:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:36:40.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:36:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:36:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:36:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:36:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:36:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:36:40.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:36:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:36:40.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:36:40.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:36:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:36:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:36:40.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.803255845999999, 2020-06-12T02:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:36:40.102 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:36:40.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:40.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:40.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:36:40.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:36:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:36:40.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:36:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:36:40.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:36:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:36:40.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:36:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:36:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:36:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:36:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:36:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:36:40.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:36:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:36:40.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:36:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:36:40.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:36:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:36:40.116 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:40.117 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.803038391000001, 2020-06-12T02:36:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:36:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.118 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:36:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.119 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:40.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:40.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:36:40.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:36:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:36:40.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:36:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:36:40.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:36:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:36:40.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:36:40.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:36:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:36:40.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:36:40.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:36:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:36:40.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:36:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:36:40.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:40.131 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.439096146000001, 2020-06-12T02:36:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:36:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.132 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:36:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.133 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:36:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:36:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:36:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:36:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:36:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:36:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:36:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:36:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:36:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:36:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:36:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:36:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.142 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:36:40.143 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.850043359000001, 2020-06-12T02:36:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:36:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.144 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:40.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:40.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:36:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:36:40.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:36:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:36:40.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:36:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:36:40.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:36:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:36:40.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:36:40.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:36:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:36:40.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:36:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:36:40.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:36:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:36:40.154 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.155 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:40.156 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.847009786000001, 2020-06-12T02:36:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:36:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.157 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:36:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:36:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:36:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:36:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:36:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:36:40.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:36:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:36:40.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:36:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:36:40.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:36:40.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:36:40.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:36:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:36:40.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:36:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:36:40.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:36:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:36:40.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.172 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:40.174 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:40.170+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:40.174 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:40.182 INFO:tasks.ceph.osd.2:Stopped 2020-06-12T02:36:40.183 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 2, 3, 4, 5, 6, 7, 1] 2020-06-12T02:36:40.183 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 2 2020-06-12T02:36:40.278 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:40.274+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:40.290 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:40.291 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:40.300 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:40.304 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:40.290+0000 7fe6bb807700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:40.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:40.306+0000 7fe6ba5a5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:40.383 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:40.378+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:40.404 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:40.405 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:40.413 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:40.467 INFO:tasks.ceph.mon.b.smithi117.stderr:2020-06-12T02:36:40.461+0000 7fab9fda4700 -1 mon.b@0(leader).osd e92 definitely_dead 0 2020-06-12T02:36:40.483 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:40.477+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:40.531 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:36:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 56.272551849999999, 2020-06-12T02:36:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:36:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:36:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:36:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:36:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:36:40.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:36:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:36:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:36:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:36:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:36:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:36:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:36:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:36:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:36:40.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:36:40.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:36:40.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:36:40.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:36:40.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:36:40.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:36:40.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:36:40.588 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.588 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.589 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.589 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:40.589 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:40.594 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 56.271134797999999, 2020-06-12T02:36:40.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:36:40.594 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.595 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.595 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:40.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:40.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:36:40.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:36:40.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:36:40.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:36:40.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:36:40.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:36:40.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:36:40.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:36:40.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:36:40.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:36:40.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:36:40.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:36:40.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:36:40.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.605 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.606 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.606 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:40.606 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.560570810000002, 2020-06-12T02:36:40.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:36:40.607 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.607 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.608 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:36:40.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.608 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:40.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:40.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:36:40.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:36:40.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:36:40.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:36:40.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:36:40.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:36:40.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:36:40.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:36:40.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:36:40.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:36:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:36:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:36:40.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:36:40.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:36:40.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:36:40.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:36:40.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:36:40.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:36:40.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:36:40.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:36:40.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:36:40.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:36:40.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:36:40.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:36:40.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:36:40.624 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.624 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.624 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.552889508, 2020-06-12T02:36:40.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:36:40.626 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.626 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.626 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.626 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.627 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.627 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:36:40.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.627 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:40.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:40.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:36:40.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:36:40.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:36:40.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:36:40.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:36:40.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:36:40.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:36:40.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:36:40.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:36:40.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:36:40.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:36:40.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:36:40.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:36:40.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:36:40.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:36:40.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:36:40.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:36:40.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:36:40.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:36:40.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:36:40.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:36:40.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:36:40.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:36:40.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:36:40.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:36:40.654 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.654 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.654 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.655 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.657 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:40.658 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.543834210999997, 2020-06-12T02:36:40.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:36:40.658 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.658 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:36:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:40.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:40.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:36:40.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:36:40.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:36:40.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:36:40.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:36:40.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:36:40.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:36:40.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:36:40.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:36:40.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:36:40.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:36:40.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:36:40.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:36:40.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:36:40.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:36:40.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:36:40.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:36:40.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:36:40.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:36:40.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:36:40.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:36:40.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:36:40.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:36:40.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:36:40.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:36:40.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.681 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.682 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.683 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:40.683 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.542894672000003, 2020-06-12T02:36:40.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:36:40.684 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.684 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.684 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.685 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:36:40.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.686 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:40.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:40.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:36:40.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:36:40.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:36:40.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:36:40.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:36:40.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:36:40.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:36:40.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:36:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:36:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:36:40.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:36:40.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:36:40.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:36:40.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:36:40.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:36:40.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:36:40.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:36:40.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:36:40.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:36:40.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:36:40.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:36:40.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.701 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.542762725000003, 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.702 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.703 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:36:40.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:40.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:36:40.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:36:40.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:36:40.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:36:40.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:36:40.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:36:40.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:36:40.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:36:40.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:36:40.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:36:40.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:36:40.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:36:40.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:36:40.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:36:40.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:36:40.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:36:40.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:36:40.716 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.716 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.716 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.535090427999997, 2020-06-12T02:36:40.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:36:40.718 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.718 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.718 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.718 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.718 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:40.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:40.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:36:40.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:36:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:36:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:36:40.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:36:40.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:36:40.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:36:40.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:36:40.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:36:40.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:36:40.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:36:40.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:36:40.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:36:40.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:36:40.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:36:40.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:36:40.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:36:40.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:36:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:36:40.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:36:40.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:36:40.734 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.735 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.735 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.735 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.529115462999997, 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.736 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.737 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:36:40.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.737 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:36:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:36:40.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:36:40.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:36:40.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:36:40.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:36:40.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:36:40.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:36:40.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:36:40.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:36:40.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:36:40.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:36:40.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:36:40.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:36:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:36:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:36:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:36:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.522283901000002, 2020-06-12T02:36:40.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:36:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:36:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:36:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:36:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:36:40.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:36:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:36:40.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:36:40.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:36:40.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:36:40.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:36:40.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:36:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:36:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:36:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:36:40.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:36:40.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:36:40.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:36:40.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:40.768 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.521600952, 2020-06-12T02:36:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:36:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:36:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:36:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:36:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:36:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:36:40.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:36:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:36:40.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:36:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:36:40.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:36:40.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:36:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:36:40.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:36:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:36:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:36:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:36:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:36:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:40.784 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 34.521514189999998, 2020-06-12T02:36:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:36:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:36:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:36:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:36:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:36:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:36:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:36:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:36:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:36:40.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:36:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:36:40.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:36:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:36:40.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:36:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:36:40.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:36:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.143120583999998, 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.800 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:36:40.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:40.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:36:40.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:36:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:36:40.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:36:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:36:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:36:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:36:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:36:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:36:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 25.120698647000001, 2020-06-12T02:36:40.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:36:40.812 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.812 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:36:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:36:40.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:36:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:36:40.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:36:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:36:40.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:36:40.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:36:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:36:40.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:36:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:36:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:36:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:36:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:40.825 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.274723950999999, 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:36:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:36:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:36:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:36:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:36:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:36:40.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:36:40.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:36:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:36:40.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:36:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:36:40.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:36:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:36:40.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:36:40.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:36:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:36:40.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:36:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:36:40.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:36:40.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:36:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:36:40.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.843 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.273906787000001, 2020-06-12T02:36:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:36:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.844 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:36:40.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:36:40.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:36:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:36:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:36:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:36:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:36:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:36:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:36:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:36:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:36:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:36:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:36:40.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:36:40.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:36:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:36:40.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.859 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 21.273670147000001, 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:36:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.861 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:36:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:36:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:36:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:36:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:36:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:36:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:36:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:36:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:36:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.548177215999999, 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:36:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:36:40.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:36:40.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.547896402999999, 2020-06-12T02:36:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:36:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.889 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:36:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:36:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:36:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:36:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:36:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:36:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:36:40.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:36:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:36:40.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:36:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:36:40.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:36:40.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.901 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 19.469125168000001, 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:40.902 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:36:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.903 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:36:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:36:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:36:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:36:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:36:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:36:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:36:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:40.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:36:40.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:36:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:36:40.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:36:40.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.914 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:40.915 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:40.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:40.825+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:40.916 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:40.934 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:40.929+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:40.982 INFO:teuthology.orchestra.run.smithi142.stderr:marked out osd.2. 2020-06-12T02:36:40.999 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-06-12T02:36:41.033 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:41.041 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:41.041 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:41.042 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:41.042 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:41.043 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:41.038+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:41.051 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.106+0000 7f3c1ca01700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.120 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.114+0000 7f3c1ca01700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.138 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:41.134+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.146+0000 7f518ca13700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.157 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.154+0000 7f518759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.189 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:41.199 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.200 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.209 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:41.211 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:41.237 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:41.240 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:41.233+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:41.258 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:41.287 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:41.314 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.315 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.317 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:41.323 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:41.324 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.322+0000 7f3c15d9b700 0 --2- 172.21.15.142:0/116251528 >> v2:172.21.15.142:3300/0 conn(0x7f3c180a6010 0x7f3c18137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-06-12T02:36:41.341 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:41.333+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:41.342 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:41.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:41.346 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:41.346 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:41.432 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.433 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.437 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:41.441 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:41.433+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:41.445 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:36:41.470 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:41.471 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":93,"fsid":"c120ba75-2438-45f0-aa6e-10a350976a3c","created":"2020-06-12T02:35:00.134323+0000","modified":"2020-06-12T02:36:40.960425+0000","last_up_change":"2020-06-12T02:36:34.935652+0000","last_in_change":"2020-06-12T02:36:40.960425+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2020-06-12T02:35:23.053307+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":70,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"8229ada4-dcfc-4d0c-9d6a-b9a9a0965f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":12037},{"type":"v1","addr":"172.21.15.142:6811","nonce":12037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":12037},{"type":"v1","addr":"172.21.15.142:6813","nonce":12037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":12037},{"type":"v1","addr":"172.21.15.142:6817","nonce":12037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":12037},{"type":"v1","addr":"172.21.15.142:6815","nonce":12037}]},"public_addr":"172.21.15.142:6811/12037","cluster_addr":"172.21.15.142:6813/12037","heartbeat_back_addr":"172.21.15.142:6817/12037","heartbeat_front_addr":"172.21.15.142:6815/12037","state":["exists","up"]},{"osd":1,"uuid":"74343e4c-0406-4803-8619-520cbc1c60db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":12047},{"type":"v1","addr":"172.21.15.142:6803","nonce":12047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":12047},{"type":"v1","addr":"172.21.15.142:6805","nonce":12047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":12047},{"type":"v1","addr":"172.21.15.142:6809","nonce":12047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":12047},{"type":"v1","addr":"172.21.15.142:6807","nonce":12047}]},"public_addr":"172.21.15.142:6803/12047","cluster_addr":"172.21.15.142:6805/12047","heartbeat_back_addr":"172.21.15.142:6809/12047","heartbeat_front_addr":"172.21.15.142:6807/12047","state":["exists","up"]},{"osd":2,"uuid":"18348953-2ab3-44d7-9812-308a4e504ffd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":88,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":12038},{"type":"v1","addr":"172.21.15.142:6819","nonce":12038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":12038},{"type":"v1","addr":"172.21.15.142:6821","nonce":12038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":12038},{"type":"v1","addr":"172.21.15.142:6825","nonce":12038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":12038},{"type":"v1","addr":"172.21.15.142:6823","nonce":12038}]},"public_addr":"172.21.15.142:6819/12038","cluster_addr":"172.21.15.142:6821/12038","heartbeat_back_addr":"172.21.15.142:6825/12038","heartbeat_front_addr":"172.21.15.142:6823/12038","state":["exists"]},{"osd":3,"uuid":"318d0252-36b6-489c-8cc7-eb5245346db4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":12048},{"type":"v1","addr":"172.21.15.142:6827","nonce":12048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":12048},{"type":"v1","addr":"172.21.15.142:6829","nonce":12048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":12048},{"type":"v1","addr":"172.21.15.142:6833","nonce":12048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":12048},{"type":"v1","addr":"172.21.15.142:6831","nonce":12048}]},"public_addr":"172.21.15.142:6827/12048","cluster_addr":"172.21.15.142:6829/12048","heartbeat_back_addr":"172.21.15.142:6833/12048","heartbeat_front_addr":"172.21.15.142:6831/12048","state":["exists","up"]},{"osd":4,"uuid":"e622cde1-ff3b-4df8-9e70-640bb7ce27fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":12021},{"type":"v1","addr":"172.21.15.117:6801","nonce":12021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":12021},{"type":"v1","addr":"172.21.15.117:6803","nonce":12021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":12021},{"type":"v1","addr":"172.21.15.117:6807","nonce":12021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":12021},{"type":"v1","addr":"172.21.15.117:6805","nonce":12021}]},"public_addr":"172.21.15.117:6801/12021","cluster_addr":"172.21.15.117:6803/12021","heartbeat_back_addr":"172.21.15.117:6807/12021","heartbeat_front_addr":"172.21.15.117:6805/12021","state":["exists","up"]},{"osd":5,"uuid":"f7d22a59-77a8-4264-888e-3e486a4c0d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":12020},{"type":"v1","addr":"172.21.15.117:6811","nonce":12020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":12020},{"type":"v1","addr":"172.21.15.117:6817","nonce":12020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6823","nonce":12020},{"type":"v1","addr":"172.21.15.117:6828","nonce":12020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":12020},{"type":"v1","addr":"172.21.15.117:6822","nonce":12020}]},"public_addr":"172.21.15.117:6811/12020","cluster_addr":"172.21.15.117:6817/12020","heartbeat_back_addr":"172.21.15.117:6828/12020","heartbeat_front_addr":"172.21.15.117:6822/12020","state":["exists","up"]},{"osd":6,"uuid":"60e271cc-4c4c-4397-87be-8c52ffab68d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":12022},{"type":"v1","addr":"172.21.15.117:6812","nonce":12022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6815","nonce":12022},{"type":"v1","addr":"172.21.15.117:6818","nonce":12022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":12022},{"type":"v1","addr":"172.21.15.117:6831","nonce":12022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6825","nonce":12022},{"type":"v1","addr":"172.21.15.117:6826","nonce":12022}]},"public_addr":"172.21.15.117:6812/12022","cluster_addr":"172.21.15.117:6818/12022","heartbeat_back_addr":"172.21.15.117:6831/12022","heartbeat_front_addr":"172.21.15.117:6826/12022","state":["exists","up"]},{"osd":7,"uuid":"0f243681-edad-4e3d-9980-cfc55c5f93ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":12023},{"type":"v1","addr":"172.21.15.117:6813","nonce":12023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":12023},{"type":"v1","addr":"172.21.15.117:6819","nonce":12023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6827","nonce":12023},{"type":"v1","addr":"172.21.15.117:6829","nonce":12023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6821","nonce":12023},{"type":"v1","addr":"172.21.15.117:6824","nonce":12023}]},"public_addr":"172.21.15.117:6813/12023","cluster_addr":"172.21.15.117:6819/12023","heartbeat_back_addr":"172.21.15.117:6829/12023","heartbeat_front_addr":"172.21.15.117:6824/12023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.988040+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.578658+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":65536,"last_purged_snaps_scrub":"2020-06-12T02:36:07.294920+0000","dead_epoch":88},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:08.017776+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:06.919687+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.053961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.210941+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-06-12T02:36:07.971670+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":50,"length":1},{"begin":58,"length":1},{"begin":62,"length":1},{"begin":65,"length":1},{"begin":69,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-06-12T02:36:41.484 INFO:tasks.thrashosds.thrasher:pool unique_pool_0 min_size is 2 2020-06-12T02:36:41.485 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get unique_pool_0 erasure_code_profile 2020-06-12T02:36:41.546 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:41.541+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:41.562 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.563 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.574 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.562+0000 7f7a21250700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:41.579 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.574+0000 7f7a21250700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.645 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.630+0000 7f4969a94700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.648 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.642+0000 7f4968832700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:41.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:41.641+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:41.712 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.713 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.730 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:41.758 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:41.741+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:41.822 INFO:teuthology.orchestra.run.smithi142.stdout:erasure_code_profile: teuthologyprofile 2020-06-12T02:36:41.833 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:41.833 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:41.841 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile get teuthologyprofile --format=json 2020-06-12T02:36:41.843 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:41.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:41.845+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:41.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:41.949+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:41.994 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:36:42.009 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:41.998+0000 7f5b44cf1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:42.012 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:42.010+0000 7f5b3f59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:42.020 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.021 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.032 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:42.077 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:42.074+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:42.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:42.149+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:42.184 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.185 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.190 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:42.190 INFO:teuthology.orchestra.run.smithi142.stdout:{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"} 2020-06-12T02:36:42.195 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:42.202 INFO:tasks.thrashosds.thrasher:pool unique_pool_0 local_k=2 local_m=1 2020-06-12T02:36:42.202 INFO:tasks.thrashosds.thrasher:setting k=2 from previous 0 2020-06-12T02:36:42.202 INFO:tasks.thrashosds.thrasher:setting m=1 from previous 99 2020-06-12T02:36:42.203 INFO:tasks.thrashosds.thrasher:using k=2, m=1 2020-06-12T02:36:42.203 INFO:tasks.thrashosds.thrasher:choosing based on number of live OSDs and rand val 0.4768898026307372 2020-06-12T02:36:42.203 INFO:tasks.thrashosds.thrasher:chose to kill 1 OSDs 2020-06-12T02:36:42.254 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:42.245+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:42.312 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.312 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.323 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:42.367 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:42.361+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:42.455 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:42.450+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:42.479 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.479 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.488 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:42.556 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:42.550+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:42.605 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.606 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.607 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:42.657 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:42.654+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:42.713 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.714 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.728 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:42.759 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:42.754+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:42.837 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.838 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.845 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:42.890 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:42.885+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:42.954 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:42.955 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:42.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:42.953+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:42.964 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:43.067 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:43.061+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:43.136 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:43.136 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:43.146 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:43.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:43.185+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:43.263 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:43.257+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:43.305 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:43.306 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:43.317 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:43.348 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:43.402 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:43.397+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:43.459 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:43.454+0000 7ffa544b4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:43.466 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:43.462+0000 7ffa53252700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:43.468 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:43.468 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:43.472 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:43.465+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:43.477 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:43.501 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:43.524 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:43.553 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:43.572 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:43.575 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:43.570+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:43.593 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:43.618 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:43.627 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:43.627 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:43.636 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.643 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.644 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:43.644 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:43.644 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.644 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:43.647 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:43.647 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:43.689 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:43.686+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:43.739 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:43.740 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:43.748 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:43.794 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:43.789+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:43.860 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:36:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.603918184999998, 2020-06-12T02:36:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:36:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:36:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:36:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:36:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:36:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:36:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:36:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:36:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:36:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:36:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:36:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:36:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:36:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:36:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:36:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.602501132999997, 2020-06-12T02:36:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:36:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:36:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:36:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:36:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:36:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:36:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:36:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:36:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:36:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:36:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:36:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:36:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:36:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.891937145, 2020-06-12T02:36:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:36:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:36:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:36:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:36:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:36:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:36:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:36:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:36:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:36:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:36:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:36:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:36:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:36:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:36:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:36:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:36:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:36:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:36:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:36:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:36:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.884255842999998, 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:36:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:36:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:36:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:36:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:36:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:36:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:36:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:36:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:36:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:36:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:36:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:36:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:36:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:36:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:36:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:36:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:36:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:36:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.875200546000002, 2020-06-12T02:36:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:36:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:36:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:36:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:36:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:36:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:36:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:36:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:36:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:36:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:36:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:36:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:36:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:36:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:36:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:36:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:36:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:36:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:36:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:36:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:36:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:36:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.939 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.940 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.940 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:43.940 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.874261007000001, 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:36:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:36:43.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:36:43.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:36:43.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:36:43.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:36:43.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:36:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:36:43.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:36:43.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:36:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:36:43.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:36:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:36:43.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:43.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:36:43.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:36:43.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:43.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:36:43.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:36:43.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:36:43.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:36:43.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.957 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.957 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:36:43.958 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:43.958 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.874129060000001, 2020-06-12T02:36:43.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:36:43.958 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.958 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:36:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.960 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:43.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:36:43.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:36:43.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:36:43.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:36:43.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:36:43.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:36:43.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:36:43.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:36:43.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:36:43.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:36:43.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:36:43.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:36:43.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:36:43.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:36:43.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:36:43.972 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.972 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.972 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.866456763000002, 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.973 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:36:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.975 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:43.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:36:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:36:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:36:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:36:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:36:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:36:43.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:36:43.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:36:43.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:36:43.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:43.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:36:43.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:36:43.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:43.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:36:43.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:36:43.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:43.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:36:43.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:36:43.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:43.986 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:43.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.987 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:43.987 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:43.987 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.860481798000002, 2020-06-12T02:36:43.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:36:43.988 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:43.988 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:43.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:43.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:43.989 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:43.989 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:36:43.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.989 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:43.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:43.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:43.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:43.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:43.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:36:43.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:36:43.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:43.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:36:43.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:36:43.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:43.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:36:43.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:36:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:36:43.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:43.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:36:43.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:36:43.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:43.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:36:43.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:36:43.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:43.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:43.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:43.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:36:43.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:36:43.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:36:44.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:36:44.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:36:44.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:36:44.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:36:44.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:36:44.004 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.005 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.006 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:44.006 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:44.007 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.853650236, 2020-06-12T02:36:44.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:36:44.007 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.007 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.007 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.008 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:36:44.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.008 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:36:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:36:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:36:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:36:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:36:44.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:36:44.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:36:44.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:36:44.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:36:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:36:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:36:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:36:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:36:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:36:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:36:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:36:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:36:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:36:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:36:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:36:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:36:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:36:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:36:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:36:44.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.033 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:36:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:44.034 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.852967286999998, 2020-06-12T02:36:44.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:36:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.037 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.038 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:36:44.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.039 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:44.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:36:44.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:36:44.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:36:44.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:36:44.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:36:44.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:36:44.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:36:44.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:36:44.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:36:44.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:36:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:36:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:36:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:36:44.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:36:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:36:44.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:36:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:36:44.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:36:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:36:44.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:36:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:36:44.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:36:44.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:36:44.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:36:44.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:36:44.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:36:44.057 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.057 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:44.058 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.852880525000003, 2020-06-12T02:36:44.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:36:44.059 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.059 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.059 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.059 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:36:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:36:44.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:36:44.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:36:44.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:36:44.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:36:44.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:36:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:36:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:36:44.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:36:44.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:36:44.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:36:44.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:36:44.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:36:44.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:36:44.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:36:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:36:44.073 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.074 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.474486919, 2020-06-12T02:36:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:36:44.076 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:36:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:44.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:36:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:36:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:36:44.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:36:44.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:36:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:36:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:36:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:36:44.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:36:44.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:36:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:36:44.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:36:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:36:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:36:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:36:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:36:44.092 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:36:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.452064982, 2020-06-12T02:36:44.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:36:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.096 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:36:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:36:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:36:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:36:44.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:36:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:36:44.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:36:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:36:44.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:36:44.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:36:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:36:44.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:36:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:36:44.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:36:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:36:44.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:36:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:36:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:36:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:36:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.110 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:44.111 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.606090286000001, 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.112 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:36:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:36:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:36:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:36:44.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:36:44.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:36:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:36:44.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:36:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:36:44.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:36:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:36:44.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:36:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:36:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:36:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:36:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:36:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:36:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:36:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:36:44.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:36:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:36:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.127 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:44.128 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.605273122, 2020-06-12T02:36:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:36:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:36:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:36:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:36:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:36:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:36:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:36:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:36:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:36:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:36:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:36:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:36:44.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:36:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:36:44.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:36:44.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:44.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:36:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:36:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.605036481999999, 2020-06-12T02:36:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:36:44.145 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.146 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:36:44.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:36:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:36:44.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:36:44.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:36:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:36:44.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:36:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:36:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:36:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:36:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:36:44.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:36:44.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:36:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:36:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:36:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:36:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:36:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.879543551000001, 2020-06-12T02:36:44.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.161 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:36:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:36:44.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:36:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:36:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:36:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:36:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:36:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:36:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:36:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:44.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:36:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:36:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:36:44.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:36:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:36:44.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:36:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.879262738000001, 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.174 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:36:44.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:36:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:36:44.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:36:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:36:44.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:36:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:36:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:36:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:36:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:36:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:36:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:36:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:36:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:36:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 22.800491503, 2020-06-12T02:36:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:36:44.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:36:44.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:44.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:36:44.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:36:44.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:36:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:36:44.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:36:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:36:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:36:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:36:44.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:36:44.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:36:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:36:44.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:36:44.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:44.200 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:44.201 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:36:44.203 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:44.198+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:44.203 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:44.306 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:44.298+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:44.320 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:44.306+0000 7f6a20ae7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:44.321 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:44.321 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:44.322 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:44.322 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:44.323 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:44.318+0000 7f6a1b59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:44.331 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:44.417 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:44.414+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:44.478 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:44.478 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:44.479 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:44.479 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:44.487 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:44.529 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:44.526+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:44.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:44.605+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:44.637 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:44.637 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:44.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:44.638 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:44.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.638 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:44.638 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:44.638 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.536700397000004, 2020-06-12T02:36:44.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:36:44.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.639 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.639 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.640 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:36:44.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.640 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:44.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:36:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:36:44.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:36:44.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:36:44.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:36:44.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:36:44.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:36:44.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:36:44.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:36:44.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:36:44.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:36:44.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:36:44.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:36:44.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:36:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:36:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:36:44.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:36:44.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.653 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:44.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:44.654 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.536530029999994, 2020-06-12T02:36:44.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:36:44.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.654 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:36:44.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:44.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:36:44.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:36:44.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:36:44.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:36:44.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:36:44.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:36:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:36:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:36:44.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:36:44.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:44.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:36:44.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:36:44.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:36:44.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:36:44.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:36:44.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:36:44.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:36:44.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:36:44.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.669 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:44.669 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:44.669 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.518392003000002, 2020-06-12T02:36:44.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:36:44.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.670 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:44.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:36:44.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:36:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:36:44.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:36:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:36:44.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:36:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:36:44.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:36:44.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:36:44.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:36:44.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:36:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:36:44.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:36:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:36:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:36:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:36:44.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.512455119999998, 2020-06-12T02:36:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:36:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:36:44.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:44.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:44.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:36:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:36:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:36:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:36:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:36:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:36:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:36:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:36:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:36:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:36:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:36:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:36:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:36:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:36:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:36:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:36:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.700 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:44.700 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:44.700 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.511946049000002, 2020-06-12T02:36:44.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:36:44.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.701 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:44.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:44.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:36:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:36:44.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:36:44.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:36:44.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:36:44.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:36:44.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:36:44.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:36:44.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:36:44.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:36:44.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:36:44.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:36:44.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:36:44.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:36:44.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:36:44.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:36:44.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:36:44.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:36:44.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:36:44.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:44.719 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:44.720 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.511787783000003, 2020-06-12T02:36:44.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:36:44.720 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.720 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:36:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.721 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:44.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:36:44.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:36:44.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:36:44.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:36:44.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:36:44.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:36:44.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:36:44.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:36:44.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:36:44.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:36:44.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:36:44.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:36:44.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:36:44.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:36:44.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:36:44.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:36:44.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:36:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:36:44.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.437390981, 2020-06-12T02:36:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:36:44.741 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.742 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:36:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:36:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:36:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:36:44.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:36:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:36:44.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:36:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:36:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:36:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:36:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:36:44.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:36:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:36:44.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:36:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:36:44.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:36:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:36:44.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:36:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:36:44.756 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.757 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:36:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.430380159000002, 2020-06-12T02:36:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:36:44.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.759 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:36:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.760 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:36:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:36:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:36:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:36:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:36:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:36:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:36:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:36:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:36:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:36:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:36:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:36:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:36:44.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:36:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:36:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:36:44.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:36:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.670593615999998, 2020-06-12T02:36:44.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.776 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:36:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:36:44.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:36:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:36:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:36:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:36:44.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:36:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:36:44.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:36:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:36:44.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:36:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:36:44.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:36:44.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:36:44.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:36:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:36:44.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:36:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:36:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:36:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:36:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:36:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:36:44.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:36:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:36:44.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.795 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.670466019999999, 2020-06-12T02:36:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:36:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.796 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:36:44.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:36:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:36:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:36:44.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:36:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:36:44.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:36:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:36:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:36:44.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:36:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:36:44.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:36:44.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:36:44.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:36:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:36:44.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:36:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:36:44.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:36:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:36:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:36:44.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:36:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:36:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:36:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:36:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:36:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:36:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:36:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:36:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.255485379, 2020-06-12T02:36:44.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:36:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:36:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:36:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:36:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:36:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:36:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:36:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:36:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:36:44.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:36:44.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:36:44.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:36:44.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:36:44.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:36:44.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.838 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:44.838 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:44.839 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.255340621999999, 2020-06-12T02:36:44.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:36:44.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.841 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.841 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.841 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:36:44.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.843 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:44.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:44.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:36:44.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:36:44.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:36:44.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:36:44.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:36:44.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:36:44.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:36:44.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:36:44.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:36:44.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:36:44.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:36:44.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.852 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.852 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:44.853 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:44.853 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.255209772000001, 2020-06-12T02:36:44.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:36:44.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.853 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.854 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:36:44.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:44.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:36:44.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:36:44.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:36:44.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:36:44.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:36:44.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:36:44.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:36:44.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:36:44.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:36:44.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:36:44.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:36:44.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.864 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.864 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.25506545, 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.865 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:36:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:44.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:36:44.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:36:44.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:36:44.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:36:44.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:36:44.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:36:44.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:36:44.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:36:44.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:36:44.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:36:44.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:36:44.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:36:44.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:36:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:36:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:36:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:36:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:36:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:36:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:36:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:36:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.254953469, 2020-06-12T02:36:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:36:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:36:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:44.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:36:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:36:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:36:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:36:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:36:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:36:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:36:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:36:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:36:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:36:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:36:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:36:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:36:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:36:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:36:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:36:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:36:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:36:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:36:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:36:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:36:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.254800983999999, 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:36:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:36:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:36:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:36:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:36:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:36:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:36:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:36:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:36:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:36:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:36:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:36:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:36:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:36:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:36:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:36:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.234055846, 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:36:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:36:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:36:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:36:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:36:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:36:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:36:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:36:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:36:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:36:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:36:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:36:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:36:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:36:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:36:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:36:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.233730752, 2020-06-12T02:36:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:36:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:36:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:36:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:36:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:36:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:36:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:36:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:36:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:36:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:36:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:36:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:36:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:36:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:36:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:36:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:36:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:36:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:36:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:36:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:36:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:36:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:36:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:36:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.118084269000001, 2020-06-12T02:36:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:36:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:36:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:36:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:36:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:36:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:36:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:36:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:36:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:36:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:36:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:36:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:36:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:36:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:36:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:36:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:36:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:36:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:36:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.117744010999999, 2020-06-12T02:36:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:36:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:36:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:36:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:36:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:36:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:36:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:36:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:36:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:36:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:36:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:36:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:36:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:36:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:36:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:36:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:44.978 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:44.979 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:44.974+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:44.980 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:45.014 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:36:45.081 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:45.074+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:45.116 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:45.116 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:45.116 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:45.117 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:45.128 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:45.181 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:45.173+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:45.284 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:45.277+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:45.289 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:45.389 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:45.381+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:45.396 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:45.397 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:45.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:45.397 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:45.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.397 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:45.398 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:45.398 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.674353495000005, 2020-06-12T02:36:45.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:36:45.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.398 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.399 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:36:45.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.400 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:45.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:45.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:36:45.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:36:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:36:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:36:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:36:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:36:45.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:36:45.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:36:45.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:36:45.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:36:45.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:36:45.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:36:45.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:36:45.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:36:45.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:36:45.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:36:45.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:36:45.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:36:45.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:36:45.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:36:45.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:36:45.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:36:45.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:36:45.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.418 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:45.419 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:45.419 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.244374242999996, 2020-06-12T02:36:45.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:36:45.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.420 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:36:45.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.421 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:45.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:45.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:36:45.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:36:45.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:36:45.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:36:45.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:36:45.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:36:45.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:45.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:36:45.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:36:45.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:36:45.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:36:45.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:45.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:36:45.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:36:45.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:36:45.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:36:45.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:36:45.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:36:45.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:36:45.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:36:45.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.434 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:45.434 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:45.435 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.128411077999999, 2020-06-12T02:36:45.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:36:45.435 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.435 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:36:45.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.437 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:45.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:45.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:36:45.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:36:45.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:36:45.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:36:45.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:36:45.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:45.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:36:45.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:36:45.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:36:45.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:36:45.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:36:45.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:36:45.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:36:45.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:36:45.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:36:45.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:36:45.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:36:45.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:36:45.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:36:45.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:36:45.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:36:45.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.451 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.452 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:45.452 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:45.452 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.128034076999995, 2020-06-12T02:36:45.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:36:45.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.453 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.453 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.453 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.454 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.454 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:36:45.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.454 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:45.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:45.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:36:45.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:36:45.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:36:45.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:36:45.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:36:45.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:36:45.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:36:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:36:45.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:36:45.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:45.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:36:45.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:36:45.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:36:45.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:36:45.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:36:45.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:36:45.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:36:45.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:36:45.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:36:45.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:36:45.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:36:45.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:36:45.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.474 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.475 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:45.476 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:45.476 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.127624542000007, 2020-06-12T02:36:45.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:36:45.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.478 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:36:45.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.479 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:45.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:45.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:36:45.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:36:45.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:36:45.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:36:45.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:36:45.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:36:45.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:36:45.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:36:45.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:36:45.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:36:45.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:36:45.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:36:45.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:36:45.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:36:45.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:36:45.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:36:45.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:36:45.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:36:45.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:36:45.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:36:45.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:36:45.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.499 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:45.500 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:45.500 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.127232211000006, 2020-06-12T02:36:45.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:36:45.502 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.502 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.502 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.503 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.503 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.503 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:36:45.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.504 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:45.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:45.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:36:45.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:36:45.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:36:45.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:36:45.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:36:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:36:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:36:45.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:36:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:36:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:36:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:36:45.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:45.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:36:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:36:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:36:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:36:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:36:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:36:45.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:36:45.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:36:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:36:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:36:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:36:45.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:36:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.526 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.110297782999993, 2020-06-12T02:36:45.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:36:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.529 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:36:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:45.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:36:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:36:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:36:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:36:45.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:36:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:36:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:36:45.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:36:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:36:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:36:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:36:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:36:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:36:45.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:36:45.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:36:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:36:45.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:36:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:36:45.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:36:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:36:45.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:36:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:45.555 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.104303184000003, 2020-06-12T02:36:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:36:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:36:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:36:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:36:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:36:45.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:36:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:36:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:36:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:36:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:36:45.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:36:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:36:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:36:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:36:45.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:36:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:36:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:36:45.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:36:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:36:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:36:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:36:45.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:36:45.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:36:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.579 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.103166610000002, 2020-06-12T02:36:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:36:45.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.581 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.582 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:36:45.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:45.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:36:45.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:36:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:36:45.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:36:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:36:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:36:45.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:36:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:36:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:36:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:36:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:36:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:36:45.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:36:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:36:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:36:45.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:36:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:36:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:36:45.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:36:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:36:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.605 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:45.607 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.102984512999996, 2020-06-12T02:36:45.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:36:45.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.608 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.610 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:36:45.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.620 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:45.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:45.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:36:45.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:36:45.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:36:45.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:36:45.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:36:45.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:36:45.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:36:45.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:36:45.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:36:45.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:36:45.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:36:45.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:36:45.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:36:45.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:36:45.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:36:45.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.633 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.634 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:45.634 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:45.634 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.455799190999997, 2020-06-12T02:36:45.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:36:45.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.635 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:45.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:45.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:36:45.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:36:45.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:36:45.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:36:45.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:36:45.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:36:45.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:36:45.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:36:45.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:36:45.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:36:45.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:36:45.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:36:45.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:36:45.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:36:45.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:36:45.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:36:45.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:36:45.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:36:45.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:36:45.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.656 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.657 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:45.657 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:45.657 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.455486801999996, 2020-06-12T02:36:45.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:36:45.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:45.658 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.658 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.659 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.659 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:36:45.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.659 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:45.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:45.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:36:45.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:36:45.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:36:45.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:36:45.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:36:45.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:36:45.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:36:45.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:36:45.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:36:45.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:45.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:36:45.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:36:45.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:36:45.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:36:45.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:36:45.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:36:45.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:36:45.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:36:45.676 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.677 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:45.677 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:45.678 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.44391821, 2020-06-12T02:36:45.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:36:45.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:36:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:45.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:36:45.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:36:45.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:36:45.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:36:45.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:36:45.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:36:45.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:36:45.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:36:45.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:36:45.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:45.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:36:45.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:36:45.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:36:45.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:36:45.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:36:45.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:36:45.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:36:45.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:36:45.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:36:45.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:36:45.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:36:45.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:36:45.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.443578752000001, 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:36:45.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.697 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:36:45.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.697 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:45.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:36:45.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:36:45.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:36:45.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:36:45.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:36:45.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:36:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:36:45.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:36:45.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:45.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:36:45.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:36:45.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:36:45.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:36:45.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:36:45.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:36:45.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:36:45.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:36:45.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:36:45.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:36:45.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.712 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:45.712 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:45.712 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.443282306999997, 2020-06-12T02:36:45.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:36:45.712 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.713 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:45.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.713 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.713 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:36:45.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.714 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:45.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:36:45.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:36:45.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:36:45.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:36:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:36:45.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:36:45.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:36:45.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:45.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:36:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:36:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:45.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:36:45.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:36:45.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:45.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:36:45.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:36:45.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:45.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:36:45.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:36:45.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:45.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:36:45.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:36:45.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.729 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.730 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:45.730 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:45.732 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.406248530999999, 2020-06-12T02:36:45.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:36:45.732 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.733 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:36:45.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.734 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:45.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:36:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:36:45.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:36:45.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:36:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:36:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:36:45.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:36:45.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:36:45.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:36:45.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:36:45.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:36:45.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:36:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:36:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.745 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:45.745 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:45.746 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.398642083, 2020-06-12T02:36:45.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:36:45.746 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.746 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:45.746 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.747 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.747 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.747 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:36:45.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.747 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:45.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:36:45.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:36:45.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:36:45.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:36:45.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:36:45.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:36:45.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:36:45.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:36:45.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:36:45.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:36:45.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:36:45.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:45.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:36:45.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:36:45.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:36:45.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:36:45.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:36:45.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:36:45.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.759 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.760 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:45.760 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:45.761 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.395263545000001, 2020-06-12T02:36:45.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:36:45.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.761 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:45.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.762 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:36:45.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:45.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:45.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:36:45.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:36:45.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:36:45.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:36:45.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:36:45.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:36:45.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:36:45.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:36:45.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:36:45.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:45.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:36:45.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:36:45.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:36:45.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:36:45.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:36:45.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:36:45.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.773 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.394993291, 2020-06-12T02:36:45.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:36:45.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.775 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:45.775 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:36:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:45.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:45.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:36:45.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:36:45.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:36:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:36:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:36:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:36:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:36:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:36:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:36:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:36:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:36:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:36:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:36:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:36:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.394812169, 2020-06-12T02:36:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:36:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:36:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:36:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:36:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:36:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:36:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:36:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:36:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:36:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:36:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:36:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:36:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:36:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:36:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:36:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:36:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:45.804 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:45.804 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:45.806 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:45.797+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:45.807 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:45.909 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:45.902+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:45.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:45.962+0000 7f716689d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:45.970 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:45.970 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:45.976 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:45.966+0000 7f716563b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:45.983 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:46.002 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:46.008 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:46.001+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:46.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2020-06-12T02:36:46.026 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:46.066 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:46.110 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:46.106+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:46.111 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.111 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.120 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:46.121 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:46.154 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:46.170 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:46.174 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:46.175 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:46.218 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:46.214+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:46.257 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.258 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.267 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:46.313 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:46.310+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:46.385 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.385 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.395 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:46.413 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:46.410+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:46.499 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.499 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.508 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:46.559 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:46.553+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:46.618 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.618 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.619 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:46.613+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:46.627 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:46.719 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:46.713+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:46.778 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.778 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.789 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:46.830 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:46.825+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:46.926 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:46.918+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:46.943 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:46.943 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:46.953 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:47.024 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:47.017+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:47.028 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:36:47.063 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.063 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.072 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:47.126 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:47.117+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:47.155 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:47.134+0000 7fdf0f54e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:47.157 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:47.150+0000 7fdf0e2ec700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:47.224 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:47.217+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:47.241 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.242 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.251 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:47.338 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:47.333+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:47.407 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.408 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.418 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:47.427 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:47.422+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:47.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:47.521+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:47.571 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.571 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.581 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:47.634 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:47.625+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:47.733 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:47.730+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:47.743 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.744 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.755 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:47.834 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:47.829+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:47.871 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:47.935 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:47.930+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:48.026 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:48.027 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:48.039 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:48.034+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:48.039 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:36:48.140 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:48.133+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:48.150 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:48.151 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:48.160 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:48.176 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:48.253 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:48.250+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:48.261 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:48.261 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:48.271 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:48.308 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:48.302+0000 7f0962537700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:48.314 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:48.310+0000 7f09612d5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:48.342 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:48.337+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:48.349 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:48.370 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:48.390 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:48.413 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.312938346999999, 2020-06-12T02:36:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:36:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:36:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:36:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:36:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:36:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:36:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:36:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:36:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:36:48.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:36:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:36:48.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:36:48.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:36:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:36:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:36:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:36:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:36:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:36:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.312767980000004, 2020-06-12T02:36:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:36:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:36:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:36:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:36:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:36:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:36:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:36:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:36:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:36:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:36:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:36:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:36:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:36:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:36:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:36:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:36:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:36:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.294629952999998, 2020-06-12T02:36:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:36:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:36:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:36:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:36:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:36:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:36:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:36:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:36:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.288693069999994, 2020-06-12T02:36:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:36:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:36:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:36:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:36:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:36:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:36:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:36:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:36:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:36:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:36:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:36:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:36:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:36:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:36:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.288183998999997, 2020-06-12T02:36:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:36:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:36:48.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:36:48.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:36:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:36:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:36:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:36:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:36:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:36:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:36:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:36:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:36:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:36:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:36:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:36:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:36:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:36:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:36:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.288025732999998, 2020-06-12T02:36:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:36:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:36:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:36:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:36:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:36:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:36:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:36:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:36:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:36:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:36:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:36:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:36:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:36:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:36:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.213628931000002, 2020-06-12T02:36:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:36:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:36:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:36:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:36:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:36:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:36:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:36:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:36:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:36:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:36:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:36:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:36:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:36:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:36:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:36:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:36:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.206618108999997, 2020-06-12T02:36:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:36:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:36:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:36:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:36:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:36:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:36:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:36:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:36:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:36:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:36:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:36:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:36:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:36:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.446831566, 2020-06-12T02:36:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:36:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:36:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:36:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:36:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:36:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:36:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:36:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:36:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:36:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:36:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:36:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:36:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:36:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:36:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:36:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:36:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:36:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:36:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:36:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:36:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:36:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:36:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:36:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 48.446703970000002, 2020-06-12T02:36:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:36:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:36:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:36:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:36:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:36:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:36:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:36:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:36:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:36:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:36:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:36:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:36:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:36:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:36:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:36:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:36:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:36:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:36:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:36:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:36:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:36:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:36:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:36:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:36:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:36:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:36:48.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:36:48.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:36:48.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:36:48.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031723329000002, 2020-06-12T02:36:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:36:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:36:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:36:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:36:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:36:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:36:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:36:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:36:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:36:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:36:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:36:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:36:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031578572000001, 2020-06-12T02:36:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:36:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:36:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:36:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:36:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:36:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:36:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:36:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:36:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:36:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:36:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:36:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:36:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:36:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:36:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031447722000003, 2020-06-12T02:36:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:36:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:36:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:36:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:36:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:36:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:36:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:36:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:36:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:36:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:36:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:36:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031303399999999, 2020-06-12T02:36:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:36:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:36:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:36:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:36:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:36:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:36:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:36:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:36:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:36:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:36:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:36:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:36:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:36:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:36:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:36:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:36:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:36:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:36:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031191419000002, 2020-06-12T02:36:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:36:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:36:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:36:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:36:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:36:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:36:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:36:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:36:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:36:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:36:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:36:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:36:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:36:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:36:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:36:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:36:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:36:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.031038934000001, 2020-06-12T02:36:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:36:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:36:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:36:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:36:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:36:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:36:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:36:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:36:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:36:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:36:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:36:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:36:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:36:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:36:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:36:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:36:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:36:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.010293795999999, 2020-06-12T02:36:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:36:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:36:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:36:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:36:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:36:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:36:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:36:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:36:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:36:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:36:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:36:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:36:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:36:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:36:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:36:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:36:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:36:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:36:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:36:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.009968702000002, 2020-06-12T02:36:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:36:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:36:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:36:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:36:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:36:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:36:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:36:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:36:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:36:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:36:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:36:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:36:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:36:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:36:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:36:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:36:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:36:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:36:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:36:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:36:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:36:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:36:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.894322218999999, 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:36:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:36:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:36:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:36:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:36:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:36:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:36:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:36:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:36:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:36:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:36:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:36:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:36:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:36:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:36:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:36:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:36:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:36:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:36:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:36:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.893981961000001, 2020-06-12T02:36:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:36:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:36:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:36:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:36:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:36:48.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:36:48.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:48.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:36:48.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:36:48.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:48.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:36:48.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:36:48.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:48.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:36:48.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:36:48.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:36:48.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:36:48.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:48.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:36:48.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:36:48.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:36:48.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:36:48.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:48.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:36:48.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:36:48.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:48.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:36:48.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:36:48.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:48.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:36:48.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:36:48.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:48.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:48.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:48.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:36:48.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:36:48.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.728 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:48.729 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:48.729 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:48.731 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:48.731 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:48.732 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:48.732 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.734 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.734 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:48.734 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:48.734 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:48.735 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:48.725+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:48.736 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:48.833 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:48.826+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:48.890 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:48.890 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:48.900 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:48.941 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:48.938+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:49.038 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:49.029+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:49.052 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:49.053 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:49.053 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:49.053 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:49.053 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:49.062 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:49.145 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:49.134+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:49.175 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:49.175 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:49.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:49.176 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:49.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.176 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:36:49.176 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:49.177 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.450194531999998, 2020-06-12T02:36:49.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:36:49.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.177 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.178 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:36:49.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:36:49.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:36:49.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:36:49.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:36:49.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:36:49.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:36:49.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:36:49.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:36:49.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:36:49.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:36:49.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:36:49.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:36:49.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:36:49.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:36:49.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:36:49.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:36:49.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:36:49.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:36:49.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:36:49.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:36:49.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:36:49.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:36:49.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:36:49.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:36:49.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:49.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.020215280000002, 2020-06-12T02:36:49.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:36:49.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.199 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:36:49.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.199 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:36:49.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:36:49.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:36:49.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:36:49.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:36:49.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:36:49.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:36:49.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:49.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:36:49.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:36:49.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:36:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:36:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:36:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:36:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:36:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:36:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.904252115000006, 2020-06-12T02:36:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:36:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.214 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:36:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:36:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:36:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:36:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:36:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:36:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:36:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:36:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:36:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:36:49.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:36:49.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:36:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:36:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:36:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:36:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:36:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:36:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:36:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:36:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:36:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:36:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.230 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.230 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:49.231 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:49.231 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.903875114000002, 2020-06-12T02:36:49.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:36:49.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.232 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.232 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.232 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:36:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:36:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:36:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:36:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:36:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:36:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:36:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:36:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:36:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:36:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:36:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:36:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:36:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:49.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:36:49.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:36:49.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:36:49.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:36:49.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:36:49.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:36:49.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:36:49.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:36:49.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:36:49.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:36:49.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:36:49.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:36:49.248 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:49.250 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.903465578999999, 2020-06-12T02:36:49.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:36:49.250 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.250 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.250 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:36:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:36:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:36:49.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:36:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:36:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:36:49.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:36:49.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:36:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:36:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:36:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:36:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:36:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:36:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:36:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:36:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:36:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:36:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:36:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:36:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.903073247999998, 2020-06-12T02:36:49.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:36:49.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.266 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.266 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.266 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:36:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:36:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:36:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:36:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:36:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:36:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:36:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:36:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:36:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:36:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:36:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:36:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.886138819999999, 2020-06-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.282 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:49.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:36:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:36:49.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:36:49.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:36:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:36:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:36:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:36:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:36:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:36:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.880144220999995, 2020-06-12T02:36:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:36:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:36:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:36:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:36:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:36:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:36:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:36:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:36:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:36:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:36:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:36:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:36:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:36:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:36:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:36:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.879007646999995, 2020-06-12T02:36:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:36:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:36:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:36:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:36:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:36:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:36:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:36:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:36:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:36:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:36:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:36:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:36:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:36:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:36:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.878825550000002, 2020-06-12T02:36:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:36:49.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:36:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:36:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:36:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:36:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:36:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:36:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:36:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:36:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:36:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:36:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:36:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:36:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:36:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.231640228000003, 2020-06-12T02:36:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:36:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:36:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:36:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:36:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:36:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:36:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:36:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:36:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:36:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:36:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:36:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:36:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:36:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:36:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:36:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:36:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:36:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:36:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:36:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:36:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:36:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:36:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:36:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.231327839000002, 2020-06-12T02:36:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:36:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:36:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:36:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:36:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:36:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:36:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:36:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:36:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:36:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:36:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:36:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:36:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:36:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:36:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:36:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:36:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:36:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:36:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:36:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:36:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:36:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 55.219759246999999, 2020-06-12T02:36:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:36:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:36:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:36:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:36:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:36:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:36:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:36:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:36:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:36:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:36:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:36:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:36:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:36:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:36:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:36:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:36:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:36:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:36:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:36:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:36:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 55.219419789, 2020-06-12T02:36:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:36:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:36:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:36:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:36:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:36:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:36:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:36:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:36:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:36:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:36:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:36:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:36:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:36:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:36:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:36:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:36:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:36:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:36:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:36:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:36:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:36:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 55.219123344000003, 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:36:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:36:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:36:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:36:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:36:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:36:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:36:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:36:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:36:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:36:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:36:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:36:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:36:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:36:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:36:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:36:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:36:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:36:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:36:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:36:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:36:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:36:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:36:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.182089568, 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:36:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:36:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:36:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:36:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:36:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:36:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:36:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:36:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:36:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:36:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:36:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:36:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:36:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:36:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:36:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.17448312, 2020-06-12T02:36:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:36:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:36:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:36:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:36:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:36:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:36:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:36:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:36:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:36:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:36:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:36:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:36:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:36:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:36:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.171104582, 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:36:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:36:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:36:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:36:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:36:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:36:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:36:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:36:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:36:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:36:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:36:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:36:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:36:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:36:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:36:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:36:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.170834328, 2020-06-12T02:36:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:36:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:36:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:36:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:36:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:36:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:36:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:36:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:36:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:36:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:36:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:36:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:36:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:36:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:36:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:36:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:36:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:36:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.170653206000001, 2020-06-12T02:36:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:36:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:36:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:36:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:36:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:36:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:36:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:36:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:36:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:36:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:36:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:36:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:36:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:36:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:36:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:36:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:36:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:36:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.502 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:49.503 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:49.497+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:49.504 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:49.609 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:49.606+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:49.661 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:49.662 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:49.662 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:36:49.662 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:49.671 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:49.715 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:49.710+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:49.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:49.805+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:49.843 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:49.844 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:36:49.844 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:36:49.844 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:36:49.844 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:49.845 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:49.915 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:49.910+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:49.972 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:36:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:36:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:36:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:36:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.842486398999995, 2020-06-12T02:36:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:36:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:36:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:36:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:36:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:36:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:36:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:36:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:36:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:36:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:36:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:36:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:36:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:36:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:36:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:36:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:36:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:36:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:36:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:36:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:36:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:36:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 78.842262957000003, 2020-06-12T02:36:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:36:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:36:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:36:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:36:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:36:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:36:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:36:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:36:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:36:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:36:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:36:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:36:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:36:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:36:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:36:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:36:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:36:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:36:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:36:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:36:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:36:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:36:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.799783848000004, 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:36:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:36:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:36:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:36:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:36:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:36:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:36:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:36:50.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:36:50.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:36:50.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:36:50.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:36:50.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:36:50.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:36:50.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:36:50.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:36:50.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:36:50.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:36:50.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:36:50.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:36:50.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:36:50.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:36:50.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:36:50.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:36:50.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:36:50.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:36:50.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:36:50.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:36:50.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.029 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:36:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.799448953999999, 2020-06-12T02:36:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:36:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:36:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.033 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:50.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:36:50.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:36:50.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:36:50.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:36:50.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:36:50.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:36:50.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:36:50.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:36:50.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:36:50.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:36:50.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:36:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:36:50.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:50.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:36:50.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:36:50.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:36:50.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:36:50.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:50.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:36:50.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:36:50.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:36:50.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:36:50.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:36:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:36:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:36:50.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:36:50.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:36:50.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:36:50.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:36:50.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:36:50.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.052 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.054 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:50.054 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:50.054 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.598573070999997, 2020-06-12T02:36:50.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:36:50.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.055 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.055 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.056 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.057 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.058 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:36:50.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.058 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:50.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:36:50.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:36:50.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:36:50.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:36:50.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:36:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:36:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:36:50.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:36:50.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:36:50.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:36:50.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:36:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:36:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:36:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:36:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:36:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:36:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:36:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:36:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.598413258000001, 2020-06-12T02:36:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:36:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:36:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:36:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:36:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:36:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:36:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:36:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:36:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:36:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:36:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:36:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:36:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:36:50.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:36:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:36:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:36:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:36:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:36:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:36:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:36:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.598332544999998, 2020-06-12T02:36:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:36:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:36:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:36:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:36:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:36:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:36:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:36:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:36:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:36:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:36:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:36:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:36:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:36:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:36:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:36:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:36:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:36:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.598085992000001, 2020-06-12T02:36:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:36:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:36:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:36:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:36:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:36:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:36:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:36:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:36:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:36:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:36:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:36:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:36:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:36:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:36:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.584735668999997, 2020-06-12T02:36:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:36:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:36:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:36:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:36:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:36:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:36:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:36:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:36:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:36:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:36:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:36:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:36:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:36:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:36:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:36:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:36:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:36:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.584549414999998, 2020-06-12T02:36:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:36:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:36:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:36:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:36:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:36:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:36:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:36:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:36:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:36:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:36:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:36:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:36:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:36:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:36:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:36:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:36:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:36:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:36:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.584348704, 2020-06-12T02:36:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:36:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:36:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:36:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:36:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:36:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:36:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:36:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:36:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:36:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:36:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:36:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:36:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:36:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:36:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:36:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:36:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:36:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:36:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.991860743, 2020-06-12T02:36:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:36:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:36:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:36:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:36:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:36:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:36:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:36:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:36:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:36:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:36:50.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:36:50.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:36:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:36:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:36:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:36:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:36:50.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:36:50.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.180 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.181 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:36:50.181 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:50.182 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.991436996000001, 2020-06-12T02:36:50.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:36:50.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:36:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:36:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:36:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:36:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:36:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:36:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:36:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:36:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:36:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:36:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:36:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:36:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:36:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:36:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:36:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:36:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:36:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.991283138, 2020-06-12T02:36:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:36:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:36:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:36:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:36:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:36:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:36:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:36:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:36:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:36:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:36:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:36:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:36:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:36:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:36:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:36:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:36:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.988552349999999, 2020-06-12T02:36:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:36:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:36:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:36:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:36:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:36:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:36:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:36:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:36:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:36:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:36:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:36:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:36:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:36:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:36:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:36:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:36:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.988132022999999, 2020-06-12T02:36:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:36:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:36:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:36:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:36:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:36:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:36:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:36:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:36:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:36:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:36:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:36:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:36:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:36:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:36:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:36:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:36:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.98803719, 2020-06-12T02:36:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:36:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:36:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:36:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:36:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:36:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:36:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:36:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:36:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:36:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:36:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:36:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:36:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:36:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:36:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:36:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:36:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:36:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:36:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:36:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:36:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:36:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:36:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.958257836000001, 2020-06-12T02:36:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:36:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:36:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:36:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:36:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:36:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:36:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:36:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:36:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:36:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:36:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:36:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:36:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:36:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:36:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:36:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:36:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:36:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:36:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:36:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:36:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:36:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:36:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.957792222999998, 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:36:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:36:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:36:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:36:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:36:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:36:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:36:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:36:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:36:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:36:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:36:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:36:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:36:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:36:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:36:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:36:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:36:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:36:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:36:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:36:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:36:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:36:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:36:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:36:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.957618287999999, 2020-06-12T02:36:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:36:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:36:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:36:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:36:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:36:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:36:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:36:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:36:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:36:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:36:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:36:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:36:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:36:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:36:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:36:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:36:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:36:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:36:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:36:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:36:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:36:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:36:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:36:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:36:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:36:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:36:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:36:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:36:50.310 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:36:50.311 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:36:50.313 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:50.306+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:50.314 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:50.413 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:50.410+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:50.431 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:50.432 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:50.432 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:50.432 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:50.442 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:50.471 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:50.458+0000 7f8852795700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:50.476 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:50.470+0000 7f8852795700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:50.514 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:50.509+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:50.552 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:50.552 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:50.553 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:50.553 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:50.561 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:50.615 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:50.610+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:50.713 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:50.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.576671818999998, 2020-06-12T02:36:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:50.715 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.716 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.717 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:50.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:50.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:50.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:50.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:50.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:50.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:50.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.733 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.565780438000004, 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:50.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:50.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:50.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:50.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.771 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:50.773 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.564648394000002, 2020-06-12T02:36:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.774 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:50.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:50.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:50.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:50.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:50.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:50.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:50.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:50.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:50.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:50.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:50.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.795 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.564393209000002, 2020-06-12T02:36:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.796 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:50.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:50.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:50.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:50.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:50.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:50.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:50.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:50.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:50.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:50.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:50.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:50.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:50.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:50.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:50.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:50.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:50.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:50.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:50.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.810 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:50.812 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:50.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.564234021999994, 2020-06-12T02:36:50.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:50.813 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.813 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:50.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.814 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:50.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:50.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:50.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:50.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:50.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:50.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:50.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:50.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:50.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:50.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:50.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:50.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:50.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:50.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:50.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:50.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:50.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:50.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:50.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:50.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.828 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.829 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:50.829 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:50.829 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.419911443999993, 2020-06-12T02:36:50.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:50.830 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.831 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:50.831 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.831 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.832 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:50.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.832 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:50.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:50.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:50.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:50.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:50.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:50.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:50.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:50.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:50.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:50.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:50.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:50.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:50.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:50.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:50.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:50.843 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.843 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.843 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.844 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:50.844 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:50.844 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.678841947000002, 2020-06-12T02:36:50.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:50.845 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.845 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.846 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:50.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.846 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:50.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:50.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:50.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:50.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:50.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:50.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:50.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:50.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:50.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:50.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:50.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:50.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:50.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:50.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:50.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:50.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.861 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:50.861 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:50.861 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.741139545999999, 2020-06-12T02:36:50.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:50.862 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.862 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.862 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.862 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.863 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.863 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:50.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.863 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:50.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:50.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:50.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:50.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:50.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:50.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:50.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:50.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:50.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:50.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:50.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:50.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:50.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:50.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:50.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:50.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:50.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:50.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:50.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:50.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:50.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:50.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:50.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:50.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:50.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:50.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:50.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.878 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.879 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:50.879 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:50.879 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.759263466, 2020-06-12T02:36:50.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.880 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:50.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.881 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:50.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:50.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:50.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:50.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:50.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:50.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:50.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:50.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:50.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:50.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:50.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:50.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:50.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:50.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:50.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:50.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:50.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.893 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:50.894 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:50.894 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.759070149999999, 2020-06-12T02:36:50.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.895 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:50.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.896 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:50.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:50.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:50.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:50.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:50.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:50.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:50.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:50.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:50.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:50.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:50.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:50.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:50.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.758921694999998, 2020-06-12T02:36:50.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:50.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.908 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:50.908 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.908 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.909 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.909 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:50.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.909 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:50.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:50.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:50.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:50.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:50.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:50.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:50.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:50.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:50.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:50.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:50.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:50.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:50.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:50.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:50.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:50.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:50.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:50.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:50.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:50.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.923 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.924 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:50.924 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:50.925 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.751488745000003, 2020-06-12T02:36:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:50.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:50.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:50.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:50.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:50.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:50.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:50.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:50.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:50.936 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.936 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.936 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.749080245000002, 2020-06-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:50.938 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.938 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:50.938 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:50.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:50.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:50.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:50.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:50.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:50.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:50.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:50.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:50.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:50.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:50.950 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:50.951 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.747053100000002, 2020-06-12T02:36:50.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:50.951 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.951 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:50.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:50.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:50.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:50.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:50.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:50.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:50.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:50.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:50.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:50.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:50.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:50.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:50.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:50.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:50.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:50.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:50.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:50.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:50.965 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:50.965 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.736003267000001, 2020-06-12T02:36:50.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:50.966 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.967 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:50.967 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:50.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:50.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:50.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:50.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:50.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:50.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:50.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:50.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:50.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:50.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:50.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:50.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:50.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:50.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:50.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:50.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:50.978 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.978 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.978 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.731790250000003, 2020-06-12T02:36:50.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:50.980 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:50.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.981 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:50.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:50.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:50.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:50.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:50.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:50.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:50.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:50.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:50.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:50.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:50.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:50.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:50.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:50.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:50.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:50.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:50.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:50.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:50.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:50.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:50.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:50.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:50.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:50.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:50.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:50.996 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.998 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:50.998 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:50.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:50.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:50.999 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:50.999 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:50.999 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.731607050999997, 2020-06-12T02:36:50.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:50.999 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:51.000 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:51.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:51.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:51.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:51.000 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:51.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.001 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:51.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:51.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:51.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:51.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:51.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:51.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:51.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:51.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:51.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:51.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:51.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:51.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:51.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:51.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:51.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:51.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:51.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:51.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:51.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:51.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:51.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:51.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:51.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:51.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:51.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:51.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:51.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:51.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:51.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.016 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:51.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.274689006999999, 2020-06-12T02:36:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:51.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:51.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:51.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:51.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:51.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:51.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:51.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:51.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:51.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:51.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:51.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:51.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:51.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:51.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:51.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:51.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:51.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:51.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:51.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:51.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:51.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:51.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:51.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:51.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:36:51.029 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:51.030 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.744227410000001, 2020-06-12T02:36:51.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:36:51.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:51.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:51.030 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:51.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:51.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:51.031 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:36:51.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.031 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:51.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:51.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:51.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:51.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:51.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:36:51.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:36:51.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:51.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:36:51.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:36:51.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:36:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:36:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:36:51.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:36:51.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:51.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:36:51.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:36:51.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:51.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:36:51.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:36:51.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:36:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:36:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:36:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:36:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:51.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:36:51.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:36:51.043 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.044 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 20.743968291000002, 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:51.045 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:51.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:51.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:51.046 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:36:51.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:51.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:51.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:51.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:51.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:51.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:51.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:36:51.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:51.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:36:51.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:36:51.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:51.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:36:51.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:36:51.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:51.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:36:51.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:36:51.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:51.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:36:51.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:36:51.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:51.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:36:51.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:36:51.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:36:51.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:36:51.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:51.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:36:51.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:36:51.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:51.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:36:51.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:36:51.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.059 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:51.060 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.060 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:51.060 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:51.061 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:51.061 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:51.063 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:36:51.064 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:51.057+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:51.064 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:51.162 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:51.154+0000 7f67d21b9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:51.163 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:51.158+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:51.168 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:51.162+0000 7f67d21b9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:51.204 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:51.222 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:51.223 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:51.233 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:51.244 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:51.264 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:51.262+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:51.317 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:51.342 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:51.342 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.343 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:51.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:51.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.343 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.344 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:51.344 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:51.345 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:51.346 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:51.347 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:51.353 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:51.400 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:51.393+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:51.462 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:51.462 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:51.465 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:51.457+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:51.472 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:51.567 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:51.561+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:51.625 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:51.626 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:51.635 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:51.678 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:51.673+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:51.768 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:51.766+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:51.787 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:51.788 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:51.798 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:51.870 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:51.866+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:51.904 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:51.905 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:51.915 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:51.971 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:51.966+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:52.023 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.023 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.028 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:52.075 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:52.069+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:52.140 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.140 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.141 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:52.174 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:52.170+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:52.205 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:52.281 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:52.273+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:52.290 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.290 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.306 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:52.324 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:52.314+0000 7f0f196eb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:52.330 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:52.326+0000 7f0f13fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:52.397 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:52.378+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:52.416 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.417 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.422 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:52.482 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:52.490 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2020-06-12T02:36:51.947376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7703960,"kb_used_data":363872,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652898920,"statfs":{"total":676457349120,"available":668568494080,"internally_reserved":7516192768,"allocated":372604928,"data_stored":439032981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.946562"},"pg_stats":[{"pgid":"1.f","version":"84'68","reported_seq":"305","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.010345+0000","last_change":"2020-06-12T02:36:44.103918+0000","last_active":"2020-06-12T02:36:45.010345+0000","last_peered":"2020-06-12T02:36:45.010345+0000","last_clean":"2020-06-12T02:36:45.010345+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:45.010345+0000","last_undegraded":"2020-06-12T02:36:45.010345+0000","last_fullsized":"2020-06-12T02:36:45.010345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'68","last_scrub_stamp":"2020-06-12T02:36:44.103723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.103723+0000","log_size":68,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8886777,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":21437,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.e","version":"81'90","reported_seq":"66","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:44.005825+0000","last_change":"2020-06-12T02:36:37.963853+0000","last_active":"2020-06-12T02:36:44.005825+0000","last_peered":"2020-06-12T02:36:44.005825+0000","last_clean":"2020-06-12T02:36:44.005825+0000","last_became_active":"2020-06-12T02:36:31.982116+0000","last_became_peered":"2020-06-12T02:36:31.982116+0000","last_unstale":"2020-06-12T02:36:44.005825+0000","last_undegraded":"2020-06-12T02:36:44.005825+0000","last_fullsized":"2020-06-12T02:36:44.005825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'86","last_scrub_stamp":"2020-06-12T02:36:28.028555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:28.028555+0000","log_size":90,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":22386693,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.d","version":"0'0","reported_seq":"6","reported_epoch":"97","state":"down","last_fresh":"2020-06-12T02:36:45.009495+0000","last_change":"2020-06-12T02:36:40.980461+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-06-12T02:36:45.009495+0000","last_undegraded":"2020-06-12T02:36:45.009495+0000","last_fullsized":"2020-06-12T02:36:45.009495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.c","version":"88'35","reported_seq":"272","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.008069+0000","last_change":"2020-06-12T02:36:44.869546+0000","last_active":"2020-06-12T02:36:45.008069+0000","last_peered":"2020-06-12T02:36:45.008069+0000","last_clean":"2020-06-12T02:36:45.008069+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:45.008069+0000","last_undegraded":"2020-06-12T02:36:45.008069+0000","last_fullsized":"2020-06-12T02:36:45.008069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'35","last_scrub_stamp":"2020-06-12T02:36:44.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.869250+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3762777,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12612,"num_write":15,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.b","version":"94'73","reported_seq":"348","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:43.999636+0000","last_change":"2020-06-12T02:36:42.082396+0000","last_active":"2020-06-12T02:36:43.999636+0000","last_peered":"2020-06-12T02:36:43.999636+0000","last_clean":"2020-06-12T02:36:43.999636+0000","last_became_active":"2020-06-12T02:36:41.995264+0000","last_became_peered":"2020-06-12T02:36:41.995264+0000","last_unstale":"2020-06-12T02:36:43.999636+0000","last_undegraded":"2020-06-12T02:36:43.999636+0000","last_fullsized":"2020-06-12T02:36:43.999636+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8336206,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":30,"num_read_kb":34289,"num_write":36,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8336206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.a","version":"85'21","reported_seq":"75","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:44.005137+0000","last_change":"2020-06-12T02:36:42.028638+0000","last_active":"2020-06-12T02:36:44.005137+0000","last_peered":"2020-06-12T02:36:44.005137+0000","last_clean":"2020-06-12T02:36:44.005137+0000","last_became_active":"2020-06-12T02:36:41.995085+0000","last_became_peered":"2020-06-12T02:36:41.995085+0000","last_unstale":"2020-06-12T02:36:44.005137+0000","last_undegraded":"2020-06-12T02:36:44.005137+0000","last_fullsized":"2020-06-12T02:36:44.005137+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7159683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.9","version":"88'92","reported_seq":"71","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:44.004898+0000","last_change":"2020-06-12T02:36:37.964431+0000","last_active":"2020-06-12T02:36:44.004898+0000","last_peered":"2020-06-12T02:36:44.004898+0000","last_clean":"2020-06-12T02:36:44.004898+0000","last_became_active":"2020-06-12T02:36:31.985154+0000","last_became_peered":"2020-06-12T02:36:31.985154+0000","last_unstale":"2020-06-12T02:36:44.004898+0000","last_undegraded":"2020-06-12T02:36:44.004898+0000","last_fullsized":"2020-06-12T02:36:44.004898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14034149,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":42,"num_write_kb":15786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":23143041,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.8","version":"88'85","reported_seq":"75","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:44.004985+0000","last_change":"2020-06-12T02:36:41.392685+0000","last_active":"2020-06-12T02:36:44.004985+0000","last_peered":"2020-06-12T02:36:44.004985+0000","last_clean":"2020-06-12T02:36:44.004985+0000","last_became_active":"2020-06-12T02:36:31.984707+0000","last_became_peered":"2020-06-12T02:36:31.984707+0000","last_unstale":"2020-06-12T02:36:44.004985+0000","last_undegraded":"2020-06-12T02:36:44.004985+0000","last_fullsized":"2020-06-12T02:36:44.004985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'85","last_scrub_stamp":"2020-06-12T02:36:41.392546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.392546+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13495005,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":8037,"num_write":35,"num_write_kb":14351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":25932970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.7","version":"86'170","reported_seq":"393","reported_epoch":"96","state":"down","last_fresh":"2020-06-12T02:36:44.004681+0000","last_change":"2020-06-12T02:36:40.985157+0000","last_active":"2020-06-12T02:36:34.949384+0000","last_peered":"2020-06-12T02:36:33.332966+0000","last_clean":"2020-06-12T02:36:28.212298+0000","last_became_active":"2020-06-12T02:36:33.293059+0000","last_became_peered":"2020-06-12T02:36:33.293059+0000","last_unstale":"2020-06-12T02:36:44.004681+0000","last_undegraded":"2020-06-12T02:36:44.004681+0000","last_fullsized":"2020-06-12T02:36:44.004681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17595493,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":48924,"num_write":75,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"91'81","reported_seq":"316","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.010166+0000","last_change":"2020-06-12T02:36:37.966550+0000","last_active":"2020-06-12T02:36:45.010166+0000","last_peered":"2020-06-12T02:36:45.010166+0000","last_clean":"2020-06-12T02:36:45.010166+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:45.010166+0000","last_undegraded":"2020-06-12T02:36:45.010166+0000","last_fullsized":"2020-06-12T02:36:45.010166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'73","last_scrub_stamp":"2020-06-12T02:36:30.051303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:30.051303+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9847642,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":32,"num_read_kb":28345,"num_write":33,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.1","version":"91'48","reported_seq":"287","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.009811+0000","last_change":"2020-06-12T02:36:37.967042+0000","last_active":"2020-06-12T02:36:45.009811+0000","last_peered":"2020-06-12T02:36:45.009811+0000","last_clean":"2020-06-12T02:36:45.009811+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:45.009811+0000","last_undegraded":"2020-06-12T02:36:45.009811+0000","last_fullsized":"2020-06-12T02:36:45.009811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"73","reported_epoch":"96","state":"active+clean","last_fresh":"2020-06-12T02:36:44.004704+0000","last_change":"2020-06-12T02:36:42.028986+0000","last_active":"2020-06-12T02:36:44.004704+0000","last_peered":"2020-06-12T02:36:44.004704+0000","last_clean":"2020-06-12T02:36:44.004704+0000","last_became_active":"2020-06-12T02:36:42.026509+0000","last_became_peered":"2020-06-12T02:36:42.026509+0000","last_unstale":"2020-06-12T02:36:44.004704+0000","last_undegraded":"2020-06-12T02:36:44.004704+0000","last_fullsized":"2020-06-12T02:36:44.004704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.2","version":"88'214","reported_seq":"553","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.004677+0000","last_change":"2020-06-12T02:36:41.101523+0000","last_active":"2020-06-12T02:36:45.004677+0000","last_peered":"2020-06-12T02:36:45.004677+0000","last_clean":"2020-06-12T02:36:45.004677+0000","last_became_active":"2020-06-12T02:36:34.964571+0000","last_became_peered":"2020-06-12T02:36:34.964571+0000","last_unstale":"2020-06-12T02:36:45.004677+0000","last_undegraded":"2020-06-12T02:36:45.004677+0000","last_fullsized":"2020-06-12T02:36:45.004677+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'214","last_scrub_stamp":"2020-06-12T02:36:41.101376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.101376+0000","log_size":214,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22113349,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":39,"num_read_kb":27696,"num_write":84,"num_write_kb":29495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":56823939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.3","version":"86'148","reported_seq":"441","reported_epoch":"96","state":"down","last_fresh":"2020-06-12T02:36:44.000018+0000","last_change":"2020-06-12T02:36:40.980118+0000","last_active":"2020-06-12T02:36:34.951718+0000","last_peered":"2020-06-12T02:36:34.003732+0000","last_clean":"2020-06-12T02:36:29.990455+0000","last_became_active":"2020-06-12T02:36:33.289911+0000","last_became_peered":"2020-06-12T02:36:33.289911+0000","last_unstale":"2020-06-12T02:36:44.000018+0000","last_undegraded":"2020-06-12T02:36:44.000018+0000","last_fullsized":"2020-06-12T02:36:44.000018+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":148,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29701358,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":56,"num_read_kb":56070,"num_write":62,"num_write_kb":23647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":48151560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"88'199","reported_seq":"437","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.216811+0000","last_change":"2020-06-12T02:36:40.811641+0000","last_active":"2020-06-12T02:36:45.216811+0000","last_peered":"2020-06-12T02:36:45.216811+0000","last_clean":"2020-06-12T02:36:45.216811+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:45.216811+0000","last_undegraded":"2020-06-12T02:36:45.216811+0000","last_fullsized":"2020-06-12T02:36:45.216811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'199","last_scrub_stamp":"2020-06-12T02:36:40.811411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:40.811411+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26861505,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":69,"num_read_kb":85329,"num_write":84,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.5","version":"97'197","reported_seq":"428","reported_epoch":"97","state":"active+clean","last_fresh":"2020-06-12T02:36:45.025236+0000","last_change":"2020-06-12T02:36:45.025845+0000","last_active":"2020-06-12T02:36:45.025236+0000","last_peered":"2020-06-12T02:36:45.025236+0000","last_clean":"2020-06-12T02:36:45.025236+0000","last_became_active":"2020-06-12T02:36:45.011966+0000","last_became_peered":"2020-06-12T02:36:45.011966+0000","last_unstale":"2020-06-12T02:36:45.025236+0000","last_undegraded":"2020-06-12T02:36:45.025236+0000","last_fullsized":"2020-06-12T02:36:45.025236+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":197,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28971752,"num_objects":13,"num_object_clones":8,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":47,"num_read_kb":38628,"num_write":85,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3],"acting":[4,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421171200,"data_stored":510935040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095384,"kb_used_data":46800,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276456,"statfs":{"total":96636764160,"available":95515090944,"internally_reserved":1073741824,"allocated":47923200,"data_stored":60139128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.6890000000000001},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":3.4089999999999998}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":3.597},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.544}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.464},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":1.827}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.7679999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.994},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.0310000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":3.2080000000000002},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.8069999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":2.492},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.988}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088440,"kb_used_data":39856,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283400,"statfs":{"total":96636764160,"available":95522201600,"internally_reserved":1073741824,"allocated":40812544,"data_stored":55670392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":2.2599999999999998}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.1930000000000001},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.762}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.919}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.4089999999999998},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":3.0329999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.125},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.7749999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.9750000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":2.6259999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":2.7280000000000002},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.302}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143572,"kb_used_data":94988,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228268,"statfs":{"total":96636764160,"available":95465746432,"internally_reserved":1073741824,"allocated":97267712,"data_stored":114659559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":1.613},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.74}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.1890000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":2.0870000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1899999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.093}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":2.3650000000000002},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":1.22}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.0310000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.4319999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.6659999999999999},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.605}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.2869999999999999},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.8769999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137576,"kb_used_data":88992,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234264,"statfs":{"total":96636764160,"available":95471886336,"internally_reserved":1073741824,"allocated":91127808,"data_stored":91132135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.476},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":2.1840000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.625}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":1.528},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":1.7130000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":2.3780000000000001},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":2.6339999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":2.7010000000000001},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":2.927}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":2.8879999999999999},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":3.2949999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":3.1880000000000002},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":2.3359999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071412,"kb_used_data":22828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300428,"statfs":{"total":96636764160,"available":95539638272,"internally_reserved":1073741824,"allocated":23375872,"data_stored":27693287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":2.1520000000000001},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.6140000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.5329999999999999},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.0780000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.024},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.2280000000000002}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":1.3009999999999999},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.6850000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":2.4369999999999998},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":1.8069999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.5670000000000002},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":2.6440000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":1.9750000000000001},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.0150000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094164,"kb_used_data":45580,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277676,"statfs":{"total":96636764160,"available":95516340224,"internally_reserved":1073741824,"allocated":46673920,"data_stored":56440440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.5349999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.9059999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.472}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.0710000000000002},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.4450000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.7879999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":2.1349999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":1.702},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.488}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.6960000000000002},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":2.4209999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":2.8599999999999999},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":3.0009999999999999}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073412,"kb_used_data":24828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298428,"statfs":{"total":96636764160,"available":95537590272,"internally_reserved":1073741824,"allocated":25423872,"data_stored":33298040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.3140000000000001},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.262}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.9370000000000001},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":2.1619999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.111},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.2959999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.633}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.8959999999999999},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":1.9790000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.2229999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":2.4180000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5680000000000001},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.6960000000000002}]}]}]}} 2020-06-12T02:36:52.491 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:52.493 INFO:tasks.thrashosds.thrasher:not all PGs are active or peered 2020-06-12T02:36:52.494 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:52.481+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:52.584 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:52.581+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:52.584 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.585 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.598 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:52.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:52.681+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:52.702 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.702 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.712 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:52.790 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:52.782+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:52.823 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.823 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:52.840 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:52.886 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:52.881+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:52.988 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:52.981+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:52.995 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:52.995 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:53.005 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:53.067 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:36:53.088 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:53.081+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:53.129 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:53.129 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:53.139 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:53.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:53.174+0000 7f02716a1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:53.191 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:53.186+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:53.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:53.186+0000 7f026bfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:53.263 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:53.263 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:53.274 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:53.293 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:53.285+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:53.348 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:53.393 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:53.385+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:53.414 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:53.414 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:53.423 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:53.462 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:53.454+0000 7fda01693700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:53.466 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:53.462+0000 7fda01693700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:53.495 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:53.490+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:53.495 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:53.515 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:53.525 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:53.526 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:53.534 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:53.539 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:53.563 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:53.586 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:53.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:53.589+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:53.611 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:53.638 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:53.638 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.638 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.639 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:53.639 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:53.639 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.639 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.641 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.641 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.641 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:53.643 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:53.643 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:53.650 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:53.650 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:53.651 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:53.651 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:53.661 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:53.702 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:53.697+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:53.798 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:53.794+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:53.817 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:53.817 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:53.818 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:53.818 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:53.819 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:53.899 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:53.893+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:53.953 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:53.956 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:53.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.813482449000006, 2020-06-12T02:36:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:36:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:53.959 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:53.960 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:53.961 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:36:53.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.961 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:53.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:53.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:36:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:36:53.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:36:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:36:53.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:36:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:36:53.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:36:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:36:53.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:36:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:36:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:53.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:36:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:36:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:36:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:36:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:36:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:36:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:36:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:36:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:36:53.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:36:53.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:53.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:36:53.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:36:53.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:53.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:36:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:36:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:53.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.995 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:36:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.802591067999998, 2020-06-12T02:36:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:36:53.996 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:53.997 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:36:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:53.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:53.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:36:54.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:36:54.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:36:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:36:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:36:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:36:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:36:54.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:36:54.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:36:54.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:36:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:36:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:36:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:36:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:36:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:36:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:36:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:36:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:36:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:36:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:36:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:54.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.801459023999996, 2020-06-12T02:36:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:36:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:36:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:36:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:36:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:36:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:36:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:36:54.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:36:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:36:54.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:36:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:36:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:36:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:36:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:36:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:36:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:36:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:36:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:36:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:36:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:36:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.801203838999996, 2020-06-12T02:36:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:36:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:36:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:36:54.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:36:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:36:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:36:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:36:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:36:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:36:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:36:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:36:54.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:36:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:36:54.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:36:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:36:54.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:36:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:36:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:36:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:36:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.043 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:54.044 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.801044652000002, 2020-06-12T02:36:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:36:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.045 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:36:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:36:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:36:54.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:36:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:36:54.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:36:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:36:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:36:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:36:54.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:36:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:36:54.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:36:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:36:54.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:36:54.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:36:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:36:54.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:36:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:36:54.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:36:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:36:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 77.656722074000001, 2020-06-12T02:36:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:36:54.059 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.060 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:36:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:36:54.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:36:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:36:54.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:36:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:36:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:36:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:36:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:36:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:36:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:36:54.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:36:54.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:36:54.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:36:54.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:36:54.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:36:54.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:36:54.073 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.073 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.074 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:36:54.074 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:54.075 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 53.915652577000003, 2020-06-12T02:36:54.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:36:54.075 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.075 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:36:54.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:54.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:36:54.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:36:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:36:54.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:36:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:36:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:36:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:36:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:36:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:36:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:36:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:36:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:36:54.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:36:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:36:54.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:36:54.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:36:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:36:54.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:36:54.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:36:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:36:54.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:36:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:36:54.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:36:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:36:54.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:36:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:36:54.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.977950176, 2020-06-12T02:36:54.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.098 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:36:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:36:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:36:54.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:36:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:36:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:36:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:36:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:36:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:36:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:36:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:36:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:54.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:36:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:36:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:36:54.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:36:54.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:36:54.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:36:54.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:36:54.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:36:54.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:36:54.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:36:54.116 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.116 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.116 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.117 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:54.117 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:54.117 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.996074096000001, 2020-06-12T02:36:54.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:36:54.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.118 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.118 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.118 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.118 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:54.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:36:54.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:36:54.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:36:54.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:36:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:36:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:36:54.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:36:54.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:36:54.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:36:54.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:36:54.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:54.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:36:54.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:36:54.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:36:54.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:36:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:36:54.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:36:54.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.130 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.131 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:54.131 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:54.131 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.99588078, 2020-06-12T02:36:54.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:36:54.132 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.132 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.132 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.132 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.132 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:54.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:36:54.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:36:54.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:36:54.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:36:54.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:36:54.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:36:54.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:36:54.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:36:54.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:36:54.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:36:54.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:36:54.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:36:54.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:54.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:36:54.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:36:54.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:36:54.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:36:54.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:36:54.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:36:54.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:36:54.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:36:54.147 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.147 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.147 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.148 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:36:54.148 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:54.148 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.995732324999999, 2020-06-12T02:36:54.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:36:54.149 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.149 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.149 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.150 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.150 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.150 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:36:54.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.151 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:54.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:36:54.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:36:54.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:36:54.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:36:54.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:36:54.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:36:54.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:36:54.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:36:54.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:36:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:36:54.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:36:54.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:36:54.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:54.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:36:54.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:36:54.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:36:54.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:36:54.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:36:54.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:36:54.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:36:54.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:36:54.164 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.164 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.165 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:36:54.166 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:54.166 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.988299374999997, 2020-06-12T02:36:54.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:36:54.166 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.166 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.167 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:54.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:54.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:54.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:36:54.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:36:54.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:36:54.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:36:54.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:36:54.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:36:54.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:36:54.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:36:54.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:36:54.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:36:54.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.178 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:54.179 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.985890875000003, 2020-06-12T02:36:54.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:36:54.181 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.181 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.181 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:54.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:36:54.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:36:54.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:36:54.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:36:54.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:36:54.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:36:54.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:36:54.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:36:54.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:36:54.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:36:54.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:36:54.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:36:54.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:36:54.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:36:54.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:36:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:36:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:36:54.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:36:54.193 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.193 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.193 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.194 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:36:54.195 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:54.195 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.983863730000003, 2020-06-12T02:36:54.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:36:54.195 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.195 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.196 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:54.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:36:54.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:36:54.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:36:54.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:36:54.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:36:54.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:36:54.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:36:54.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:36:54.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:36:54.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:36:54.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:36:54.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:36:54.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:36:54.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:36:54.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:36:54.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:36:54.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:36:54.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:36:54.209 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.209 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.210 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.211 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:36:54.211 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:54.211 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 47.972813897000002, 2020-06-12T02:36:54.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:36:54.212 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.212 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.212 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:54.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:36:54.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:36:54.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:36:54.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:36:54.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:36:54.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:36:54.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:36:54.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:36:54.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:36:54.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:36:54.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:36:54.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:36:54.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:36:54.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:36:54.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:36:54.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:36:54.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:36:54.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:36:54.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.223 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.224 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:54.224 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:54.224 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.968600879999997, 2020-06-12T02:36:54.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:36:54.225 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.225 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.225 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.226 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.226 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.226 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:36:54.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.226 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:54.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:36:54.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:36:54.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:36:54.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:36:54.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:36:54.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:36:54.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:36:54.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:36:54.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:36:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:36:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:36:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:36:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:36:54.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:36:54.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:36:54.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:36:54.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:36:54.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:36:54.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:36:54.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:36:54.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:36:54.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:36:54.242 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.242 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.242 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.243 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:54.243 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:54.243 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.968417680999998, 2020-06-12T02:36:54.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:36:54.243 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.244 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.244 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:36:54.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.245 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:54.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:36:54.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:36:54.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:36:54.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:36:54.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:36:54.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:36:54.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:36:54.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:36:54.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:36:54.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:36:54.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:54.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:36:54.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:36:54.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:36:54.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:36:54.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:36:54.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:36:54.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:36:54.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:36:54.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:36:54.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:36:54.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.258 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.258 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:36:54.259 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:54.259 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.511499637, 2020-06-12T02:36:54.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:36:54.259 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.259 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:36:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:36:54.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:36:54.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:36:54.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:36:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:36:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:36:54.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:36:54.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:36:54.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:36:54.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:36:54.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:36:54.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.270 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:36:54.270 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:54.270 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.981038040000001, 2020-06-12T02:36:54.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:36:54.271 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.271 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.271 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.271 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:36:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:54.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:36:54.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:36:54.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:36:54.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:36:54.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:36:54.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:36:54.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:36:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:36:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:36:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:36:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:36:54.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:36:54.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:36:54.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:36:54.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:36:54.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:36:54.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:36:54.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:36:54.289 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.289 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.289 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.290 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:36:54.290 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:54.290 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 23.980778920999999, 2020-06-12T02:36:54.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:36:54.291 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.291 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.291 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.291 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.292 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.292 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:36:54.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.292 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:54.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:36:54.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:36:54.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:36:54.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:36:54.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:36:54.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:36:54.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:36:54.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:36:54.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:36:54.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:36:54.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:36:54.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:36:54.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:54.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:36:54.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:36:54.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:36:54.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:36:54.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:36:54.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:36:54.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:36:54.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:36:54.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:36:54.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:36:54.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:36:54.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:36:54.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.308 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:54.309 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:36:54.310 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:54.306+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:54.311 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:54.410 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:54.405+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:54.469 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:54.469 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:54.470 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:54.470 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:54.479 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:54.511 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:54.506+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:54.613 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:54.605+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:54.635 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:54.636 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:54.636 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:54.645 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:54.746 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:54.741+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:54.800 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:54.801 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 83.651451764000001, 2020-06-12T02:36:54.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:54.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:54.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:54.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:54.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:54.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:54.815 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.504938253000006, 2020-06-12T02:36:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:54.817 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:54.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:54.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:54.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:54.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:54.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.837 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.827389578999998, 2020-06-12T02:36:54.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.839 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.840 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:54.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:54.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:54.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:54.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:54.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:54.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:54.856 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.826625651000001, 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:54.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:54.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:54.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:54.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:54.876 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.603820595999998, 2020-06-12T02:36:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.878 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:54.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:54.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:54.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:54.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:54.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:54.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:54.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:54.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:54.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:54.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.901 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.595534309000001, 2020-06-12T02:36:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:54.902 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.903 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.588505065, 2020-06-12T02:36:54.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.920 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:54.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:54.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:54.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:54.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.588367613999999, 2020-06-12T02:36:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:54.935 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:54.936 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.937 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.787579874999999, 2020-06-12T02:36:54.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.952 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:54.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:54.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:54.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:54.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:54.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:54.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:54.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:54.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:54.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:54.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:54.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:54.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:54.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:54.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:54.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:54.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:54.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:54.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.968 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.969 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:54.969 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:54.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.787433260999997, 2020-06-12T02:36:54.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:54.969 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:54.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.971 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:54.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:54.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:54.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:54.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:54.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:54.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:54.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:54.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:54.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:54.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:54.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:54.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:54.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:54.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:54.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:54.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:54.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:54.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:54.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:54.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:54.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:54.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:54.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:54.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.985 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:54.986 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:54.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.986 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:54.986 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:54.987 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.831420387000001, 2020-06-12T02:36:54.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:54.987 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:54.987 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:54.987 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:54.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:54.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:54.988 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:54.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.989 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:54.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:54.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:54.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:54.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:54.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:54.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:54.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:54.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:54.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:54.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:54.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:54.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:54.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:54.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:54.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:54.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:54.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:54.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:54.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:54.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:54.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:54.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:54.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:54.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:54.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:54.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:54.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:55.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:55.000 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.000 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.001 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.001 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.001 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.825688874000001, 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.002 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.003 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:55.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.003 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:55.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:55.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:55.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:55.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:55.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:55.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:55.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:55.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:55.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:55.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.016 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.016 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:55.016 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.825195358000002, 2020-06-12T02:36:55.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:55.017 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.018 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.019 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:55.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.019 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:55.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:55.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:55.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:55.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:55.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:55.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:55.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:55.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:55.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:55.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:55.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:55.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.031 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.032 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:55.032 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:55.032 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.825101351000001, 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.034 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:55.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.034 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:55.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:55.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:55.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:55.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:55.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:55.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:55.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:55.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:55.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:55.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:55.044 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.044 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.045 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.045 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:55.045 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.786940322, 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:55.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:55.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:55.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:55.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:55.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:55.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:55.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:55.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:55.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:55.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:55.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:55.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:55.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:55.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:55.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:55.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:55.057 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.058 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.059 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:55.059 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:55.059 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.746143328999999, 2020-06-12T02:36:55.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:55.059 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.060 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.060 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:55.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:55.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:55.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:55.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:55.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:55.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:55.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:55.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:55.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:55.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:55.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.070 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:55.071 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:55.071 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.745901263, 2020-06-12T02:36:55.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:55.071 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.071 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.072 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:55.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.073 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:55.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:55.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:55.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:55.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:55.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:55.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:55.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:55.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:55.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:55.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:55.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:55.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:55.081 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.081 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.082 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:55.082 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.745691571999998, 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.084 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.084 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:55.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.084 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:55.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:55.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:55.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:55.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:55.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:55.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:55.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:55.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:55.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:55.093 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.094 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.094 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.094 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:55.095 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:55.095 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 33.730157411, 2020-06-12T02:36:55.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:55.095 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.098 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.099 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.099 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:55.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.099 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:55.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:55.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:55.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:55.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:55.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:55.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:55.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:55.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:55.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:55.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:55.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.109 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:36:55.109 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:55.109 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 24.832097377, 2020-06-12T02:36:55.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:36:55.110 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.110 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.110 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.111 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.111 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.111 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:36:55.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.111 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:55.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:36:55.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:36:55.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:36:55.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:36:55.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:36:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:36:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:36:55.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:36:55.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:36:55.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:36:55.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.120 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.121 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.121 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:55.122 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:55.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:55.117+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:55.223 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:55.217+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:55.287 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:55.288 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:55.288 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:55.288 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:55.297 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:55.330 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:55.322+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:55.427 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:55.422+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:55.450 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:55.450 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:55.451 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:55.451 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:55.451 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:55.467 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:55.528 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:55.522+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:55.577 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.579 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:55.579 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:55.580 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.450440313000001, 2020-06-12T02:36:55.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:36:55.580 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.580 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.581 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:36:55.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:36:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:36:55.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:36:55.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:36:55.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:36:55.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:36:55.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:36:55.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:36:55.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:36:55.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:55.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:36:55.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:36:55.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:36:55.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:36:55.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:36:55.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:36:55.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:36:55.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:36:55.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:36:55.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:36:55.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.597 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:55.597 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:55.597 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.450301377000002, 2020-06-12T02:36:55.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:36:55.598 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.598 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:55.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:55.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:36:55.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:36:55.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:36:55.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:36:55.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:36:55.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:36:55.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:36:55.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:36:55.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:36:55.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:55.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:36:55.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:36:55.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:36:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:36:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:36:55.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:36:55.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:36:55.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:36:55.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:36:55.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:36:55.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.616 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.450165538999997, 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.618 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:36:55.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.619 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:55.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:55.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:36:55.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:36:55.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:36:55.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:36:55.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:36:55.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:36:55.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:36:55.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:36:55.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:36:55.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:36:55.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:36:55.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:36:55.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:36:55.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:36:55.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:36:55.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:36:55.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:36:55.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:36:55.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:36:55.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:36:55.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:36:55.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:36:55.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:36:55.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.634 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:55.635 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.426500691000001, 2020-06-12T02:36:55.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:36:55.636 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.636 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.636 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:55.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:55.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:36:55.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:36:55.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:36:55.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:36:55.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:36:55.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:36:55.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:36:55.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:36:55.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:36:55.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:36:55.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:36:55.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:36:55.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:36:55.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:36:55.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:36:55.646 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.646 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.646 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.648 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:36:55.648 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:55.648 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.379056781000003, 2020-06-12T02:36:55.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:36:55.649 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.649 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.649 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.651 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:36:55.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.651 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:55.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:55.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:36:55.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:36:55.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:36:55.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:36:55.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:36:55.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:36:55.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:36:55.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:36:55.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:36:55.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:55.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:36:55.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:36:55.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:36:55.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:36:55.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:36:55.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:36:55.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:36:55.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:36:55.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:36:55.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:36:55.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.665 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.666 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.666 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:55.666 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:55.667 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.635319738000007, 2020-06-12T02:36:55.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:36:55.667 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.667 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.667 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:55.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:55.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:36:55.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:36:55.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:36:55.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:36:55.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:36:55.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:36:55.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:36:55.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:36:55.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:36:55.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:36:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:36:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.678 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:55.678 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:55.678 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.634346367999996, 2020-06-12T02:36:55.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:36:55.679 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.679 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.679 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:55.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:55.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:36:55.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:36:55.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:36:55.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:36:55.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:36:55.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:36:55.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:36:55.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:36:55.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:36:55.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:36:55.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:36:55.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:36:55.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:36:55.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:36:55.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:36:55.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:36:55.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:36:55.691 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.692 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.692 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.693 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:55.693 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.633137247999997, 2020-06-12T02:36:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:36:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.694 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:55.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:36:55.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:36:55.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:36:55.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:36:55.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:36:55.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:36:55.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:36:55.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:36:55.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:36:55.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:36:55.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:36:55.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:36:55.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:36:55.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.705 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:55.705 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:55.705 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.631874263, 2020-06-12T02:36:55.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:36:55.706 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.706 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.706 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:55.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:55.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:36:55.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:36:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:36:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:36:55.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:36:55.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:36:55.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:36:55.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:36:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:36:55.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:36:55.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:36:55.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:36:55.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:36:55.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:36:55.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:36:55.719 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.719 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.720 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.720 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:36:55.721 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:55.721 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.620416136000003, 2020-06-12T02:36:55.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:36:55.721 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.721 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.722 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:55.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:36:55.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:36:55.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:36:55.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:36:55.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:36:55.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:36:55.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:36:55.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:36:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:36:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:36:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:36:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:36:55.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:36:55.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:36:55.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:36:55.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.732 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.734 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:36:55.734 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:55.734 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.617415096000002, 2020-06-12T02:36:55.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:36:55.735 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.735 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.736 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:55.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:55.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:36:55.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:36:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:36:55.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:36:55.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:36:55.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:36:55.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:36:55.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:36:55.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:36:55.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:36:55.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:36:55.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:36:55.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:36:55.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:36:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:36:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:36:55.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:36:55.753 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.753 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.753 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.754 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.755 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:55.755 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.594589096999997, 2020-06-12T02:36:55.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:36:55.756 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.756 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.756 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.757 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.757 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.757 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:36:55.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.758 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:55.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:55.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:36:55.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:36:55.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:36:55.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:36:55.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:36:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:36:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:36:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:36:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:36:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:36:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:36:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:36:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:36:55.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:36:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:36:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:36:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:36:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:36:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:36:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.594443705000003, 2020-06-12T02:36:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:36:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:36:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:36:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:36:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:36:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:36:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:36:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:36:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:36:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:36:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:36:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:36:55.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:36:55.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:36:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:36:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:36:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:36:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:36:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:36:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:36:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:36:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:36:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:36:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.805 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.805 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:55.805 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.562302426000002, 2020-06-12T02:36:55.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:36:55.806 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.806 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.806 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.807 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.807 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.807 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:36:55.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.808 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:55.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:55.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:36:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:36:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:36:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:36:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:36:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:36:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:36:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:36:55.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:36:55.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:36:55.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:36:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:36:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:36:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:36:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:36:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:36:55.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:36:55.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:36:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:36:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:36:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:36:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.557175790999999, 2020-06-12T02:36:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:36:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:36:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:36:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:36:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:36:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:36:55.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:36:55.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:36:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:36:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:36:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:36:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:36:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:36:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:36:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:36:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:36:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:36:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.556796781000003, 2020-06-12T02:36:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:36:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:36:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:36:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:36:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:36:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:36:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:36:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:36:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:36:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:36:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:36:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:36:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:36:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:36:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:36:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:36:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:36:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.556579325999998, 2020-06-12T02:36:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:36:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:36:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:36:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:36:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:36:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:36:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:36:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:36:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:36:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:36:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:36:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:36:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:36:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:36:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.192637081000001, 2020-06-12T02:36:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:36:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:36:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:36:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:36:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:36:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:36:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:36:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:36:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:36:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:36:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:36:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:36:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:36:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:36:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.603584294000001, 2020-06-12T02:36:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:36:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:36:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:36:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:36:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:36:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:36:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:36:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:36:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:36:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:36:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:36:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 35.600550720999998, 2020-06-12T02:36:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:36:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:36:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:36:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:36:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:36:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:36:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:36:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:36:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:36:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:36:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:36:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:36:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:36:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:36:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:36:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:55.908 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:36:55.910 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:55.901+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:55.910 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:56.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:56.005+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:56.022 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:56.018+0000 7fe32aae1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:56.034 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:56.026+0000 7fe32aae1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:56.064 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:56.074 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:56.075 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:56.100 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:56.101 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:56.110 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:56.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:56.129+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:56.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:56.157 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:56.185 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:56.209 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:56.210 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.211 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.211 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.211 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.211 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:36:56.212 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:56.213 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:56.213 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:56.205+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:56.250 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.250 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.259 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:56.311 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:36:56.315 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:56.310+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:56.409 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.409 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.415 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:56.409+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:56.419 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:36:56.455 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:56.422+0000 7feeb312d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:56.455 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:56.434+0000 7feeb312d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:56.516 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:56.509+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:56.533 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.534 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.541 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:36:56.618 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:56.613+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:56.689 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.690 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.695 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:36:56.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:56.713+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:56.805 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.806 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.818 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:36:56.822 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:56.818+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:56.922 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:56.917+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:56.929 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:56.941 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:36:57.023 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:57.017+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:57.053 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.053 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.062 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:36:57.105 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:36:57.165 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:57.162+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:57.181 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.181 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.188 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:36:57.233 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:57.221+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:57.329 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:57.321+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:57.346 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.346 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.355 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:36:57.428 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:57.426+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:57.469 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.469 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.475 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:36:57.494 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:36:57.529 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:57.521+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:57.625 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.626 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.626 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:57.614+0000 7f2aaa5ee700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:57.630 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:57.625+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:57.631 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:57.626+0000 7f2aa938c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:57.634 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:36:57.731 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:57.725+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:57.749 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.750 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.759 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:36:57.777 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:36:57.778 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:36:57.790 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2020-06-12T02:36:57.084798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7704092,"kb_used_data":364004,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652898788,"statfs":{"total":676457349120,"available":668568358912,"internally_reserved":7516192768,"allocated":372740096,"data_stored":439093712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.138129"},"pg_stats":[{"pgid":"1.f","version":"84'68","reported_seq":"307","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.289247+0000","last_change":"2020-06-12T02:36:44.103918+0000","last_active":"2020-06-12T02:36:51.289247+0000","last_peered":"2020-06-12T02:36:51.289247+0000","last_clean":"2020-06-12T02:36:51.289247+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:51.289247+0000","last_undegraded":"2020-06-12T02:36:51.289247+0000","last_fullsized":"2020-06-12T02:36:51.289247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'68","last_scrub_stamp":"2020-06-12T02:36:44.103723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.103723+0000","log_size":68,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8886777,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":21437,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.e","version":"81'90","reported_seq":"68","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.040536+0000","last_change":"2020-06-12T02:36:37.963853+0000","last_active":"2020-06-12T02:36:48.040536+0000","last_peered":"2020-06-12T02:36:48.040536+0000","last_clean":"2020-06-12T02:36:48.040536+0000","last_became_active":"2020-06-12T02:36:31.982116+0000","last_became_peered":"2020-06-12T02:36:31.982116+0000","last_unstale":"2020-06-12T02:36:48.040536+0000","last_undegraded":"2020-06-12T02:36:48.040536+0000","last_fullsized":"2020-06-12T02:36:48.040536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'86","last_scrub_stamp":"2020-06-12T02:36:28.028555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:28.028555+0000","log_size":90,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":22386693,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.d","version":"0'0","reported_seq":"8","reported_epoch":"99","state":"down","last_fresh":"2020-06-12T02:36:51.045455+0000","last_change":"2020-06-12T02:36:40.980461+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-06-12T02:36:51.045455+0000","last_undegraded":"2020-06-12T02:36:51.045455+0000","last_fullsized":"2020-06-12T02:36:51.045455+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.c","version":"88'35","reported_seq":"274","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.045774+0000","last_change":"2020-06-12T02:36:44.869546+0000","last_active":"2020-06-12T02:36:51.045774+0000","last_peered":"2020-06-12T02:36:51.045774+0000","last_clean":"2020-06-12T02:36:51.045774+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:51.045774+0000","last_undegraded":"2020-06-12T02:36:51.045774+0000","last_fullsized":"2020-06-12T02:36:51.045774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'35","last_scrub_stamp":"2020-06-12T02:36:44.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.869250+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3762777,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12612,"num_write":15,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.b","version":"94'73","reported_seq":"350","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.033094+0000","last_change":"2020-06-12T02:36:42.082396+0000","last_active":"2020-06-12T02:36:48.033094+0000","last_peered":"2020-06-12T02:36:48.033094+0000","last_clean":"2020-06-12T02:36:48.033094+0000","last_became_active":"2020-06-12T02:36:41.995264+0000","last_became_peered":"2020-06-12T02:36:41.995264+0000","last_unstale":"2020-06-12T02:36:48.033094+0000","last_undegraded":"2020-06-12T02:36:48.033094+0000","last_fullsized":"2020-06-12T02:36:48.033094+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8336206,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":30,"num_read_kb":34289,"num_write":36,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8336206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.a","version":"85'21","reported_seq":"77","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.040772+0000","last_change":"2020-06-12T02:36:42.028638+0000","last_active":"2020-06-12T02:36:48.040772+0000","last_peered":"2020-06-12T02:36:48.040772+0000","last_clean":"2020-06-12T02:36:48.040772+0000","last_became_active":"2020-06-12T02:36:41.995085+0000","last_became_peered":"2020-06-12T02:36:41.995085+0000","last_unstale":"2020-06-12T02:36:48.040772+0000","last_undegraded":"2020-06-12T02:36:48.040772+0000","last_fullsized":"2020-06-12T02:36:48.040772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7159683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.9","version":"88'92","reported_seq":"73","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.040842+0000","last_change":"2020-06-12T02:36:37.964431+0000","last_active":"2020-06-12T02:36:48.040842+0000","last_peered":"2020-06-12T02:36:48.040842+0000","last_clean":"2020-06-12T02:36:48.040842+0000","last_became_active":"2020-06-12T02:36:31.985154+0000","last_became_peered":"2020-06-12T02:36:31.985154+0000","last_unstale":"2020-06-12T02:36:48.040842+0000","last_undegraded":"2020-06-12T02:36:48.040842+0000","last_fullsized":"2020-06-12T02:36:48.040842+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14034149,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":42,"num_write_kb":15786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":23143041,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.8","version":"88'85","reported_seq":"77","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.040460+0000","last_change":"2020-06-12T02:36:41.392685+0000","last_active":"2020-06-12T02:36:48.040460+0000","last_peered":"2020-06-12T02:36:48.040460+0000","last_clean":"2020-06-12T02:36:48.040460+0000","last_became_active":"2020-06-12T02:36:31.984707+0000","last_became_peered":"2020-06-12T02:36:31.984707+0000","last_unstale":"2020-06-12T02:36:48.040460+0000","last_undegraded":"2020-06-12T02:36:48.040460+0000","last_fullsized":"2020-06-12T02:36:48.040460+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'85","last_scrub_stamp":"2020-06-12T02:36:41.392546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.392546+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13495005,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":8037,"num_write":35,"num_write_kb":14351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":25932970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.7","version":"86'170","reported_seq":"395","reported_epoch":"98","state":"down","last_fresh":"2020-06-12T02:36:48.040285+0000","last_change":"2020-06-12T02:36:40.985157+0000","last_active":"2020-06-12T02:36:34.949384+0000","last_peered":"2020-06-12T02:36:33.332966+0000","last_clean":"2020-06-12T02:36:28.212298+0000","last_became_active":"2020-06-12T02:36:33.293059+0000","last_became_peered":"2020-06-12T02:36:33.293059+0000","last_unstale":"2020-06-12T02:36:48.040285+0000","last_undegraded":"2020-06-12T02:36:48.040285+0000","last_fullsized":"2020-06-12T02:36:48.040285+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17595493,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":48924,"num_write":75,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"91'81","reported_seq":"318","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.289222+0000","last_change":"2020-06-12T02:36:37.966550+0000","last_active":"2020-06-12T02:36:51.289222+0000","last_peered":"2020-06-12T02:36:51.289222+0000","last_clean":"2020-06-12T02:36:51.289222+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:51.289222+0000","last_undegraded":"2020-06-12T02:36:51.289222+0000","last_fullsized":"2020-06-12T02:36:51.289222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'73","last_scrub_stamp":"2020-06-12T02:36:30.051303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:30.051303+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9847642,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":32,"num_read_kb":28345,"num_write":33,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.1","version":"91'48","reported_seq":"292","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:54.056863+0000","last_change":"2020-06-12T02:36:54.056863+0000","last_active":"2020-06-12T02:36:54.056863+0000","last_peered":"2020-06-12T02:36:54.056863+0000","last_clean":"2020-06-12T02:36:54.056863+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:54.056863+0000","last_undegraded":"2020-06-12T02:36:54.056863+0000","last_fullsized":"2020-06-12T02:36:54.056863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'48","last_scrub_stamp":"2020-06-12T02:36:54.056647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:54.056647+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"78","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.476480+0000","last_change":"2020-06-12T02:36:51.476689+0000","last_active":"2020-06-12T02:36:51.476480+0000","last_peered":"2020-06-12T02:36:51.476480+0000","last_clean":"2020-06-12T02:36:51.476480+0000","last_became_active":"2020-06-12T02:36:42.026509+0000","last_became_peered":"2020-06-12T02:36:42.026509+0000","last_unstale":"2020-06-12T02:36:51.476480+0000","last_undegraded":"2020-06-12T02:36:51.476480+0000","last_fullsized":"2020-06-12T02:36:51.476480+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:36:51.476479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:51.476479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.2","version":"88'214","reported_seq":"555","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.620817+0000","last_change":"2020-06-12T02:36:41.101523+0000","last_active":"2020-06-12T02:36:51.620817+0000","last_peered":"2020-06-12T02:36:51.620817+0000","last_clean":"2020-06-12T02:36:51.620817+0000","last_became_active":"2020-06-12T02:36:34.964571+0000","last_became_peered":"2020-06-12T02:36:34.964571+0000","last_unstale":"2020-06-12T02:36:51.620817+0000","last_undegraded":"2020-06-12T02:36:51.620817+0000","last_fullsized":"2020-06-12T02:36:51.620817+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'214","last_scrub_stamp":"2020-06-12T02:36:41.101376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.101376+0000","log_size":214,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22113349,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":39,"num_read_kb":27696,"num_write":84,"num_write_kb":29495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":56823939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.3","version":"86'148","reported_seq":"443","reported_epoch":"98","state":"down","last_fresh":"2020-06-12T02:36:48.033167+0000","last_change":"2020-06-12T02:36:40.980118+0000","last_active":"2020-06-12T02:36:34.951718+0000","last_peered":"2020-06-12T02:36:34.003732+0000","last_clean":"2020-06-12T02:36:29.990455+0000","last_became_active":"2020-06-12T02:36:33.289911+0000","last_became_peered":"2020-06-12T02:36:33.289911+0000","last_unstale":"2020-06-12T02:36:48.033167+0000","last_undegraded":"2020-06-12T02:36:48.033167+0000","last_fullsized":"2020-06-12T02:36:48.033167+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":148,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29701358,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":56,"num_read_kb":56070,"num_write":62,"num_write_kb":23647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":48151560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"88'199","reported_seq":"439","reported_epoch":"99","state":"active+clean","last_fresh":"2020-06-12T02:36:51.471350+0000","last_change":"2020-06-12T02:36:40.811641+0000","last_active":"2020-06-12T02:36:51.471350+0000","last_peered":"2020-06-12T02:36:51.471350+0000","last_clean":"2020-06-12T02:36:51.471350+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:51.471350+0000","last_undegraded":"2020-06-12T02:36:51.471350+0000","last_fullsized":"2020-06-12T02:36:51.471350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'199","last_scrub_stamp":"2020-06-12T02:36:40.811411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:40.811411+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26861505,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":69,"num_read_kb":85329,"num_write":84,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.5","version":"97'197","reported_seq":"430","reported_epoch":"98","state":"active+clean","last_fresh":"2020-06-12T02:36:48.033454+0000","last_change":"2020-06-12T02:36:45.025845+0000","last_active":"2020-06-12T02:36:48.033454+0000","last_peered":"2020-06-12T02:36:48.033454+0000","last_clean":"2020-06-12T02:36:48.033454+0000","last_became_active":"2020-06-12T02:36:45.011966+0000","last_became_peered":"2020-06-12T02:36:45.011966+0000","last_unstale":"2020-06-12T02:36:48.033454+0000","last_undegraded":"2020-06-12T02:36:48.033454+0000","last_fullsized":"2020-06-12T02:36:48.033454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":197,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28971752,"num_objects":13,"num_object_clones":8,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":47,"num_read_kb":38628,"num_write":85,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3],"acting":[4,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421171200,"data_stored":510935040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095396,"kb_used_data":46812,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276444,"statfs":{"total":96636764160,"available":95515078656,"internally_reserved":1073741824,"allocated":47935488,"data_stored":60144649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":2.1600000000000001},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":1.6459999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.202},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.3340000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.464},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":1.827}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.954},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.0569999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":2.3820000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":1.802},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":1.774}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":1.5309999999999999},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":2.2970000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088464,"kb_used_data":39880,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283376,"statfs":{"total":96636764160,"available":95522177024,"internally_reserved":1073741824,"allocated":40837120,"data_stored":55681434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":2.5179999999999998},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":2.4239999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":1.514},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.9039999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.919}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.2130000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":3.0659999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.621},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.8919999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6000000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.379}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":2.9940000000000002},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.6389999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143596,"kb_used_data":95012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228244,"statfs":{"total":96636764160,"available":95465721856,"internally_reserved":1073741824,"allocated":97292288,"data_stored":114670601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.488}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":2.4460000000000002},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.891}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1899999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.093}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":2.3639999999999999},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.2890000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.0939999999999999},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.8730000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":3.2789999999999999},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.6779999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.2869999999999999},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.8769999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137600,"kb_used_data":89016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234240,"statfs":{"total":96636764160,"available":95471861760,"internally_reserved":1073741824,"allocated":91152384,"data_stored":91143177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.3069999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.5469999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.625}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":1.865},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":1.7589999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.4970000000000001},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.6359999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":2.1779999999999999},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":2.2280000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":2.746},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":2.4470000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":1.9810000000000001},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":3.1890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071436,"kb_used_data":22852,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300404,"statfs":{"total":96636764160,"available":95539613696,"internally_reserved":1073741824,"allocated":23400448,"data_stored":27704329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.77},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.7280000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.496},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.6559999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.024},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.2280000000000002}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":2.032},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.6789999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":2.4340000000000002},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":2.3450000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":1.895},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":2.2309999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.0289999999999999},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.6299999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094176,"kb_used_data":45592,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277664,"statfs":{"total":96636764160,"available":95516327936,"internally_reserved":1073741824,"allocated":46686208,"data_stored":56445961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.5349999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.9059999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.472}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.0710000000000002},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.4450000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.7879999999999998},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":2.1349999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":1.702},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.488}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.6960000000000002},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":2.4209999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":2.8599999999999999},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":3.0009999999999999}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073424,"kb_used_data":24840,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298416,"statfs":{"total":96636764160,"available":95537577984,"internally_reserved":1073741824,"allocated":25436160,"data_stored":33303561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.649},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.7040000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.776},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":2.1850000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.111},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.2959999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.7270000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":2.8029999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.7570000000000001},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":2.4620000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.3719999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.0550000000000002}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.2890000000000001},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.0960000000000001}]}]}]}} 2020-06-12T02:36:57.793 INFO:tasks.thrashosds.thrasher:not all PGs are active or peered 2020-06-12T02:36:57.839 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:57.826+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:57.910 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:57.910 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:57.924 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:36:57.972 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:57.965+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:58.029 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:58.030 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:58.035 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:58.029+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:58.038 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:36:58.138 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:58.134+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:58.187 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:58.188 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:58.197 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:36:58.214 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:36:58.242 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:58.237+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:36:58.307 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:36:58.325 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:36:58.334 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:58.322+0000 7f5f4fe40700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:58.335 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:58.330+0000 7f5f4ebde700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:58.338 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:36:58.334+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:36:58.370 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:36:58.387 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:36:58.409 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:36:58.451 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:36:58.452 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:58.446+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:58.460 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:36:58.495 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:58.495 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:58.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:58.495 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:58.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.496 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:58.496 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:58.496 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 87.333814755000006, 2020-06-12T02:36:58.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:36:58.497 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.497 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:58.497 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:58.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:36:58.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:36:58.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:36:58.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:36:58.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:36:58.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:36:58.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:36:58.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:36:58.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:36:58.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:36:58.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:36:58.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:36:58.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:36:58.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:36:58.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:36:58.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:36:58.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:36:58.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:36:58.537 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.537 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.537 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.538 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:36:58.539 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:58.539 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 82.187301243999997, 2020-06-12T02:36:58.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:36:58.540 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.541 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:58.541 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:58.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:36:58.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:36:58.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:36:58.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:36:58.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:36:58.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:36:58.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:36:58.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:36:58.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:36:58.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:36:58.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:36:58.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:36:58.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:36:58.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:36:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:36:58.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:36:58.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:36:58.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:36:58.558 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.559 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.560 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:58.560 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:58.560 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.509752570000003, 2020-06-12T02:36:58.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:36:58.561 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.561 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.563 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:36:58.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.563 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:58.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:36:58.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:36:58.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:36:58.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:36:58.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:36:58.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:36:58.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:36:58.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:36:58.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:36:58.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:36:58.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:36:58.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:36:58.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:58.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:36:58.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:36:58.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:36:58.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:36:58.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:36:58.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:36:58.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:36:58.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:36:58.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:36:58.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:36:58.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:36:58.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:36:58.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:36:58.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:36:58.583 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.583 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.583 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.508988641999998, 2020-06-12T02:36:58.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:36:58.585 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.585 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.586 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:36:58.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.586 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:58.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:36:58.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:36:58.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:36:58.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:36:58.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:36:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:36:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:36:58.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:36:58.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:36:58.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:36:58.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:36:58.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:36:58.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:58.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:36:58.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:36:58.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:36:58.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:36:58.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:58.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:36:58.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:36:58.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:36:58.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:36:58.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:58.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:36:58.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:36:58.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:36:58.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:36:58.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:36:58.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:36:58.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:36:58.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:36:58.601 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.601 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.602 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.602 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:58.602 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:58.603 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.286183586999996, 2020-06-12T02:36:58.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:36:58.603 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.603 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.603 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.604 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:36:58.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.604 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:58.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:36:58.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:36:58.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:36:58.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:36:58.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:36:58.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:36:58.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:36:58.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:36:58.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:36:58.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:36:58.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:36:58.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:36:58.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:36:58.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:36:58.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:36:58.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:36:58.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:36:58.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:36:58.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:36:58.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:36:58.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.617 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.618 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:58.618 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:58.618 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.277897299999999, 2020-06-12T02:36:58.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:36:58.619 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.619 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.619 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.620 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:36:58.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.620 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:58.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:36:58.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:36:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:36:58.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:36:58.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:36:58.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:36:58.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:36:58.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:36:58.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:36:58.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:36:58.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:36:58.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:36:58.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:36:58.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:36:58.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:36:58.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:36:58.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:36:58.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:36:58.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.633 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.633 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.634 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:36:58.634 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:58.634 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.270868055999998, 2020-06-12T02:36:58.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:36:58.635 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.635 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.635 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.636 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:36:58.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.636 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:36:58.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:36:58.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:36:58.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:36:58.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:36:58.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:36:58.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:36:58.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:36:58.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:36:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:36:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:36:58.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:36:58.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:36:58.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:36:58.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:36:58.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:36:58.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:36:58.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:36:58.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:36:58.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:36:58.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:36:58.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:36:58.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.648 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.649 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.649 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:36:58.649 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.270730604999997, 2020-06-12T02:36:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:36:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.651 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.651 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.651 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:36:58.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.651 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:58.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:36:58.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:36:58.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:36:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:36:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:36:58.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:36:58.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:36:58.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:36:58.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:36:58.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:36:58.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:36:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:36:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:58.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:36:58.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:36:58.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:36:58.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:36:58.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:36:58.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:36:58.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:36:58.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:36:58.663 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.663 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.663 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.664 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:58.664 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:58.664 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.469942865999997, 2020-06-12T02:36:58.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:36:58.665 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.665 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.665 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.665 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.665 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.666 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:36:58.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.666 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:58.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:36:58.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:36:58.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:36:58.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:36:58.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:36:58.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:36:58.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:36:58.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:36:58.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:36:58.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:36:58.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:36:58.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:36:58.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:58.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:36:58.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:36:58.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:36:58.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:36:58.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:36:58.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:36:58.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:36:58.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:36:58.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:36:58.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:36:58.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:36:58.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:36:58.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:36:58.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:36:58.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.681 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.682 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:36:58.682 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:58.682 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.469796252000002, 2020-06-12T02:36:58.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:36:58.684 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.685 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.686 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:36:58.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.686 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:58.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:36:58.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:36:58.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:36:58.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:36:58.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:36:58.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:36:58.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:36:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:36:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:58.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:36:58.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:36:58.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:36:58.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:36:58.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:36:58.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:36:58.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:36:58.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:36:58.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:36:58.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:36:58.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:36:58.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:36:58.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:36:58.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:36:58.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.705 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.706 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:58.707 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:58.707 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.513783377999999, 2020-06-12T02:36:58.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:36:58.707 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.707 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.708 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:36:58.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.709 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:58.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:36:58.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:36:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:36:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:36:58.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:36:58.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:36:58.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:36:58.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:36:58.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:36:58.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:36:58.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:36:58.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:36:58.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:36:58.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:36:58.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:36:58.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:36:58.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:36:58.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:36:58.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.721 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:58.722 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:58.722 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.508051864999999, 2020-06-12T02:36:58.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:36:58.723 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.723 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:58.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:36:58.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:36:58.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:36:58.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:36:58.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:36:58.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:36:58.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:36:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:36:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:36:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:36:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:36:58.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:36:58.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:36:58.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:36:58.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:36:58.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:36:58.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:36:58.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:36:58.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:36:58.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:36:58.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.736 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.738 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:58.738 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:58.738 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.507558349, 2020-06-12T02:36:58.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:36:58.739 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.739 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:58.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.740 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:36:58.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.740 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:58.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:36:58.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:36:58.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:36:58.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:36:58.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:36:58.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:36:58.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:36:58.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:36:58.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:36:58.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:36:58.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:36:58.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:36:58.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:36:58.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:36:58.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:36:58.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:36:58.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:36:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:36:58.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:36:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:36:58.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.752 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:58.753 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:58.754 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.507464341999999, 2020-06-12T02:36:58.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:36:58.754 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.754 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.755 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.755 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.755 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:36:58.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.755 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:58.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:36:58.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:36:58.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:36:58.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:36:58.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:36:58.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:36:58.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:36:58.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:36:58.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:36:58.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:36:58.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:36:58.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:36:58.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:36:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:36:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:36:58.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:36:58.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.766 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.469303312999998, 2020-06-12T02:36:58.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:36:58.768 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.768 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:58.768 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:58.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:36:58.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:36:58.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:36:58.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:36:58.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:36:58.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:36:58.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:36:58.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:36:58.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:36:58.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:36:58.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:58.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:36:58.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:36:58.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:36:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:36:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.783 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:58.783 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:58.783 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.428506319999997, 2020-06-12T02:36:58.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:36:58.784 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.784 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.785 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:36:58.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.785 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:58.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:36:58.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:36:58.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:36:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:36:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:36:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:36:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:36:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:36:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:36:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:36:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:36:58.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:36:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.428264253999998, 2020-06-12T02:36:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:36:58.795 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.796 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:58.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:36:58.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:36:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:36:58.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:36:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:36:58.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:36:58.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:36:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:36:58.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:36:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:36:58.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:36:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:36:58.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:36:58.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:36:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:36:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:58.807 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.428054563000003, 2020-06-12T02:36:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:36:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.808 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:36:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:36:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:36:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:36:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:36:58.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:36:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:36:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:36:58.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:36:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:36:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:36:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:36:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:36:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:36:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:36:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:36:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.821 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:36:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:58.822 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 37.412520401999998, 2020-06-12T02:36:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:36:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.823 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:36:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.824 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:36:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:36:58.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:36:58.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:36:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:36:58.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:36:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:36:58.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:36:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:36:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:36:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:36:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:36:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:36:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:36:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:36:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 28.514460368000002, 2020-06-12T02:36:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:36:58.835 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:58.837 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:36:58.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.837 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:58.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:36:58.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:36:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:36:58.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:36:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:58.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:36:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:36:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:58.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:36:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:36:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:58.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:36:58.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:36:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:36:58.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:36:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:36:58.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:36:58.847 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:58.849 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:58.849 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:58.849 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:36:58.852 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:36:58.853 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:36:58.853 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.853 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:36:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:36:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.855 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:36:58.856 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:36:58.856 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:36:58.857 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:58.845+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:36:58.952 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:58.950+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:58.974 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:58.975 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:58.975 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:58.975 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:58.986 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:36:59.058 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:36:59.049+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:36:59.094 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:59.096 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:59.103 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:36:59.128 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:36:59.190 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:59.185+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:59.257 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:36:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:36:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:36:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.130623588999995, 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:36:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:36:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:36:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:36:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:36:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:36:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:36:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:36:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:36:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:36:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:36:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:36:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:36:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:36:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:36:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:36:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:36:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:36:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:36:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:36:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:36:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.130484652999996, 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:36:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:36:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:36:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:36:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:36:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:36:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:36:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:36:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:36:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:36:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:36:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:36:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:36:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:36:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:36:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:36:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:36:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:36:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:36:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:36:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:36:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:36:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:36:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:36:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.130348815000005, 2020-06-12T02:36:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:36:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:36:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:59.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:36:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:36:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:36:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:36:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:36:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:36:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:36:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:36:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:36:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:36:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:36:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:36:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:36:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:36:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:36:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:36:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:36:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:36:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:36:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 88.106683966999995, 2020-06-12T02:36:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:36:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:36:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:36:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:36:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:36:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:36:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:36:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:36:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:36:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:36:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:36:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:36:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:36:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:36:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:36:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:36:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:36:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:36:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:36:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:36:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.059240056999997, 2020-06-12T02:36:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:36:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:36:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:36:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:36:59.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:36:59.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:36:59.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:36:59.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:36:59.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:36:59.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:36:59.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:36:59.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:36:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:36:59.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:36:59.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:59.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:36:59.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:36:59.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:36:59.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:36:59.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:36:59.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:36:59.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:36:59.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:36:59.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:36:59.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:36:59.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:36:59.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:36:59.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:36:59.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:36:59.352 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.352 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.353 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.353 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:59.353 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:59.354 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.315503014000001, 2020-06-12T02:36:59.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:36:59.354 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.354 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.354 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:59.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:36:59.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:36:59.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:36:59.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:36:59.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:36:59.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:36:59.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:36:59.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:36:59.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:36:59.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:36:59.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:36:59.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:36:59.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:36:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:36:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:36:59.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:36:59.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:36:59.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:36:59.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.367 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.367 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:59.368 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:59.368 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.314529644000004, 2020-06-12T02:36:59.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:36:59.368 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.368 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.369 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:59.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:36:59.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:36:59.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:36:59.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:36:59.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:36:59.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:36:59.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:36:59.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:36:59.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:36:59.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:36:59.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:36:59.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:36:59.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:36:59.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:36:59.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:36:59.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:36:59.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:36:59.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:36:59.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.381 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.382 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.383 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:36:59.383 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:59.383 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.313320524000005, 2020-06-12T02:36:59.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:36:59.383 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.384 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.384 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:59.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:36:59.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:36:59.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:36:59.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:36:59.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:36:59.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:36:59.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:36:59.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:36:59.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:36:59.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:36:59.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:36:59.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:36:59.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:36:59.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:36:59.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:36:59.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:36:59.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:36:59.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.400 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:36:59.401 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:59.401 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.312057538999994, 2020-06-12T02:36:59.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:36:59.401 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.401 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:36:59.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:36:59.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:36:59.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:36:59.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:36:59.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:36:59.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:36:59.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:36:59.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:36:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:36:59.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:36:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:36:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.411 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.412 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:36:59.413 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:59.414 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 53.300599411999997, 2020-06-12T02:36:59.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:36:59.415 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.415 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.415 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:59.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:36:59.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:36:59.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:36:59.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:36:59.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:36:59.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:36:59.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:36:59.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:36:59.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:36:59.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:36:59.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:36:59.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:36:59.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:36:59.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:36:59.425 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.425 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.425 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.426 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:36:59.426 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:59.426 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 53.297598372000003, 2020-06-12T02:36:59.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:36:59.427 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.427 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.427 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:36:59.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:36:59.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:36:59.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:36:59.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:36:59.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:36:59.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:36:59.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:36:59.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:36:59.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:36:59.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:36:59.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:36:59.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:36:59.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:36:59.437 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.437 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.438 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.438 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:59.438 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.274772372999998, 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.439 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.440 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.440 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:36:59.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.440 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:59.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:36:59.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:36:59.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:36:59.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:36:59.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:36:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:36:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:36:59.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:36:59.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:36:59.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:36:59.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:36:59.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:36:59.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:36:59.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:36:59.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:36:59.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:36:59.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.451 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.274626980999997, 2020-06-12T02:36:59.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:36:59.453 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.453 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.453 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.454 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.454 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:36:59.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.454 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:36:59.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:36:59.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:36:59.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:36:59.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:36:59.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:36:59.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:36:59.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:36:59.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:36:59.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:36:59.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:36:59.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:36:59.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:59.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:36:59.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:36:59.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:36:59.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:36:59.466 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.466 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.466 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.467 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:59.467 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:59.467 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.242485702000003, 2020-06-12T02:36:59.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:36:59.467 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.468 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.468 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.468 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.468 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.468 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:59.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:36:59.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:36:59.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:36:59.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:36:59.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:36:59.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:36:59.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:36:59.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:36:59.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:36:59.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:36:59.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:36:59.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:36:59.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:36:59.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:36:59.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:36:59.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:36:59.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.480 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.481 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.481 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:59.481 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.237359067, 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.483 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:36:59.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.483 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:59.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:36:59.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:36:59.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:36:59.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:36:59.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:36:59.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:36:59.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:36:59.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:36:59.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:36:59.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:36:59.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:36:59.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:36:59.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:36:59.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:36:59.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:36:59.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:36:59.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.495 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.236980056999997, 2020-06-12T02:36:59.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:36:59.497 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.497 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:36:59.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.498 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:36:59.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.498 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:59.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:36:59.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:36:59.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:36:59.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:36:59.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:36:59.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:36:59.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:36:59.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:36:59.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:36:59.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:36:59.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:36:59.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:36:59.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:36:59.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:36:59.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:36:59.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:36:59.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:36:59.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.510 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.511 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.511 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:36:59.511 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:59.512 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.236762601999999, 2020-06-12T02:36:59.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:36:59.512 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.512 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:59.512 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.513 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.513 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.513 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:36:59.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.513 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:59.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:36:59.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:36:59.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:36:59.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:36:59.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:36:59.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:36:59.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:36:59.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:36:59.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:36:59.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:36:59.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:36:59.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:36:59.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:36:59.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:36:59.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:36:59.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:36:59.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:36:59.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:36:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:36:59.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.527 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:36:59.527 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:59.527 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 43.872820357000002, 2020-06-12T02:36:59.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:36:59.527 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.528 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:59.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.529 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:36:59.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.529 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:59.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:36:59.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:36:59.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:36:59.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:36:59.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:36:59.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:36:59.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:36:59.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:36:59.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:36:59.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:36:59.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:36:59.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:36:59.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:36:59.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:36:59.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.539 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.540 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.540 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:36:59.540 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:59.541 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.283767570000002, 2020-06-12T02:36:59.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:36:59.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.541 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:36:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:59.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:36:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:36:59.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:36:59.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:36:59.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:36:59.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:36:59.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:36:59.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:36:59.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:36:59.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:36:59.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:36:59.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:36:59.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:36:59.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:36:59.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:36:59.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:36:59.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:36:59.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.553 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.554 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 39.280733996999999, 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:36:59.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:36:59.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:36:59.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:36:59.557 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:36:59.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.557 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:36:59.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:36:59.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:59.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:36:59.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:36:59.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:36:59.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:36:59.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:36:59.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:36:59.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:36:59.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:36:59.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:36:59.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:36:59.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:36:59.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:36:59.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:36:59.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:36:59.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:36:59.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:36:59.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:36:59.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:36:59.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:36:59.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:36:59.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:36:59.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:36:59.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:36:59.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:36:59.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:36:59.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:36:59.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:36:59.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:36:59.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:36:59.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:36:59.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:36:59.570 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.571 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.571 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.571 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:36:59.571 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:36:59.571 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:59.572 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:59.249+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:59.242+0000 7fbcf9d02700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:36:59.258+0000 7fbcf8aa0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:36:59.574 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:36:59.575 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:36:59.565+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:36:59.676 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:36:59.669+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:36:59.734 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:59.734 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:59.734 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:36:59.735 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:59.745 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:36:59.775 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:36:59.770+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:36:59.879 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:36:59.874+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:36:59.896 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:36:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:36:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:36:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:36:59.897 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:36:59.906 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:36:59.979 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:36:59.973+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:00.019 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:37:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.766722646999995, 2020-06-12T02:37:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:37:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:37:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:37:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:37:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:37:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:37:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:37:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:37:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:37:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:37:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:37:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:37:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:37:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:37:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:37:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:37:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:37:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:37:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:37:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:37:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:37:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:37:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.765305595000001, 2020-06-12T02:37:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:37:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:37:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:37:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:37:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:37:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:37:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:37:00.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:37:00.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:37:00.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:37:00.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:37:00.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:37:00.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:37:00.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:37:00.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:37:00.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:37:00.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:37:00.055 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.055 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.056 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.056 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.057 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:00.057 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.054741606999997, 2020-06-12T02:37:00.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:37:00.057 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.057 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:37:00.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.059 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:00.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:37:00.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:37:00.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:37:00.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:37:00.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:37:00.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:37:00.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:37:00.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:37:00.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:37:00.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:37:00.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:37:00.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:37:00.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:37:00.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:37:00.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:37:00.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:37:00.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:37:00.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:37:00.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:37:00.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:37:00.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:37:00.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:37:00.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:37:00.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:37:00.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:37:00.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.078 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.085 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.086 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:00.086 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.047060305000002, 2020-06-12T02:37:00.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:37:00.086 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.086 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.087 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.087 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.087 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.087 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:37:00.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:00.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:37:00.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:37:00.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:37:00.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:37:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:37:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:37:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:37:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:37:00.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:37:00.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:37:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:37:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:37:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:37:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:37:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:37:00.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:37:00.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:37:00.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.104 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.104 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.105 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:00.105 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.038005007999999, 2020-06-12T02:37:00.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:37:00.105 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.105 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.106 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:37:00.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.107 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:00.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:37:00.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:37:00.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:37:00.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:37:00.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:37:00.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:37:00.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:37:00.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:37:00.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:37:00.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:37:00.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:37:00.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:37:00.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:37:00.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:37:00.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:37:00.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:37:00.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:37:00.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:37:00.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:37:00.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:37:00.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:37:00.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.120 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.121 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.121 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.037065468999998, 2020-06-12T02:37:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:37:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:00.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:37:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:37:00.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:37:00.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:37:00.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:37:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:37:00.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:37:00.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:37:00.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:37:00.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:37:00.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:37:00.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:37:00.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:37:00.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:37:00.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:37:00.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:37:00.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:37:00.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.138 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:00.138 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:00.138 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.036933521999998, 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.140 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:37:00.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:00.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:37:00.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:37:00.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:37:00.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:37:00.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:37:00.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:37:00.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:37:00.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:37:00.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:37:00.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:37:00.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:37:00.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:37:00.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:37:00.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:37:00.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.152 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.029261224999999, 2020-06-12T02:37:00.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:37:00.154 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.154 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.155 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:37:00.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.155 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:37:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:37:00.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:37:00.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:37:00.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:37:00.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:37:00.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:37:00.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:37:00.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:37:00.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:37:00.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:37:00.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:37:00.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:37:00.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.023286259999999, 2020-06-12T02:37:00.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:37:00.168 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.168 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:00.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:37:00.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:00.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:37:00.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:00.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:37:00.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:37:00.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:37:00.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:37:00.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:37:00.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:37:00.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:37:00.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:37:00.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:37:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:37:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:37:00.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:37:00.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.182 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.016454697999997, 2020-06-12T02:37:00.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:37:00.184 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.184 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:00.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:37:00.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:37:00.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:37:00.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:37:00.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:37:00.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:37:00.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:37:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:37:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:37:00.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:37:00.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:37:00.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:37:00.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:37:00.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:37:00.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:37:00.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:37:00.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.198 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.015771749000002, 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:37:00.199 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.200 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.200 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.200 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:37:00.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.201 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:00.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:00.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:37:00.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:37:00.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:37:00.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:37:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:37:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:37:00.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:37:00.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:37:00.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:37:00.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:37:00.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:37:00.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:37:00.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:37:00.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:37:00.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:37:00.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:37:00.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:37:00.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:37:00.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:37:00.220 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.220 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.220 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 54.015684987, 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:37:00.221 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.222 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.222 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.222 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.222 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.222 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:00.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:00.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:37:00.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:37:00.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:37:00.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:37:00.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:37:00.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:37:00.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:37:00.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:37:00.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:37:00.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:37:00.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:37:00.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:37:00.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:37:00.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:37:00.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:37:00.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:37:00.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:37:00.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:00.236 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.637291380999997, 2020-06-12T02:37:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:37:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.237 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:00.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:37:00.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:37:00.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:37:00.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:37:00.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:37:00.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:37:00.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:37:00.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:37:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:37:00.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:37:00.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.247 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.614869444, 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.248 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.249 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:37:00.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:00.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:37:00.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:37:00.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:37:00.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:00.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:37:00.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:37:00.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:37:00.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:37:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:37:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:37:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:37:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:37:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:37:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:37:00.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:37:00.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:37:00.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:37:00.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:37:00.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:37:00.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.263 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.264 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:00.264 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:00.265 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.768894748000001, 2020-06-12T02:37:00.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:37:00.265 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.265 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.265 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.266 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.266 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:37:00.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.267 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:00.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:00.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:37:00.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:37:00.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:37:00.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:37:00.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:37:00.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:37:00.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:37:00.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:37:00.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:37:00.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:37:00.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:37:00.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:37:00.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:37:00.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:37:00.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:37:00.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:37:00.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:37:00.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:37:00.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:37:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:37:00.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:37:00.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:37:00.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:37:00.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:37:00.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:37:00.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.284 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.285 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:00.285 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:00.285 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.768077583999997, 2020-06-12T02:37:00.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:37:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.287 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:37:00.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.287 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:00.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:37:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:37:00.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:37:00.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:37:00.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:37:00.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:37:00.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:37:00.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:37:00.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:37:00.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:37:00.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:37:00.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:37:00.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:37:00.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:37:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:37:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:37:00.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:37:00.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:37:00.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:37:00.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:37:00.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:37:00.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:00.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:37:00.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:37:00.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:37:00.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:37:00.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.302 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.302 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.303 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:00.303 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:00.303 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.767840944, 2020-06-12T02:37:00.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:37:00.303 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:37:00.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:37:00.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:37:00.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:37:00.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:37:00.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:37:00.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:37:00.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:37:00.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:37:00.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:37:00.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:37:00.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:37:00.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:37:00.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:37:00.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:37:00.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:37:00.318 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.319 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.319 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.319 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:00.320 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:00.320 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.042348013000002, 2020-06-12T02:37:00.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:37:00.320 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.320 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.321 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.321 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.321 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.321 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:37:00.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.322 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:00.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:00.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:37:00.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:37:00.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:37:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:37:00.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:37:00.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:37:00.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:37:00.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:37:00.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:37:00.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:00.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:37:00.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:37:00.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:37:00.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:37:00.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:37:00.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:37:00.333 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 40.042067199999998, 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.335 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.336 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.336 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:37:00.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.336 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:00.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:00.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:37:00.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:37:00.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:37:00.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:37:00.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:37:00.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:37:00.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:37:00.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:37:00.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:37:00.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:00.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:37:00.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:37:00.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:37:00.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:37:00.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:37:00.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:37:00.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.350 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.350 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.351 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:37:00.351 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:00.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 38.963295965, 2020-06-12T02:37:00.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:37:00.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:37:00.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.354 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:00.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:00.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:00.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:00.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:00.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:00.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:37:00.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:00.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:37:00.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:37:00.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:00.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:37:00.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:37:00.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:00.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:37:00.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:37:00.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:37:00.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:37:00.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:37:00.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:37:00.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:00.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:37:00.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:37:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:37:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:37:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:00.368 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:00.369 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:37:00.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:00.361+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:00.371 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:00.476 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:00.466+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:00.537 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:00.538 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:00.548 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:00.572 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:00.569+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:00.674 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:00.670+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:00.699 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:00.700 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:00.713 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:00.775 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:00.769+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:00.859 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:00.875 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:00.875 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:00.876 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.769586865999997, 2020-06-12T02:37:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.877 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:00.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:00.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:00.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:00.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:00.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:00.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:00.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:00.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:00.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:00.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:00.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:00.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:00.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:00.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:00.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:00.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:00.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:00.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:00.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.894 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:00.894 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:00.894 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.769416499000002, 2020-06-12T02:37:00.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:00.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.895 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:00.895 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.895 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.895 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:00.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:00.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:00.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:00.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:00.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:00.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:00.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:00.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:00.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:00.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:00.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:00.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:00.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:00.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.909 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.910 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:00.910 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:00.911 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.751278471999996, 2020-06-12T02:37:00.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:00.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.911 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.912 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:00.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:00.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:00.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:00.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:00.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:00.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:00.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:00.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:00.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:00.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:00.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:00.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:00.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:00.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:00.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:00.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:00.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.925 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:00.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:00.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.745341589000006, 2020-06-12T02:37:00.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:00.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.927 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.928 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.928 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:00.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.929 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:00.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:00.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:00.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:00.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:00.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:00.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:00.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:00.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:00.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:00.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:00.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:00.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:00.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:00.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:00.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:00.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:00.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:00.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.744832517999996, 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:00.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:00.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:00.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:00.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:00.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:00.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:00.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:00.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:00.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:00.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:00.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.960 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.962 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:00.962 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:00.962 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.744674251999996, 2020-06-12T02:37:00.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:00.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.963 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:00.963 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.963 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:00.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:00.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:00.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:00.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:00.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:00.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:00.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:00.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:00.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:00.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:00.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:00.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:00.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:00.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:00.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:00.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:00.977 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.67027745, 2020-06-12T02:37:00.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:00.977 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.978 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:00.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:00.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:00.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:00.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:00.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:00.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:00.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:00.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:00.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:00.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:00.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:00.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:00.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:00.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:00.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:00.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:00.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:00.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:00.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:00.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:00.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:00.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:00.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.991 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:00.991 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.663266628000002, 2020-06-12T02:37:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:00.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:00.993 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:00.993 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:00.993 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:00.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.993 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:00.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:00.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:00.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:00.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:00.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:00.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:00.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:00.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:00.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:00.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:00.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:00.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:00.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:00.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:00.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:01.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:01.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:01.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:01.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:01.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:01.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:01.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:01.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:01.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:01.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:01.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.006 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:01.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:01.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.903480084999998, 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.009 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:01.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:01.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:01.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:01.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:01.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:01.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:01.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:01.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:01.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:01.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:01.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:01.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:01.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:01.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:01.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:01.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:01.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:01.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:01.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:01.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:01.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:01.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:01.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:01.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:01.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:01.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:01.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:01.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:01.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:01.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.037 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:01.037 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:01.037 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.903352489, 2020-06-12T02:37:01.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:01.037 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.038 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.038 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:01.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.039 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:01.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:01.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:01.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:01.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:01.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:01.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:01.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:01.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:01.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:01.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:01.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:01.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:01.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:01.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:01.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:01.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:01.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:01.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:01.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:01.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:01.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:01.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:01.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:01.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:01.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:01.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:01.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:01.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.488371848, 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:01.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.059 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:01.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.060 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:01.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:01.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:01.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:01.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:01.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:01.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:01.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.070 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:01.070 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:01.070 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.488227090999999, 2020-06-12T02:37:01.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:01.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:01.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.072 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:01.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:01.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:01.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:01.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:01.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:01.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:01.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:01.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:01.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:01.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:01.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:01.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:01.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.082 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:01.082 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:01.082 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.488096241000001, 2020-06-12T02:37:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:01.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:01.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:01.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:01.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:01.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:01.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:01.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:01.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:01.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:01.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:01.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:01.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:01.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:01.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:01.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.093 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:01.094 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.487951918999997, 2020-06-12T02:37:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.096 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:01.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.096 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.487839938, 2020-06-12T02:37:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.487687452999999, 2020-06-12T02:37:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.466942314999997, 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.466617221, 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 41.350970738000001, 2020-06-12T02:37:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 41.35063048, 2020-06-12T02:37:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:01.205 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:01.207 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:00.954+0000 7fcdb1ecd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:01.208 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:00.962+0000 7fcdb0c6b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:01.208 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.208 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.208 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:01.208 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:01.209 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.209 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.209 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.209 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.209 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:01.211 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:01.211 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:01.211 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:01.211 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:01.212 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:01.202+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:01.212 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:01.307 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:01.301+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:01.362 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:01.362 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:01.374 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:01.420 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:01.418+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:01.482 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:01.482 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:01.491 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:01.509 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:01.505+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:01.611 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:01.606+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:01.651 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:01.651 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:01.659 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:01.725 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:01.717+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:01.807 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:01.807 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:01.819 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:01.826 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:01.821+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:01.927 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:01.922+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:01.928 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:01.928 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:01.939 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:02.028 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:02.021+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:02.094 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.094 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.104 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:02.128 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:02.126+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:02.222 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.223 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:02.225+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:02.232 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:02.330 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:02.325+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:02.371 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:37:02.385 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.385 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.394 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:02.431 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:02.426+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:02.490 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:02.478+0000 7f58ce750700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:02.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:02.490+0000 7f58ce750700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:02.532 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:02.525+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:02.548 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.549 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.575 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:02.634 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:02.630+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:02.718 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.718 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.727 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:02.735 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:02.729+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:02.795 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:02.846 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:02.854 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:02.850+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:02.922 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:02.910+0000 7fe4bfa39700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:04.835 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:04.839 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:04.839 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:04.840 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:04.829+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:02.922+0000 7fe4be7d7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:04.840 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:37:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:37:04.841 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2020-06-12T02:37:01.950419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7704248,"kb_used_data":364160,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652898632,"statfs":{"total":676457349120,"available":668568199168,"internally_reserved":7516192768,"allocated":372899840,"data_stored":439165485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.880143"},"pg_stats":[{"pgid":"1.f","version":"84'68","reported_seq":"308","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074461+0000","last_change":"2020-06-12T02:36:44.103918+0000","last_active":"2020-06-12T02:36:54.074461+0000","last_peered":"2020-06-12T02:36:54.074461+0000","last_clean":"2020-06-12T02:36:54.074461+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:36:54.074461+0000","last_undegraded":"2020-06-12T02:36:54.074461+0000","last_fullsized":"2020-06-12T02:36:54.074461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'68","last_scrub_stamp":"2020-06-12T02:36:44.103723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.103723+0000","log_size":68,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8886777,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":21437,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.e","version":"81'90","reported_seq":"70","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074359+0000","last_change":"2020-06-12T02:36:37.963853+0000","last_active":"2020-06-12T02:36:54.074359+0000","last_peered":"2020-06-12T02:36:54.074359+0000","last_clean":"2020-06-12T02:36:54.074359+0000","last_became_active":"2020-06-12T02:36:31.982116+0000","last_became_peered":"2020-06-12T02:36:31.982116+0000","last_unstale":"2020-06-12T02:36:54.074359+0000","last_undegraded":"2020-06-12T02:36:54.074359+0000","last_fullsized":"2020-06-12T02:36:54.074359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'86","last_scrub_stamp":"2020-06-12T02:36:28.028555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:28.028555+0000","log_size":90,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":22386693,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.d","version":"0'0","reported_seq":"9","reported_epoch":"100","state":"down","last_fresh":"2020-06-12T02:36:54.071869+0000","last_change":"2020-06-12T02:36:40.980461+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-06-12T02:36:54.071869+0000","last_undegraded":"2020-06-12T02:36:54.071869+0000","last_fullsized":"2020-06-12T02:36:54.071869+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.c","version":"88'35","reported_seq":"275","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.071236+0000","last_change":"2020-06-12T02:36:44.869546+0000","last_active":"2020-06-12T02:36:54.071236+0000","last_peered":"2020-06-12T02:36:54.071236+0000","last_clean":"2020-06-12T02:36:54.071236+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:36:54.071236+0000","last_undegraded":"2020-06-12T02:36:54.071236+0000","last_fullsized":"2020-06-12T02:36:54.071236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'35","last_scrub_stamp":"2020-06-12T02:36:44.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.869250+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3762777,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12612,"num_write":15,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.b","version":"94'73","reported_seq":"352","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.077221+0000","last_change":"2020-06-12T02:36:42.082396+0000","last_active":"2020-06-12T02:36:54.077221+0000","last_peered":"2020-06-12T02:36:54.077221+0000","last_clean":"2020-06-12T02:36:54.077221+0000","last_became_active":"2020-06-12T02:36:41.995264+0000","last_became_peered":"2020-06-12T02:36:41.995264+0000","last_unstale":"2020-06-12T02:36:54.077221+0000","last_undegraded":"2020-06-12T02:36:54.077221+0000","last_fullsized":"2020-06-12T02:36:54.077221+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8336206,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":30,"num_read_kb":34289,"num_write":36,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8336206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.a","version":"85'21","reported_seq":"82","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074831+0000","last_change":"2020-06-12T02:36:53.430043+0000","last_active":"2020-06-12T02:36:54.074831+0000","last_peered":"2020-06-12T02:36:54.074831+0000","last_clean":"2020-06-12T02:36:54.074831+0000","last_became_active":"2020-06-12T02:36:41.995085+0000","last_became_peered":"2020-06-12T02:36:41.995085+0000","last_unstale":"2020-06-12T02:36:54.074831+0000","last_undegraded":"2020-06-12T02:36:54.074831+0000","last_fullsized":"2020-06-12T02:36:54.074831+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'21","last_scrub_stamp":"2020-06-12T02:36:53.429891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:53.429891+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7159683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.9","version":"88'92","reported_seq":"78","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:55.406642+0000","last_change":"2020-06-12T02:36:55.406642+0000","last_active":"2020-06-12T02:36:55.406642+0000","last_peered":"2020-06-12T02:36:55.406642+0000","last_clean":"2020-06-12T02:36:55.406642+0000","last_became_active":"2020-06-12T02:36:31.985154+0000","last_became_peered":"2020-06-12T02:36:31.985154+0000","last_unstale":"2020-06-12T02:36:55.406642+0000","last_undegraded":"2020-06-12T02:36:55.406642+0000","last_fullsized":"2020-06-12T02:36:55.406642+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'92","last_scrub_stamp":"2020-06-12T02:36:55.406429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:55.406429+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14034149,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":42,"num_write_kb":15786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":23143041,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.8","version":"88'85","reported_seq":"79","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074682+0000","last_change":"2020-06-12T02:36:41.392685+0000","last_active":"2020-06-12T02:36:54.074682+0000","last_peered":"2020-06-12T02:36:54.074682+0000","last_clean":"2020-06-12T02:36:54.074682+0000","last_became_active":"2020-06-12T02:36:31.984707+0000","last_became_peered":"2020-06-12T02:36:31.984707+0000","last_unstale":"2020-06-12T02:36:54.074682+0000","last_undegraded":"2020-06-12T02:36:54.074682+0000","last_fullsized":"2020-06-12T02:36:54.074682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'85","last_scrub_stamp":"2020-06-12T02:36:41.392546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.392546+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13495005,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":8037,"num_write":35,"num_write_kb":14351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":25932970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.7","version":"86'170","reported_seq":"397","reported_epoch":"100","state":"down","last_fresh":"2020-06-12T02:36:54.074146+0000","last_change":"2020-06-12T02:36:40.985157+0000","last_active":"2020-06-12T02:36:34.949384+0000","last_peered":"2020-06-12T02:36:33.332966+0000","last_clean":"2020-06-12T02:36:28.212298+0000","last_became_active":"2020-06-12T02:36:33.293059+0000","last_became_peered":"2020-06-12T02:36:33.293059+0000","last_unstale":"2020-06-12T02:36:54.074146+0000","last_undegraded":"2020-06-12T02:36:54.074146+0000","last_fullsized":"2020-06-12T02:36:54.074146+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17595493,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":48924,"num_write":75,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"91'81","reported_seq":"319","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074258+0000","last_change":"2020-06-12T02:36:37.966550+0000","last_active":"2020-06-12T02:36:54.074258+0000","last_peered":"2020-06-12T02:36:54.074258+0000","last_clean":"2020-06-12T02:36:54.074258+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:36:54.074258+0000","last_undegraded":"2020-06-12T02:36:54.074258+0000","last_fullsized":"2020-06-12T02:36:54.074258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'73","last_scrub_stamp":"2020-06-12T02:36:30.051303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:30.051303+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9847642,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":32,"num_read_kb":28345,"num_write":33,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.1","version":"91'48","reported_seq":"293","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.075081+0000","last_change":"2020-06-12T02:36:54.056863+0000","last_active":"2020-06-12T02:36:54.075081+0000","last_peered":"2020-06-12T02:36:54.075081+0000","last_clean":"2020-06-12T02:36:54.075081+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:36:54.075081+0000","last_undegraded":"2020-06-12T02:36:54.075081+0000","last_fullsized":"2020-06-12T02:36:54.075081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'48","last_scrub_stamp":"2020-06-12T02:36:54.056647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:54.056647+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"80","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.074452+0000","last_change":"2020-06-12T02:36:51.476689+0000","last_active":"2020-06-12T02:36:54.074452+0000","last_peered":"2020-06-12T02:36:54.074452+0000","last_clean":"2020-06-12T02:36:54.074452+0000","last_became_active":"2020-06-12T02:36:42.026509+0000","last_became_peered":"2020-06-12T02:36:42.026509+0000","last_unstale":"2020-06-12T02:36:54.074452+0000","last_undegraded":"2020-06-12T02:36:54.074452+0000","last_fullsized":"2020-06-12T02:36:54.074452+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:36:51.476479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:51.476479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.2","version":"88'214","reported_seq":"556","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.121941+0000","last_change":"2020-06-12T02:36:41.101523+0000","last_active":"2020-06-12T02:36:54.121941+0000","last_peered":"2020-06-12T02:36:54.121941+0000","last_clean":"2020-06-12T02:36:54.121941+0000","last_became_active":"2020-06-12T02:36:34.964571+0000","last_became_peered":"2020-06-12T02:36:34.964571+0000","last_unstale":"2020-06-12T02:36:54.121941+0000","last_undegraded":"2020-06-12T02:36:54.121941+0000","last_fullsized":"2020-06-12T02:36:54.121941+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'214","last_scrub_stamp":"2020-06-12T02:36:41.101376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.101376+0000","log_size":214,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22113349,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":39,"num_read_kb":27696,"num_write":84,"num_write_kb":29495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":56823939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.3","version":"86'148","reported_seq":"445","reported_epoch":"100","state":"down","last_fresh":"2020-06-12T02:36:54.076927+0000","last_change":"2020-06-12T02:36:40.980118+0000","last_active":"2020-06-12T02:36:34.951718+0000","last_peered":"2020-06-12T02:36:34.003732+0000","last_clean":"2020-06-12T02:36:29.990455+0000","last_became_active":"2020-06-12T02:36:33.289911+0000","last_became_peered":"2020-06-12T02:36:33.289911+0000","last_unstale":"2020-06-12T02:36:54.076927+0000","last_undegraded":"2020-06-12T02:36:54.076927+0000","last_fullsized":"2020-06-12T02:36:54.076927+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":148,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29701358,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":56,"num_read_kb":56070,"num_write":62,"num_write_kb":23647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":48151560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"88'199","reported_seq":"440","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.121866+0000","last_change":"2020-06-12T02:36:40.811641+0000","last_active":"2020-06-12T02:36:54.121866+0000","last_peered":"2020-06-12T02:36:54.121866+0000","last_clean":"2020-06-12T02:36:54.121866+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:54.121866+0000","last_undegraded":"2020-06-12T02:36:54.121866+0000","last_fullsized":"2020-06-12T02:36:54.121866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'199","last_scrub_stamp":"2020-06-12T02:36:40.811411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:40.811411+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26861505,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":69,"num_read_kb":85329,"num_write":84,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.5","version":"97'197","reported_seq":"432","reported_epoch":"100","state":"active+clean","last_fresh":"2020-06-12T02:36:54.077549+0000","last_change":"2020-06-12T02:36:45.025845+0000","last_active":"2020-06-12T02:36:54.077549+0000","last_peered":"2020-06-12T02:36:54.077549+0000","last_clean":"2020-06-12T02:36:54.077549+0000","last_became_active":"2020-06-12T02:36:45.011966+0000","last_became_peered":"2020-06-12T02:36:45.011966+0000","last_unstale":"2020-06-12T02:36:54.077549+0000","last_undegraded":"2020-06-12T02:36:54.077549+0000","last_fullsized":"2020-06-12T02:36:54.077549+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":197,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28971752,"num_objects":13,"num_object_clones":8,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":47,"num_read_kb":38628,"num_write":85,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3],"acting":[4,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421171200,"data_stored":510935040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095420,"kb_used_data":46836,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276420,"statfs":{"total":96636764160,"available":95515054080,"internally_reserved":1073741824,"allocated":47960064,"data_stored":60155691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.24},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":1.478}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.7270000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.464},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":1.827}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":1.7929999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":1.046},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":1.587}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.4590000000000001},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":1.9570000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":2.0009999999999999},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":2.2069999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088476,"kb_used_data":39892,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283364,"statfs":{"total":96636764160,"available":95522164736,"internally_reserved":1073741824,"allocated":40849408,"data_stored":55686955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.7589999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.504},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":2.2949999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.919}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.395},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.9849999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.8889999999999998},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.8090000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":3.508},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.8300000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":4.1029999999999998},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.4279999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143620,"kb_used_data":95036,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228220,"statfs":{"total":96636764160,"available":95465697280,"internally_reserved":1073741824,"allocated":97316864,"data_stored":114681643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":0.999},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":2.3769999999999998}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.504},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.8180000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1899999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.093}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":1.8999999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.0150000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":2.73}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.952},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.5939999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.2549999999999999},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":2.4980000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137624,"kb_used_data":89040,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234216,"statfs":{"total":96636764160,"available":95471837184,"internally_reserved":1073741824,"allocated":91176960,"data_stored":91154219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.474},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":2.0899999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.625}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":2.581},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":1.988}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":2.653},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":3.0169999999999999},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":3.4689999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":3.2410000000000001},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":4.0590000000000002}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":3.0960000000000001},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":3.669}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071460,"kb_used_data":22876,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300380,"statfs":{"total":96636764160,"available":95539589120,"internally_reserved":1073741824,"allocated":23425024,"data_stored":27715371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.2930000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.6499999999999999},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.544}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.024},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.2280000000000002}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":1.8660000000000001},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.8820000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":2.4340000000000002},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":2.7869999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.528},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.2189999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.056},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":3.137}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094200,"kb_used_data":45616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277640,"statfs":{"total":96636764160,"available":95516303360,"internally_reserved":1073741824,"allocated":46710784,"data_stored":56457003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.583},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.631}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.472}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.202}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.8100000000000001},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.3839999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":1.7649999999999999},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":2.625}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":1.859},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":2.0089999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":2.2450000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.286}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073448,"kb_used_data":24864,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298392,"statfs":{"total":96636764160,"available":95537553408,"internally_reserved":1073741824,"allocated":25460736,"data_stored":33314603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.4300000000000002}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.0939999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":2.0339999999999998}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.111},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.2959999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.7090000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.5},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":1.9810000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.6200000000000001},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.3180000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.387},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.8090000000000002}]}]}]}} 2020-06-12T02:37:04.845 INFO:tasks.thrashosds.thrasher:not all PGs are active or peered 2020-06-12T02:37:04.845 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:37:04.846 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:04.936 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:04.929+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:04.990+0000 7fda3eb46700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:04.997 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:04.998 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:04.994+0000 7fda3eb46700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:05.008 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:05.032 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:05.037 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:05.034+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:05.067 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:05.076 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:05.100 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:05.123 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:05.139 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:05.134+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:05.148 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:05.176 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.177 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.177 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:05.177 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:05.177 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.177 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.178 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.178 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.178 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:05.179 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:05.179 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:05.180 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:05.180 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:05.180 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:05.180 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:05.181 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:05.197 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:05.239 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:05.238+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:05.309 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:05.309 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:05.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:05.310 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:05.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.310 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:05.310 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:05.310 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.183658234999996, 2020-06-12T02:37:05.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:37:05.311 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.311 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.311 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.311 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.312 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.312 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:37:05.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.312 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:05.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:05.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:37:05.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:37:05.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:37:05.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:37:05.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:37:05.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:37:05.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:37:05.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:37:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:37:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:37:05.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:37:05.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:37:05.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:37:05.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:37:05.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:37:05.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:37:05.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:37:05.330 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.331 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.331 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.183519298999997, 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.333 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.333 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.333 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:37:05.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.333 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:05.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:05.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:37:05.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:37:05.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:37:05.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:05.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:37:05.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:37:05.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:37:05.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:05.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:37:05.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:37:05.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:37:05.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:37:05.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:37:05.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:37:05.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:37:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:37:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:37:05.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:37:05.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:37:05.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:37:05.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:37:05.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:37:05.347 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.348 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.183383461000005, 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.349 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.350 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:37:05.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.350 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:05.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:05.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:37:05.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:37:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:37:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:37:05.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:37:05.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:37:05.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:37:05.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:05.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:37:05.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:37:05.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:37:05.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:37:05.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:37:05.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:37:05.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:37:05.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:37:05.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:37:05.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:37:05.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:37:05.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:37:05.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.365 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.365 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 94.159718612999995, 2020-06-12T02:37:05.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:37:05.367 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.367 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.367 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:05.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:05.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:37:05.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:37:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:37:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:37:05.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:37:05.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:37:05.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:37:05.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:37:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:37:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:37:05.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:37:05.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:37:05.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:37:05.377 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.377 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.377 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.378 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:37:05.378 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:05.378 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 86.112274702999997, 2020-06-12T02:37:05.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:37:05.378 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.379 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.379 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:37:05.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.380 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:05.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:05.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:37:05.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:37:05.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:37:05.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:37:05.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:37:05.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:37:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:37:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:37:05.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:37:05.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:05.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:37:05.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:37:05.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:37:05.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:37:05.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:37:05.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:37:05.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:37:05.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:37:05.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:37:05.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:37:05.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.394 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.394 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.368537660000001, 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.395 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:05.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:37:05.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:37:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:37:05.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:37:05.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:37:05.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:37:05.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:37:05.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:37:05.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:37:05.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:37:05.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:37:05.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:37:05.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:37:05.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.405 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.406 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:05.406 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:05.406 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.367564290000004, 2020-06-12T02:37:05.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:37:05.407 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.407 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:05.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:37:05.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:37:05.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:37:05.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:37:05.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:37:05.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:37:05.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:37:05.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:37:05.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:37:05.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:37:05.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:37:05.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.417 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.417 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.366355170000006, 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:05.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:37:05.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:37:05.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:37:05.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:37:05.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:37:05.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:37:05.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:37:05.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:37:05.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:37:05.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:37:05.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.365092184999995, 2020-06-12T02:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:37:05.429 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.430 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.430 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:05.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:05.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:37:05.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:37:05.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:37:05.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:37:05.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:37:05.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:37:05.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:37:05.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:37:05.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:37:05.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:37:05.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:37:05.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.440 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.440 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.440 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.353634057999997, 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.441 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:05.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:37:05.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:37:05.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:37:05.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:37:05.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:37:05.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:37:05.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:37:05.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:37:05.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:37:05.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:37:05.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.452 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:37:05.452 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:05.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 59.350633018000003, 2020-06-12T02:37:05.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:37:05.452 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:05.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:05.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:37:05.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:37:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:37:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:37:05.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:37:05.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:37:05.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:37:05.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:37:05.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:37:05.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:37:05.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:37:05.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.462 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.327807018999998, 2020-06-12T02:37:05.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:37:05.464 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.464 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:05.464 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.464 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:05.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:05.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:37:05.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:37:05.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:37:05.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:37:05.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:37:05.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:37:05.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:37:05.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:05.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:37:05.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:37:05.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:37:05.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:37:05.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:37:05.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:37:05.475 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:05.476 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:05.477 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.327661626999998, 2020-06-12T02:37:05.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:37:05.477 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.477 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:05.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:05.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:37:05.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:37:05.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:37:05.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:37:05.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:37:05.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:37:05.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:37:05.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:05.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:37:05.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:37:05.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:37:05.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:37:05.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:37:05.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:37:05.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.491 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:05.491 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:05.491 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.295520347999997, 2020-06-12T02:37:05.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:37:05.491 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.492 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.492 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:05.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:05.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:37:05.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:37:05.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:37:05.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:37:05.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:37:05.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:37:05.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:37:05.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:37:05.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:37:05.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:37:05.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:37:05.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:37:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:37:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:37:05.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:37:05.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:37:05.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:37:05.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.505 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.506 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:05.506 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:05.506 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.290393713, 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:37:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:05.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:37:05.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:37:05.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:37:05.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:37:05.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:37:05.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:37:05.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:37:05.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:37:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:37:05.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:37:05.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:37:05.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:37:05.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:37:05.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:37:05.519 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.519 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:05.520 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.290014702999997, 2020-06-12T02:37:05.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:37:05.521 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.521 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:05.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.522 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.522 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:37:05.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.522 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:05.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:37:05.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:37:05.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:37:05.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:37:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:37:05.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:37:05.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:37:05.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:37:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:37:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:37:05.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:37:05.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:05.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:37:05.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:37:05.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.539 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:05.539 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:05.539 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.289797247999999, 2020-06-12T02:37:05.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:37:05.540 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.540 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:05.540 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.540 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.540 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:05.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:05.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:37:05.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:37:05.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:37:05.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:37:05.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:37:05.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:37:05.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:37:05.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:37:05.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:37:05.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:05.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:37:05.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:37:05.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:37:05.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:37:05.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:37:05.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.552 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:05.553 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:05.553 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.925855003000002, 2020-06-12T02:37:05.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:37:05.553 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.553 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:05.554 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.554 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.554 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.554 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:37:05.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:05.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:37:05.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:37:05.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:37:05.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:37:05.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:37:05.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:37:05.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:37:05.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:37:05.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:37:05.566 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.566 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.566 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.567 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:37:05.567 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:05.567 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.336802216000002, 2020-06-12T02:37:05.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:37:05.568 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.568 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:05.568 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:05.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:05.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:37:05.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:37:05.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:37:05.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:37:05.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:37:05.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:37:05.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:37:05.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:37:05.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:37:05.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:37:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:37:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:05.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:37:05.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:37:05.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:05.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:37:05.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:37:05.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:37:05.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:37:05.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.579 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.580 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:05.580 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:05.581 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.333768642999999, 2020-06-12T02:37:05.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:37:05.581 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:05.581 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:05.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:05.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:05.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:05.582 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:37:05.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.582 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:05.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:05.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:05.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:05.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:05.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:05.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:37:05.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:05.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:37:05.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:37:05.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:05.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:37:05.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:37:05.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:05.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:37:05.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:37:05.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:37:05.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:37:05.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:05.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:37:05.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:37:05.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:37:05.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:37:05.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:05.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:37:05.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:37:05.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:05.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:37:05.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:37:05.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:05.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:37:05.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:37:05.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:05.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:05.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:05.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:37:05.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:37:05.598 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.599 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:05.599 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:05.599 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:05.603 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:05.604 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:05.601+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:05.705 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:05.702+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:05.721 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:05.722 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:05.722 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:05.722 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:05.736 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:05.805 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:05.797+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:05.845 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:05.846 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:05.846 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:05.846 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:05.847 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:05.855 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:05.908 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:05.906+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:06.010 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:06.005+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:06.012 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:37:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.758729015, 2020-06-12T02:37:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:37:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:37:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:37:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:37:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:37:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:37:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:37:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:37:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:37:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:37:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:37:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:37:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:37:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:37:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:37:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:37:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:37:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.757311963000006, 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:37:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:37:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:37:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:37:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:37:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:37:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:37:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:37:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:37:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:37:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:37:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.046747975000002, 2020-06-12T02:37:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:37:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:37:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:37:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:37:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:37:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:37:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:37:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:37:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:37:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:37:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:37:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:37:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:37:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:37:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:37:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:37:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:37:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:37:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:37:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:37:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:37:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.039066673000001, 2020-06-12T02:37:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:37:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:37:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:37:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:37:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:37:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:37:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:37:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:37:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:37:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:37:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:37:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:37:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:37:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:37:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:37:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:37:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:37:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:37:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.030011375999997, 2020-06-12T02:37:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:37:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:37:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:37:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:37:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:37:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:37:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:37:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:37:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:37:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:37:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:37:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:37:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:37:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:37:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:37:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:37:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:37:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.029071836999996, 2020-06-12T02:37:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:37:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:37:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:37:06.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:37:06.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:37:06.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:37:06.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:37:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:37:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:37:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:37:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:37:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:37:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:37:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:37:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:37:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:37:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:37:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.028939889999997, 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:37:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:37:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:37:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:37:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:37:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:37:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:37:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:37:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:37:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:37:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:37:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:37:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:37:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:37:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:37:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.021267592999997, 2020-06-12T02:37:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:37:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:37:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:37:06.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:37:06.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:37:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:37:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:37:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:37:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:37:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:37:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:37:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:37:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:37:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:37:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:37:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.015292627999997, 2020-06-12T02:37:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:37:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:37:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:37:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:37:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:37:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:37:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:37:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:37:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:37:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:37:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:37:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:37:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:37:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:37:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:37:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:37:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:37:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:37:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.008461066000002, 2020-06-12T02:37:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:37:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:37:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:37:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:37:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:37:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:37:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:37:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:37:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:37:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:37:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:37:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:37:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:37:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:37:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:37:06.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:37:06.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:37:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:37:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:37:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:37:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:37:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:37:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:37:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:37:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.007778117000001, 2020-06-12T02:37:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:37:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:37:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:06.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:37:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:37:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:37:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:37:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:37:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:37:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:37:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:37:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:37:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:37:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:37:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:37:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:37:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:37:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:37:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:37:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:37:06.190 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.190 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.190 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.007691354999999, 2020-06-12T02:37:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:37:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:37:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:37:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:37:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:37:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:37:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:37:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:37:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:37:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:37:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:37:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:37:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:37:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:37:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:37:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:37:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:37:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:37:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:37:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:37:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:37:06.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:37:06.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.629297749000003, 2020-06-12T02:37:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:37:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:37:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:37:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:37:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:37:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:37:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:37:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:37:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:37:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:37:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:37:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:37:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:37:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.606875811999998, 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.222 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:37:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:37:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:37:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:37:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:37:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:37:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:37:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:37:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:37:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:37:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:37:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:37:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:37:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:37:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:37:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:37:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:37:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.760901115999999, 2020-06-12T02:37:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:37:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:37:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:37:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:37:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:37:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:37:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:37:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:37:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:37:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:37:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:37:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:37:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:37:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:37:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:37:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:37:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:37:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:37:06.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:37:06.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:37:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:37:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:37:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:37:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:37:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:37:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.760083952000002, 2020-06-12T02:37:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:37:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:37:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:37:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:37:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:37:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:37:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:37:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:37:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:37:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:37:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:37:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:37:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:37:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:37:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:37:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:37:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:37:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:37:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:37:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:37:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:37:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:37:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:37:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:37:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:37:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.284 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:06.284 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:06.284 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.759847311999998, 2020-06-12T02:37:06.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:37:06.285 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.285 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.285 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.285 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.286 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:37:06.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.286 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:06.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:37:06.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:37:06.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:37:06.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:37:06.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:37:06.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:37:06.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:37:06.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:37:06.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:37:06.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:37:06.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:37:06.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:37:06.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:37:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:37:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:37:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:37:06.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:37:06.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:37:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:37:06.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:37:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:37:06.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:37:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.034354381, 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:37:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:37:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:37:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:37:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:37:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:37:06.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:37:06.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:37:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:37:06.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:37:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:37:06.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:37:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:37:06.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:37:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:37:06.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:37:06.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:37:06.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:37:06.317 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.317 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.317 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.318 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:06.318 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:06.318 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.034073567999997, 2020-06-12T02:37:06.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:37:06.319 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.319 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.319 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.320 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.320 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.320 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:37:06.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.321 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:06.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:06.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:37:06.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:37:06.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:37:06.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:37:06.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:37:06.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:37:06.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:37:06.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:37:06.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:37:06.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:37:06.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:37:06.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:06.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:37:06.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:37:06.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:37:06.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:37:06.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:37:06.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:37:06.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:37:06.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:37:06.336 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.336 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.336 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.338 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:37:06.338 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:06.339 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 44.955302332999999, 2020-06-12T02:37:06.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:37:06.339 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:06.339 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:06.340 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:06.340 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:06.340 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.341 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:37:06.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.341 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:06.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:06.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:06.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:06.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:06.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:37:06.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:37:06.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:06.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:37:06.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:37:06.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:06.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:37:06.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:37:06.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:37:06.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:37:06.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:37:06.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:37:06.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:37:06.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:37:06.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:06.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:37:06.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:37:06.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:06.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:37:06.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:37:06.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:06.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:06.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:06.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:37:06.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:37:06.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.360 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:06.361 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:06.361 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:06.364 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:06.365 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:06.357+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:06.464 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:06.457+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:06.485 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:06.485 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:06.486 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:06.486 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:06.501 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:06.566 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:06.562+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:06.622 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:06.622 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:06.623 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:06.629 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:06.672 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:06.670+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:06.770 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:06.761+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:06.792 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.685316427000004, 2020-06-12T02:37:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.685146059999994, 2020-06-12T02:37:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.667008033000002, 2020-06-12T02:37:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:06.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:06.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.661071149999998, 2020-06-12T02:37:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.660562079000002, 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.660403813000002, 2020-06-12T02:37:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:06.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:06.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:06.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:06.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.586007011000007, 2020-06-12T02:37:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.578996188999994, 2020-06-12T02:37:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:06.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.819209646000004, 2020-06-12T02:37:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.819082050000006, 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.404101408999999, 2020-06-12T02:37:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.403956651999998, 2020-06-12T02:37:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.403825802, 2020-06-12T02:37:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.403681480000003, 2020-06-12T02:37:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:07.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:07.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:07.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.403569499, 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.403417013999999, 2020-06-12T02:37:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:07.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:07.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:07.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:07.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:07.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:07.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.382671876000003, 2020-06-12T02:37:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.382346781999999, 2020-06-12T02:37:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:07.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.266700299, 2020-06-12T02:37:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.266360040999999, 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:07.117 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:07.118 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:37:07.120 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:07.114+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:07.120 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:07.182 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:07.221 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:07.217+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:07.286 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:07.286 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:07.287 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:07.287 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:07.287 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:07.278+0000 7f21762ee700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:07.290 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:07.286+0000 7f217508c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:07.298 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:07.306+0000 7f19a23b3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:07.314 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:07.310+0000 7f19a23b3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:07.321 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:07.313+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:07.344 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:07.365 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:07.390 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:07.396 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:07.396 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:07.405 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:07.407 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:07.432 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:07.433 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:07.430+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:07.459 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:07.489 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:07.490 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.493 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.494 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.495 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:07.495 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:07.496 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:07.507 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:07.507 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:07.516 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:07.523 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:07.517+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:07.627 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:07.617+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:07.668 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:07.668 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:07.677 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:07.724 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:07.717+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:07.780 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:07.780 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:07.789 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:07.836 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:07.834+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:07.893 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:07.893 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:07.903 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:07.945 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:07.942+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:08.020 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.021 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.031 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:08.033 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:08.025+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:08.134 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:08.130+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:08.141 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.141 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.160 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:08.173 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:37:08.234 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:08.229+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:08.271 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.272 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.273 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:08.335 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:08.330+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:08.428 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.428 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.443 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:08.434+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:08.443 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:08.537 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:08.529+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:08.547 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.548 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.559 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:08.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:08.641+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:08.710 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.711 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.720 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:08.762 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:08.757+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:08.840 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:08.833+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:08.870 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:08.870 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:08.879 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:08.975 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:08.961+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:09.035 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:09.035 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:09.042 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:09.038+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:09.048 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:09.143 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:09.137+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:09.198 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:09.198 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:09.208 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:09.250 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:09.245+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:09.346 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:09.342+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:09.359 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:09.359 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:09.369 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:09.446 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:09.437+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:09.486 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:09.498 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:09.582 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:09.569+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:09.602+0000 7f10f5f41700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:09.610 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:09.606+0000 7f10f5f41700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:09.642 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:09.642 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:09.642 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:09.662 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:09.649+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:09.662 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:09.664 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:09.678 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:09.704 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:09.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:09.753 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:09.757 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:09.754+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:09.775 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:09.775 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:09.775 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:09.775 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:09.779 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:09.779 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.779 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.779 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:09.780 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:09.780 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.780 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.781 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.781 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.781 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:09.783 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:09.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:09.784 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:09.847 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:37:09.876 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:09.874+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:09.936 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:09.938 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:09.946 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:09.990 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:09.982+0000 7fc74e9b1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:09.991 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:09.986+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:09.995 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:09.990+0000 7fc74d74f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:10.055 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.953981040000002, 2020-06-12T02:37:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:10.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:10.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:10.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:10.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:10.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:10.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:10.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:10.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:10.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:10.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:10.075 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:10.076 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.953810673000007, 2020-06-12T02:37:10.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:10.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.076 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.077 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:10.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:10.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:10.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:10.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:10.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:10.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:10.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:10.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:10.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:10.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.935672646, 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.095 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:10.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:10.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:10.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:10.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:10.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:10.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:10.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:10.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:10.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:10.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:10.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.111 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.929735762999996, 2020-06-12T02:37:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.113 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:10.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.929226692, 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.929068426000001, 2020-06-12T02:37:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.854671624000005, 2020-06-12T02:37:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.847660801999993, 2020-06-12T02:37:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.087874259000003, 2020-06-12T02:37:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.087746663000004, 2020-06-12T02:37:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672766021999998, 2020-06-12T02:37:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672621264999997, 2020-06-12T02:37:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672490414999999, 2020-06-12T02:37:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672346093000002, 2020-06-12T02:37:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672234111999998, 2020-06-12T02:37:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.672081626999997, 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.651336489000002, 2020-06-12T02:37:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.651011394999998, 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.535364911999999, 2020-06-12T02:37:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.535024653999997, 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.405 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:10.406 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:37:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:37:10.409 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2020-06-12T02:37:09.953116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7704428,"kb_used_data":364340,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652898452,"statfs":{"total":676457349120,"available":668568014848,"internally_reserved":7516192768,"allocated":373084160,"data_stored":439248450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002038"},"pg_stats":[{"pgid":"1.f","version":"84'68","reported_seq":"310","reported_epoch":"102","state":"active+clean","last_fresh":"2020-06-12T02:37:00.118878+0000","last_change":"2020-06-12T02:36:44.103918+0000","last_active":"2020-06-12T02:37:00.118878+0000","last_peered":"2020-06-12T02:37:00.118878+0000","last_clean":"2020-06-12T02:37:00.118878+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:37:00.118878+0000","last_undegraded":"2020-06-12T02:37:00.118878+0000","last_fullsized":"2020-06-12T02:37:00.118878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'68","last_scrub_stamp":"2020-06-12T02:36:44.103723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.103723+0000","log_size":68,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8886777,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":21437,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.e","version":"81'90","reported_seq":"73","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.134936+0000","last_change":"2020-06-12T02:36:37.963853+0000","last_active":"2020-06-12T02:37:03.134936+0000","last_peered":"2020-06-12T02:37:03.134936+0000","last_clean":"2020-06-12T02:37:03.134936+0000","last_became_active":"2020-06-12T02:36:31.982116+0000","last_became_peered":"2020-06-12T02:36:31.982116+0000","last_unstale":"2020-06-12T02:37:03.134936+0000","last_undegraded":"2020-06-12T02:37:03.134936+0000","last_fullsized":"2020-06-12T02:37:03.134936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'86","last_scrub_stamp":"2020-06-12T02:36:28.028555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:28.028555+0000","log_size":90,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":22386693,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.d","version":"0'0","reported_seq":"11","reported_epoch":"102","state":"down","last_fresh":"2020-06-12T02:37:00.117367+0000","last_change":"2020-06-12T02:36:40.980461+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-06-12T02:37:00.117367+0000","last_undegraded":"2020-06-12T02:37:00.117367+0000","last_fullsized":"2020-06-12T02:37:00.117367+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.c","version":"88'35","reported_seq":"277","reported_epoch":"102","state":"active+clean","last_fresh":"2020-06-12T02:37:00.117467+0000","last_change":"2020-06-12T02:36:44.869546+0000","last_active":"2020-06-12T02:37:00.117467+0000","last_peered":"2020-06-12T02:37:00.117467+0000","last_clean":"2020-06-12T02:37:00.117467+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:37:00.117467+0000","last_undegraded":"2020-06-12T02:37:00.117467+0000","last_fullsized":"2020-06-12T02:37:00.117467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'35","last_scrub_stamp":"2020-06-12T02:36:44.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.869250+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3762777,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12612,"num_write":15,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.b","version":"94'73","reported_seq":"358","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:06.557673+0000","last_change":"2020-06-12T02:37:06.557673+0000","last_active":"2020-06-12T02:37:06.557673+0000","last_peered":"2020-06-12T02:37:06.557673+0000","last_clean":"2020-06-12T02:37:06.557673+0000","last_became_active":"2020-06-12T02:36:41.995264+0000","last_became_peered":"2020-06-12T02:36:41.995264+0000","last_unstale":"2020-06-12T02:37:06.557673+0000","last_undegraded":"2020-06-12T02:37:06.557673+0000","last_fullsized":"2020-06-12T02:37:06.557673+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'73","last_scrub_stamp":"2020-06-12T02:37:06.557458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:37:06.557458+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8336206,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":30,"num_read_kb":34289,"num_write":36,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8336206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.a","version":"85'21","reported_seq":"85","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.134695+0000","last_change":"2020-06-12T02:36:53.430043+0000","last_active":"2020-06-12T02:37:03.134695+0000","last_peered":"2020-06-12T02:37:03.134695+0000","last_clean":"2020-06-12T02:37:03.134695+0000","last_became_active":"2020-06-12T02:36:41.995085+0000","last_became_peered":"2020-06-12T02:36:41.995085+0000","last_unstale":"2020-06-12T02:37:03.134695+0000","last_undegraded":"2020-06-12T02:37:03.134695+0000","last_fullsized":"2020-06-12T02:37:03.134695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'21","last_scrub_stamp":"2020-06-12T02:36:53.429891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:53.429891+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7159683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.9","version":"88'92","reported_seq":"81","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.135075+0000","last_change":"2020-06-12T02:36:55.406642+0000","last_active":"2020-06-12T02:37:03.135075+0000","last_peered":"2020-06-12T02:37:03.135075+0000","last_clean":"2020-06-12T02:37:03.135075+0000","last_became_active":"2020-06-12T02:36:31.985154+0000","last_became_peered":"2020-06-12T02:36:31.985154+0000","last_unstale":"2020-06-12T02:37:03.135075+0000","last_undegraded":"2020-06-12T02:37:03.135075+0000","last_fullsized":"2020-06-12T02:37:03.135075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'92","last_scrub_stamp":"2020-06-12T02:36:55.406429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:55.406429+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14034149,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":42,"num_write_kb":15786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":23143041,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.8","version":"88'85","reported_seq":"82","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.134797+0000","last_change":"2020-06-12T02:36:41.392685+0000","last_active":"2020-06-12T02:37:03.134797+0000","last_peered":"2020-06-12T02:37:03.134797+0000","last_clean":"2020-06-12T02:37:03.134797+0000","last_became_active":"2020-06-12T02:36:31.984707+0000","last_became_peered":"2020-06-12T02:36:31.984707+0000","last_unstale":"2020-06-12T02:37:03.134797+0000","last_undegraded":"2020-06-12T02:37:03.134797+0000","last_fullsized":"2020-06-12T02:37:03.134797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'85","last_scrub_stamp":"2020-06-12T02:36:41.392546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.392546+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13495005,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":8037,"num_write":35,"num_write_kb":14351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":25932970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.7","version":"86'170","reported_seq":"400","reported_epoch":"103","state":"down","last_fresh":"2020-06-12T02:37:03.134332+0000","last_change":"2020-06-12T02:36:40.985157+0000","last_active":"2020-06-12T02:36:34.949384+0000","last_peered":"2020-06-12T02:36:33.332966+0000","last_clean":"2020-06-12T02:36:28.212298+0000","last_became_active":"2020-06-12T02:36:33.293059+0000","last_became_peered":"2020-06-12T02:36:33.293059+0000","last_unstale":"2020-06-12T02:37:03.134332+0000","last_undegraded":"2020-06-12T02:37:03.134332+0000","last_fullsized":"2020-06-12T02:37:03.134332+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17595493,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":48924,"num_write":75,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"91'81","reported_seq":"321","reported_epoch":"102","state":"active+clean","last_fresh":"2020-06-12T02:37:00.119056+0000","last_change":"2020-06-12T02:36:37.966550+0000","last_active":"2020-06-12T02:37:00.119056+0000","last_peered":"2020-06-12T02:37:00.119056+0000","last_clean":"2020-06-12T02:37:00.119056+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:37:00.119056+0000","last_undegraded":"2020-06-12T02:37:00.119056+0000","last_fullsized":"2020-06-12T02:37:00.119056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'73","last_scrub_stamp":"2020-06-12T02:36:30.051303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:30.051303+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9847642,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":32,"num_read_kb":28345,"num_write":33,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.1","version":"91'48","reported_seq":"295","reported_epoch":"102","state":"active+clean","last_fresh":"2020-06-12T02:37:00.118842+0000","last_change":"2020-06-12T02:36:54.056863+0000","last_active":"2020-06-12T02:37:00.118842+0000","last_peered":"2020-06-12T02:37:00.118842+0000","last_clean":"2020-06-12T02:37:00.118842+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:37:00.118842+0000","last_undegraded":"2020-06-12T02:37:00.118842+0000","last_fullsized":"2020-06-12T02:37:00.118842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'48","last_scrub_stamp":"2020-06-12T02:36:54.056647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:54.056647+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"83","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.134514+0000","last_change":"2020-06-12T02:36:51.476689+0000","last_active":"2020-06-12T02:37:03.134514+0000","last_peered":"2020-06-12T02:37:03.134514+0000","last_clean":"2020-06-12T02:37:03.134514+0000","last_became_active":"2020-06-12T02:36:42.026509+0000","last_became_peered":"2020-06-12T02:36:42.026509+0000","last_unstale":"2020-06-12T02:37:03.134514+0000","last_undegraded":"2020-06-12T02:37:03.134514+0000","last_fullsized":"2020-06-12T02:37:03.134514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:36:51.476479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:51.476479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.2","version":"88'214","reported_seq":"558","reported_epoch":"102","state":"active+clean","last_fresh":"2020-06-12T02:37:00.806997+0000","last_change":"2020-06-12T02:36:41.101523+0000","last_active":"2020-06-12T02:37:00.806997+0000","last_peered":"2020-06-12T02:37:00.806997+0000","last_clean":"2020-06-12T02:37:00.806997+0000","last_became_active":"2020-06-12T02:36:34.964571+0000","last_became_peered":"2020-06-12T02:36:34.964571+0000","last_unstale":"2020-06-12T02:37:00.806997+0000","last_undegraded":"2020-06-12T02:37:00.806997+0000","last_fullsized":"2020-06-12T02:37:00.806997+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'214","last_scrub_stamp":"2020-06-12T02:36:41.101376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.101376+0000","log_size":214,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22113349,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":39,"num_read_kb":27696,"num_write":84,"num_write_kb":29495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":56823939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.3","version":"86'148","reported_seq":"448","reported_epoch":"103","state":"down","last_fresh":"2020-06-12T02:37:03.125889+0000","last_change":"2020-06-12T02:36:40.980118+0000","last_active":"2020-06-12T02:36:34.951718+0000","last_peered":"2020-06-12T02:36:34.003732+0000","last_clean":"2020-06-12T02:36:29.990455+0000","last_became_active":"2020-06-12T02:36:33.289911+0000","last_became_peered":"2020-06-12T02:36:33.289911+0000","last_unstale":"2020-06-12T02:37:03.125889+0000","last_undegraded":"2020-06-12T02:37:03.125889+0000","last_fullsized":"2020-06-12T02:37:03.125889+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":148,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29701358,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":56,"num_read_kb":56070,"num_write":62,"num_write_kb":23647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":48151560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"88'199","reported_seq":"441","reported_epoch":"101","state":"active+clean","last_fresh":"2020-06-12T02:36:57.540645+0000","last_change":"2020-06-12T02:36:40.811641+0000","last_active":"2020-06-12T02:36:57.540645+0000","last_peered":"2020-06-12T02:36:57.540645+0000","last_clean":"2020-06-12T02:36:57.540645+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:36:57.540645+0000","last_undegraded":"2020-06-12T02:36:57.540645+0000","last_fullsized":"2020-06-12T02:36:57.540645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'199","last_scrub_stamp":"2020-06-12T02:36:40.811411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:40.811411+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26861505,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":69,"num_read_kb":85329,"num_write":84,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.5","version":"97'197","reported_seq":"438","reported_epoch":"103","state":"active+clean","last_fresh":"2020-06-12T02:37:03.616931+0000","last_change":"2020-06-12T02:37:03.616931+0000","last_active":"2020-06-12T02:37:03.616931+0000","last_peered":"2020-06-12T02:37:03.616931+0000","last_clean":"2020-06-12T02:37:03.616931+0000","last_became_active":"2020-06-12T02:36:45.011966+0000","last_became_peered":"2020-06-12T02:36:45.011966+0000","last_unstale":"2020-06-12T02:37:03.616931+0000","last_undegraded":"2020-06-12T02:37:03.616931+0000","last_fullsized":"2020-06-12T02:37:03.616931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'197","last_scrub_stamp":"2020-06-12T02:37:03.616781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:37:03.616781+0000","log_size":197,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28971752,"num_objects":13,"num_object_clones":8,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":47,"num_read_kb":38628,"num_write":85,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3],"acting":[4,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421171200,"data_stored":510935040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095432,"kb_used_data":46848,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276408,"statfs":{"total":96636764160,"available":95515041792,"internally_reserved":1073741824,"allocated":47972352,"data_stored":60161212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":2.6909999999999998},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":2.8039999999999998}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":2.2400000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.464},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":1.827}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":3.1190000000000002},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":1.9630000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.5840000000000001},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.5489999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":2.4300000000000002},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.2519999999999998}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.952},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":2.8980000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088500,"kb_used_data":39916,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283340,"statfs":{"total":96636764160,"available":95522140160,"internally_reserved":1073741824,"allocated":40873984,"data_stored":55697997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.7889999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.1419999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":2.2400000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.919}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.5469999999999999},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.3380000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.5880000000000001},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.5470000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.956},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":2.73}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.0190000000000001},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":2.5070000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143656,"kb_used_data":95072,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228184,"statfs":{"total":96636764160,"available":95465660416,"internally_reserved":1073741824,"allocated":97353728,"data_stored":114698256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.423},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.0760000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4180000000000001,"5min":2.4180000000000001,"15min":2.4180000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":5.8300000000000001,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":5.758,"5min":5.758,"15min":5.758},"last":1.242}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1899999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.093}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.728},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":1.931}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.782,"5min":2.782,"15min":2.782},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.835},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.7829999999999999,"15min":2.7829999999999999},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":5.0350000000000001,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":1.8420000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.294},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.0979999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.3900000000000001},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":3.2480000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137660,"kb_used_data":89076,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234180,"statfs":{"total":96636764160,"available":95471800320,"internally_reserved":1073741824,"allocated":91213824,"data_stored":91170832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.843},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.9450000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.625}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":1.639},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":1.429}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":2.0640000000000001},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":2.5880000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":2.1890000000000001},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":2.504}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":3.234},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":2.4470000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":3.0960000000000001},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":3.4980000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071496,"kb_used_data":22912,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300344,"statfs":{"total":96636764160,"available":95539552256,"internally_reserved":1073741824,"allocated":23461888,"data_stored":27731984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.284},{"interface":"front","average":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":2.1659999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.22},{"interface":"front","average":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.51}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.024},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.2280000000000002}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.258,"5min":1.258,"15min":1.258},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":1.9390000000000001},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.3340000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"min":{"1min":1.377,"5min":1.377,"15min":1.377},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":2.7869999999999999},{"interface":"front","average":{"1min":2.843,"5min":2.843,"15min":2.843},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.9289999999999998,"5min":3.9289999999999998,"15min":3.9289999999999998},"last":2.637}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":3.4860000000000002,"5min":3.4860000000000002,"15min":3.4860000000000002},"last":2.516},{"interface":"front","average":{"1min":3.056,"5min":3.056,"15min":3.056},"min":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":3.2010000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":8.7759999999999998,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.0640000000000001},{"interface":"front","average":{"1min":3.073,"5min":3.073,"15min":3.073},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":4.4980000000000002,"5min":4.4980000000000002,"15min":4.4980000000000002},"last":2.738}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094212,"kb_used_data":45628,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277628,"statfs":{"total":96636764160,"available":95516291072,"internally_reserved":1073741824,"allocated":46723072,"data_stored":56462524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.5720000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.798}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.472}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.0270000000000001},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":1.415}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":3.0600000000000001},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":1.9730000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":2.4079999999999999},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":3.448}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":2.73},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":2.879}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.3279999999999998},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":3.71}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073472,"kb_used_data":24888,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298368,"statfs":{"total":96636764160,"available":95537528832,"internally_reserved":1073741824,"allocated":25485312,"data_stored":33325645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.929},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.7090000000000001}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":1.4490000000000001},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.5329999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.111},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.2959999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.7889999999999999},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":2.145}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":1.7250000000000001},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":2.246}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":3.2530000000000001},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":2.3340000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":2.5790000000000002},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.157}]}]}]}} 2020-06-12T02:37:10.410 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:37:10.412 INFO:tasks.thrashosds.thrasher:not all PGs are active or peered 2020-06-12T02:37:10.413 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:10.401+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:10.413 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:10.509 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:10.501+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:10.562 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:10.563 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:10.563 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:10.563 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:10.565 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:10.550+0000 7f9617a2c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:10.570 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:10.566+0000 7f96167ca700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:10.575 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:10.610 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:10.605+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:10.676 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:10.676 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:10.676 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:10.677 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:10.677 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:10.685 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:10.714 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:10.709+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:10.792 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:10.793 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:10.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:10.793 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:10.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.794 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:10.794 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:10.794 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.06909056000001, 2020-06-12T02:37:10.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:10.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.795 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.796 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:10.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.796 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:10.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:10.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:10.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:10.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:10.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:10.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:10.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:10.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:10.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:10.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:10.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:10.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:10.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:10.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:10.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:10.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:10.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:10.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:10.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:10.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:10.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:10.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:10.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.810 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.810 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.639111307999997, 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.812 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.812 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.812 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:10.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.812 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:10.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:10.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:10.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:10.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:10.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:10.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:10.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:10.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:10.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:10.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:10.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:10.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:10.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:10.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:10.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:10.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:10.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:10.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:10.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.823 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.824 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:10.824 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:10.825 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.523148143, 2020-06-12T02:37:10.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:10.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.825 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.825 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:10.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:10.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:10.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:10.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:10.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:10.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:10.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:10.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:10.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:10.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:10.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:10.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:10.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:10.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:10.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:10.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:10.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.838 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.839 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:10.839 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:10.839 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.522771141999996, 2020-06-12T02:37:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.841 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.841 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:10.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.841 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:10.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:10.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:10.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:10.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:10.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:10.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:10.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:10.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:10.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:10.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:10.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:10.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:10.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:10.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:10.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:10.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:10.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:10.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:10.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:10.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.854 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.522361606999993, 2020-06-12T02:37:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.855 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:10.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:10.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:10.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:10.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:10.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:10.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:10.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:10.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:10.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:10.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:10.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:10.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:10.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:10.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:10.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:10.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.874 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.875 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:10.875 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:10.875 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.521969275999993, 2020-06-12T02:37:10.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:10.875 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.876 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.876 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.876 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.876 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.876 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:10.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.877 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:10.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:10.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:10.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:10.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:10.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:10.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:10.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:10.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:10.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:10.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:10.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:10.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:10.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:10.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:10.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:10.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:10.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:10.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:10.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:10.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:10.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:10.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:10.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:10.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.890 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.891 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:10.891 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:10.892 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.505034847999994, 2020-06-12T02:37:10.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:10.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.892 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.892 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.893 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:10.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.893 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:10.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:10.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:10.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:10.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:10.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:10.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:10.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:10.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:10.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:10.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:10.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:10.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:10.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:10.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:10.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:10.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:10.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.908 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:10.908 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:10.908 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.499040249000004, 2020-06-12T02:37:10.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:10.908 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.909 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.909 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.909 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.909 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:10.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.910 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:10.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:10.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:10.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:10.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:10.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:10.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:10.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:10.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:10.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:10.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:10.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:10.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:10.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:10.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:10.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:10.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:10.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:10.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:10.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.923 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:10.923 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:10.923 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.497903675000003, 2020-06-12T02:37:10.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:10.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:10.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.925 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:10.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:10.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:10.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:10.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:10.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:10.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:10.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:10.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:10.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:10.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:10.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:10.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:10.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:10.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:10.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:10.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:10.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:10.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:10.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:10.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:10.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.497721577999997, 2020-06-12T02:37:10.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:10.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.939 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.940 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:10.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.940 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:10.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:10.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:10.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:10.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:10.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:10.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:10.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:10.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:10.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:10.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:10.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:10.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:10.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:10.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:10.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:10.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:10.951 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.952 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:10.953 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:10.953 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.850536255999998, 2020-06-12T02:37:10.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:10.953 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.953 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.954 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.954 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.954 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.954 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:10.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:10.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:10.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:10.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:10.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:10.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:10.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:10.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.967 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:10.967 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:10.967 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.850223866999997, 2020-06-12T02:37:10.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:10.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.969 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:10.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.970 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:10.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.970 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:10.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:10.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:10.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:10.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:10.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:10.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:10.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:10.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:10.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:10.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.985 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:10.985 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:10.985 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.838655274999994, 2020-06-12T02:37:10.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:10.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:10.986 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:10.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:10.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:10.987 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:10.987 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:10.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.987 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:10.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:10.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:10.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:10.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:10.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:10.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:10.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:10.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:10.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:10.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:10.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:10.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:10.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:10.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:10.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:10.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:10.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:10.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:10.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:10.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:10.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:10.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:10.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:10.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:11.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:11.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:11.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:11.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.002 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:11.003 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.838315816999994, 2020-06-12T02:37:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.005 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:11.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.006 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:11.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:11.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:11.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:11.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:11.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:11.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:11.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:11.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:11.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:11.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:11.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:11.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:11.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:11.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:11.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:11.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:11.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:11.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:11.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:11.020 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.020 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.022 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:11.022 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:11.022 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.838019372000005, 2020-06-12T02:37:11.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:11.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:11.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:11.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:11.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:11.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:11.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:11.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:11.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:11.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:11.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:11.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:11.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:11.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:11.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:11.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:11.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:11.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:11.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:11.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:11.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:11.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:11.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:11.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:11.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:11.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.039 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.800985595999997, 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:11.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.041 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:11.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.042 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:11.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:11.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:11.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:11.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:11.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:11.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:11.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:11.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:11.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:11.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:11.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:11.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:11.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:11.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:11.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:11.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.052 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.052 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:11.053 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:11.053 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.793379148, 2020-06-12T02:37:11.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:11.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.053 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.054 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:11.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:11.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:11.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:11.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:11.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:11.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:11.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:11.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:11.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:11.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:11.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:11.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:11.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:11.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:11.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.070 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.071 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:11.071 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:11.071 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.79000061, 2020-06-12T02:37:11.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:11.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.072 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:11.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.073 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:11.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:11.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:11.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:11.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:11.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:11.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:11.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:11.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:11.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:11.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.082 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.083 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:11.083 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:11.084 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.789730356, 2020-06-12T02:37:11.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:11.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.084 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:11.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:11.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:11.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:11.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:11.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:11.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:11.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:11.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:11.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:11.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:11.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:11.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:11.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:11.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.095 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.789549233999999, 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.096 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.097 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.097 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.097 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.097 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:11.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.098 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:11.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:11.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:11.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:11.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:11.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:11.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:11.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:11.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:11.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:11.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:11.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:11.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:11.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.108 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:11.109 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:11.105+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:11.110 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:11.210 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:37:11.210 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:11.206+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:11.233 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:11.234 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:11.234 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:11.234 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:11.263 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:11.346 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:11.342+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:11.410 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:11.428 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:11.429 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:11.421+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:11.537 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:11.522+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:11.582 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:11.583 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:11.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:11.583 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:11.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:11.584 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:11.584 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.45622199899999, 2020-06-12T02:37:11.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:11.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:11.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:11.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:11.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:11.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:11.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:11.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:11.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:11.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:11.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:11.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:11.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:11.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:11.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:11.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:11.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:11.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:11.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:11.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:11.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:11.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:11.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:11.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:11.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.607 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.607 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:11.608 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:11.608 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.455998557, 2020-06-12T02:37:11.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:11.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.610 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:11.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.611 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:11.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:11.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:11.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:11.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:11.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:11.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:11.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:11.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:11.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:11.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:11.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:11.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:11.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:11.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:11.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:11.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:11.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:11.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:11.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:11.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:11.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:11.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:11.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:11.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:11.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.413519448000002, 2020-06-12T02:37:11.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:11.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.630 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.632 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:11.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:11.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:11.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:11.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:11.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:11.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:11.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:11.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:11.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:11.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:11.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:11.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:11.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:11.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:11.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:11.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:11.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:11.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:11.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:11.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:11.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:11.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.649 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.650 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:11.650 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:11.651 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.413184553999997, 2020-06-12T02:37:11.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:11.651 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.651 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.651 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.652 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:11.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:11.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:11.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:11.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:11.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:11.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:11.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:11.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:11.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:11.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:11.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:11.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:11.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:11.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:11.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:11.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:11.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:11.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:11.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:11.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:11.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:11.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:11.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:11.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.671 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.672 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:11.672 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:11.672 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.212308671000002, 2020-06-12T02:37:11.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:11.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.673 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:11.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.675 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:11.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:11.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:11.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:11.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:11.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:11.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:11.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:11.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:11.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:11.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:11.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:11.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:11.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:11.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:11.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:11.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:11.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:11.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:11.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:11.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:11.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:11.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:11.702 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.702 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.702 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.703 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:11.703 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:11.704 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.212148857999999, 2020-06-12T02:37:11.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:11.704 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.705 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.706 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:11.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.706 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:11.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:11.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:11.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:11.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:11.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:11.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:11.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:11.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:11.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:11.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:11.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:11.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:11.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:11.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:11.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:11.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:11.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:11.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:11.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:11.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:11.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:11.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:11.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.728 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:11.729 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.212068145000003, 2020-06-12T02:37:11.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:11.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.731 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:11.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.732 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:11.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:11.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:11.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:11.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:11.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:11.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:11.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:11.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:11.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:11.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:11.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:11.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:11.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:11.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:11.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:11.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:11.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:11.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:11.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:11.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:11.748 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.748 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.750 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:11.750 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:11.750 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.211821592, 2020-06-12T02:37:11.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:11.751 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.751 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.752 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:11.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.753 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:11.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:11.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:11.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:11.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:11.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:11.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:11.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:11.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:11.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:11.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:11.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:11.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:11.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:11.764 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.765 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.765 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.765 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:11.766 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:11.766 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.198471269000002, 2020-06-12T02:37:11.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:11.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.766 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.768 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:11.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:11.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:11.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:11.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:11.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:11.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:11.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:11.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:11.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:11.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:11.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:11.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:11.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:11.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:11.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:11.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:11.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:11.782 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.198285015000003, 2020-06-12T02:37:11.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:11.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.783 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.783 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.783 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.784 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.784 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:11.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.784 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:11.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:11.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:11.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:11.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:11.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:11.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:11.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:11.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:11.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:11.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:11.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:11.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:11.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:11.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:11.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:11.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:11.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:11.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:11.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.799 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:11.799 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:11.799 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.198084303999998, 2020-06-12T02:37:11.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:11.800 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.800 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.800 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.801 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:11.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.801 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:11.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:11.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:11.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:11.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:11.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:11.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:11.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:11.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:11.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:11.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:11.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:11.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:11.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:11.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:11.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:11.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:11.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:11.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:11.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:11.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:11.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:11.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:11.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:11.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.828 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:11.829 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:11.829 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.605596343000002, 2020-06-12T02:37:11.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:11.829 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.830 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:11.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:11.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:11.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:11.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:11.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:11.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:11.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:11.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:11.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:11.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.846 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.847 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:11.847 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:11.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.605172596000003, 2020-06-12T02:37:11.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:11.848 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.848 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.849 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:11.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.850 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:11.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:11.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:11.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:11.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:11.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:11.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:11.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:11.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:11.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:11.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:11.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:11.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:11.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:11.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:11.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:11.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:11.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:11.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:11.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:11.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:11.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:11.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:11.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.872 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:11.872 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:11.872 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.605018737999998, 2020-06-12T02:37:11.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:11.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.873 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:11.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.874 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:11.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.875 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:11.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:11.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:11.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:11.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:11.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:11.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:11.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:11.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:11.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:11.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:11.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:11.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:11.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:11.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:11.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:11.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:11.896 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.896 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.897 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:11.897 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.602287949999997, 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.898 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.899 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.899 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:11.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.899 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:11.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:11.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:11.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:11.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:11.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:11.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:11.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:11.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:11.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:11.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:11.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:11.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:11.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:11.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:11.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:11.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:11.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.910 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:11.911 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:11.911 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.601867622999997, 2020-06-12T02:37:11.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:11.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.911 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:11.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.912 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:11.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:11.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:11.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:11.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:11.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:11.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:11.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:11.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:11.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:11.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:11.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:11.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.601772789999998, 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:11.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:11.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:11.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:11.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:11.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:11.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:11.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:11.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:11.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:11.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:11.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:11.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:11.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:11.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:11.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:11.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.571993436, 2020-06-12T02:37:11.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:11.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.938 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:11.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.939 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:11.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:11.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:11.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:11.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:11.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:11.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:11.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:11.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:11.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:11.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:11.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:11.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:11.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:11.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:11.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:11.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:11.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:11.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.953 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:11.954 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:11.954 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.571527822999997, 2020-06-12T02:37:11.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:11.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:11.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.956 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:11.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:11.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:11.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:11.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:11.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:11.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:11.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:11.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:11.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:11.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:11.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:11.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:11.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:11.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:11.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:11.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:11.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:11.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:11.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:11.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:11.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:11.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:11.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.971 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:11.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.571353887999997, 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:11.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:11.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:11.973 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:11.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.973 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:11.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:11.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:11.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:11.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:11.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:11.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:11.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:11.987 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:11.988 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:11.989 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:11.981+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:11.990 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:12.089 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:12.086+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:12.108 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:12.108 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:12.108 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:12.108 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:12.119 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:12.146 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:12.138+0000 7f67dedc1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:12.151 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:12.146+0000 7f67ddb5f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:12.185 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:12.190 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:12.186+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:12.206 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:12.236 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:12.237 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:12.238 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:12.246 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:12.260 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:12.286 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:12.291 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:12.286+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:12.310 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:12.334 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:12.334 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.335 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.336 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.336 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.336 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:12.338 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:12.338 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:12.351 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:12.352 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:12.361 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:12.392 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:12.390+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:12.468 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:12.468 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:12.479 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:12.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:12.521+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:12.585 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:12.585 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:12.594 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:12.597 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:12.594+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:12.705 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:12.698+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:12.748 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:12.749 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:12.758 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:12.803 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:12.798+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:12.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:12.862 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:12.879 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:12.946 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:12.941+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:13.005 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:12.997+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:13.009 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.010 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.019 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:13.107 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:13.102+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:13.170 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.170 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.180 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:13.224 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:37:13.289 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:13.221+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:13.290 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.290 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.299 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:13.340 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:13.326+0000 7f0191e92700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:13.342+0000 7f0190c30700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:13.348 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:13.341+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:13.399 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.400 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.424 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:13.459 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:13.453+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:13.534 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:13.529+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:13.569 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.569 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.579 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:13.632 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:13.630+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.713 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:13.733 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:13.729+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:13.835 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:13.830+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:13.868 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:13.868 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:13.877 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:13.936 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:13.929+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:14.030 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:14.030 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:14.040 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:14.038+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:14.041 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:14.141 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:14.133+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:14.194 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:14.194 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:14.209 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:37:14.244 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:14.238+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:14.326 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:14.327 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:14.335 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:14.340 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:14.385 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:14.378+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:14.442 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:14.443 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:14.451 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:14.445+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:14.452 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:14.481 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:14.474+0000 7fdbb8259700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:14.485 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:14.482+0000 7fdbb8259700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:14.517 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:14.538 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:14.554 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:14.549+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:14.558 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:14.558 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:14.571 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:14.571 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:14.590 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:14.620 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:14.642 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:14.656 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:14.654+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:14.668 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:14.668 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.669 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.669 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:14.670 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:14.670 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.670 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.670 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.671 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.671 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:14.672 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:14.673 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:14.700 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:14.700 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:14.701 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:14.703 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:14.703 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:14.717 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:14.761 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:14.758+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:14.862 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:14.858+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:14.875 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.749070219, 2020-06-12T02:37:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.748846777, 2020-06-12T02:37:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:14.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:14.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:14.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:14.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:14.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.915 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:14.916 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.706367667999999, 2020-06-12T02:37:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.917 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:14.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:14.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:14.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:14.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:14.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:14.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:14.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:14.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:14.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:14.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:14.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:14.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:14.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:14.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:14.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:14.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:14.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:14.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:14.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:14.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:14.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:14.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:14.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:14.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.706032773999993, 2020-06-12T02:37:14.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:14.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:14.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.939 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:14.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.939 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:14.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:14.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:14.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:14.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:14.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:14.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:14.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:14.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:14.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:14.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:14.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:14.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:14.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:14.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:14.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.956 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:14.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:14.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.505156890999999, 2020-06-12T02:37:14.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:14.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:14.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.965 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:14.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:14.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:14.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:14.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:14.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:14.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:14.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:14.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:14.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:14.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:14.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:14.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:14.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:14.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:14.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:14.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:14.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:14.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:14.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:14.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:14.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.979 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:14.980 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:14.980 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.504997078000002, 2020-06-12T02:37:14.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:14.980 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.980 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.981 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:14.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.504916365, 2020-06-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:14.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:15.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:15.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:15.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:15.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:15.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:15.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.504669812000003, 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:15.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:15.009 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.009 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.009 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.009 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:15.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.010 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:15.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:15.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:15.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:15.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:15.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:15.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:15.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:15.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:15.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:15.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:15.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:15.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:15.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.491319488999999, 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:15.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.034 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:15.035 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:15.035 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.491133235, 2020-06-12T02:37:15.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:15.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.035 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:15.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:15.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:15.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:15.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:15.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:15.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:15.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:15.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:15.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:15.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:15.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:15.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:15.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:15.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:15.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:15.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.490932524000002, 2020-06-12T02:37:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:15.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:15.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:15.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:15.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:15.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:15.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:15.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:15.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:15.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:15.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:15.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:15.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:15.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:15.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:15.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:15.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:15.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:15.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:15.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.063 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.064 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.064 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:15.064 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:15.065 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.898444562999998, 2020-06-12T02:37:15.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:15.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.065 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.065 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:15.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:15.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:15.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:15.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:15.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:15.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:15.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:15.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:15.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:15.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:15.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:15.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:15.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.898020815999999, 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:15.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:15.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:15.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:15.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:15.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:15.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:15.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:15.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:15.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:15.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:15.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:15.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:15.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:15.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.092 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:15.093 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:15.093 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.897866958000002, 2020-06-12T02:37:15.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:15.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.093 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.094 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.094 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.094 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.094 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:15.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:15.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:15.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:15.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:15.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:15.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:15.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:15.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:15.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:15.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:15.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:15.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:15.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.104 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.105 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:15.105 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:15.105 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.895136170000001, 2020-06-12T02:37:15.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:15.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:15.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:15.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:15.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:15.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:15.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:15.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:15.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:15.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:15.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.894715843, 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:15.118 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.118 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.119 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:15.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.119 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:15.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:15.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:15.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:15.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:15.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:15.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:15.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:15.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:15.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:15.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:15.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:15.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:15.129 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.894621010000002, 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:15.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.131 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:15.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:15.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:15.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:15.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:15.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:15.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:15.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:15.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:15.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:15.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:15.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:15.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:15.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:15.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.142 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:15.143 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:15.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.864841656000003, 2020-06-12T02:37:15.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:15.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.143 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:15.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:15.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:15.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:15.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:15.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:15.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:15.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:15.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:15.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:15.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:15.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:15.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:15.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:15.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:15.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:15.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:15.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:15.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:15.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:15.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:15.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:15.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.159 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:15.159 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:15.159 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.864376043, 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:15.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:15.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:15.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:15.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:15.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:15.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:15.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:15.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:15.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:15.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:15.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:15.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:15.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:15.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:15.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:15.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:15.180 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.864202108000001, 2020-06-12T02:37:15.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:15.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:15.181 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:15.181 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:15.181 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:15.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:15.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:15.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:15.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:15.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:15.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:15.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:15.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:15.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:15.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:15.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:15.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.194 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:15.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:15.195 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:15.197 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:15.189+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:15.197 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:15.301 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:15.298+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:15.316 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:15.316 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:15.317 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:15.317 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:15.326 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:15.402 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:15.398+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:15.413 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-06-12T02:37:15.441 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:15.442 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:15.446 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:15.503 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:15.498+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:15.529 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:15.518+0000 7f0337f4c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:15.530+0000 7f0336cea700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:15.560 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.422022821, 2020-06-12T02:37:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.41113144000001, 2020-06-12T02:37:15.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:15.586 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.587 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.409999396, 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.409744211, 2020-06-12T02:37:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.40958502399999, 2020-06-12T02:37:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:15.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:15.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:15.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:15.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:15.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:15.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:15.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:15.671 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.265262445999994, 2020-06-12T02:37:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:15.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:15.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:15.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:15.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.524192948999996, 2020-06-12T02:37:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 71.586490548, 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.702 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:15.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:15.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:15.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:15.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.717 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:15.718 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.604614467999994, 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:15.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:15.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:15.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:15.730 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.604421152, 2020-06-12T02:37:15.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.733 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:15.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:15.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.604272696999999, 2020-06-12T02:37:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:15.746 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:15.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:15.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:15.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:15.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:15.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:15.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:15.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:15.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:15.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:15.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:15.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:15.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:15.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:15.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:15.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:15.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:15.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:15.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:15.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:15.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.766 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.767 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:15.767 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:15.767 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.596839747000004, 2020-06-12T02:37:15.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:15.768 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.768 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.768 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:15.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:15.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:15.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:15.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:15.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:15.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:15.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:15.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:15.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:15.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:15.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:15.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:15.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.788 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.789 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.789 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:15.790 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:15.790 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.594431247000003, 2020-06-12T02:37:15.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:15.790 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.790 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.791 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:15.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:15.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:15.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:15.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:15.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:15.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:15.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:15.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:15.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:15.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:15.802 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:15.802 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.592404102000003, 2020-06-12T02:37:15.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:15.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.803 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:15.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:15.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:15.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:15.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:15.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:15.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:15.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:15.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:15.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:15.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:15.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:15.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.813 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.581354269000002, 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:15.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:15.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:15.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:15.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:15.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:15.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:15.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:15.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:15.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:15.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:15.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:15.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.824 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.825 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:15.825 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:15.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.577141251999997, 2020-06-12T02:37:15.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:15.826 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.826 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.827 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:15.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.827 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:15.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:15.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:15.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:15.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:15.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:15.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:15.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:15.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:15.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:15.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:15.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:15.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:15.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.840 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:15.840 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:15.840 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.576958052999998, 2020-06-12T02:37:15.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.841 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:15.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.842 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:15.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:15.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:15.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:15.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:15.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:15.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:15.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:15.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:15.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:15.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:15.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:15.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:15.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:15.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:15.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:15.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:15.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:15.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:15.856 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.856 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:15.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.120040009, 2020-06-12T02:37:15.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:15.858 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.858 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:15.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:15.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:15.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:15.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:15.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:15.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:15.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:15.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:15.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.868 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.869 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.589578412000002, 2020-06-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.870 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:15.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:15.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:15.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:15.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:15.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:15.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:15.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:15.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:15.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:15.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:15.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:15.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:15.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.884 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.885 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:15.885 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:15.885 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 45.589319293000003, 2020-06-12T02:37:15.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:15.886 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:15.886 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:15.886 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:15.886 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:15.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:15.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:15.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:15.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:15.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:15.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:15.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:15.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:15.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:15.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:15.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:15.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:15.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:15.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:15.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:15.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:15.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:15.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:15.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:15.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:15.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.901 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:15.901 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:15.901 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:15.904 INFO:teuthology.orchestra.run.smithi142.stdout: 2020-06-12T02:37:15.905 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2020-06-12T02:37:14.234282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7704680,"kb_used_data":364592,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652898200,"statfs":{"total":676457349120,"available":668567756800,"internally_reserved":7516192768,"allocated":373342208,"data_stored":439366391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.073391"},"pg_stats":[{"pgid":"1.f","version":"84'68","reported_seq":"313","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.165251+0000","last_change":"2020-06-12T02:36:44.103918+0000","last_active":"2020-06-12T02:37:08.165251+0000","last_peered":"2020-06-12T02:37:08.165251+0000","last_clean":"2020-06-12T02:37:08.165251+0000","last_became_active":"2020-06-12T02:35:25.070973+0000","last_became_peered":"2020-06-12T02:35:25.070973+0000","last_unstale":"2020-06-12T02:37:08.165251+0000","last_undegraded":"2020-06-12T02:37:08.165251+0000","last_fullsized":"2020-06-12T02:37:08.165251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'68","last_scrub_stamp":"2020-06-12T02:36:44.103723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.103723+0000","log_size":68,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8886777,"num_objects":4,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":21437,"num_write":27,"num_write_kb":11501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.e","version":"81'90","reported_seq":"76","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.206049+0000","last_change":"2020-06-12T02:36:37.963853+0000","last_active":"2020-06-12T02:37:09.206049+0000","last_peered":"2020-06-12T02:37:09.206049+0000","last_clean":"2020-06-12T02:37:09.206049+0000","last_became_active":"2020-06-12T02:36:31.982116+0000","last_became_peered":"2020-06-12T02:36:31.982116+0000","last_unstale":"2020-06-12T02:37:09.206049+0000","last_undegraded":"2020-06-12T02:37:09.206049+0000","last_fullsized":"2020-06-12T02:37:09.206049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'86","last_scrub_stamp":"2020-06-12T02:36:28.028555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:28.028555+0000","log_size":90,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11076580,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":52066,"num_write":39,"num_write_kb":10980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":22386693,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.d","version":"0'0","reported_seq":"14","reported_epoch":"105","state":"down","last_fresh":"2020-06-12T02:37:08.167715+0000","last_change":"2020-06-12T02:36:40.980461+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-06-12T02:37:08.167715+0000","last_undegraded":"2020-06-12T02:37:08.167715+0000","last_fullsized":"2020-06-12T02:37:08.167715+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.c","version":"88'35","reported_seq":"280","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.167906+0000","last_change":"2020-06-12T02:36:44.869546+0000","last_active":"2020-06-12T02:37:08.167906+0000","last_peered":"2020-06-12T02:37:08.167906+0000","last_clean":"2020-06-12T02:37:08.167906+0000","last_became_active":"2020-06-12T02:35:25.068002+0000","last_became_peered":"2020-06-12T02:35:25.068002+0000","last_unstale":"2020-06-12T02:37:08.167906+0000","last_undegraded":"2020-06-12T02:37:08.167906+0000","last_fullsized":"2020-06-12T02:37:08.167906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'35","last_scrub_stamp":"2020-06-12T02:36:44.869250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:44.869250+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3762777,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":12612,"num_write":15,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.b","version":"94'73","reported_seq":"361","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.197208+0000","last_change":"2020-06-12T02:37:06.557673+0000","last_active":"2020-06-12T02:37:09.197208+0000","last_peered":"2020-06-12T02:37:09.197208+0000","last_clean":"2020-06-12T02:37:09.197208+0000","last_became_active":"2020-06-12T02:36:41.995264+0000","last_became_peered":"2020-06-12T02:36:41.995264+0000","last_unstale":"2020-06-12T02:37:09.197208+0000","last_undegraded":"2020-06-12T02:37:09.197208+0000","last_fullsized":"2020-06-12T02:37:09.197208+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'73","last_scrub_stamp":"2020-06-12T02:37:06.557458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:37:06.557458+0000","log_size":73,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8336206,"num_objects":5,"num_object_clones":2,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":30,"num_read_kb":34289,"num_write":36,"num_write_kb":9108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8336206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.a","version":"85'21","reported_seq":"88","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.206157+0000","last_change":"2020-06-12T02:36:53.430043+0000","last_active":"2020-06-12T02:37:09.206157+0000","last_peered":"2020-06-12T02:37:09.206157+0000","last_clean":"2020-06-12T02:37:09.206157+0000","last_became_active":"2020-06-12T02:36:41.995085+0000","last_became_peered":"2020-06-12T02:36:41.995085+0000","last_unstale":"2020-06-12T02:37:09.206157+0000","last_undegraded":"2020-06-12T02:37:09.206157+0000","last_fullsized":"2020-06-12T02:37:09.206157+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'21","last_scrub_stamp":"2020-06-12T02:36:53.429891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:53.429891+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2386561,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":8,"num_read_kb":6995,"num_write":6,"num_write_kb":3575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":7159683,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,5],"acting":[1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.9","version":"88'92","reported_seq":"84","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.205938+0000","last_change":"2020-06-12T02:36:55.406642+0000","last_active":"2020-06-12T02:37:09.205938+0000","last_peered":"2020-06-12T02:37:09.205938+0000","last_clean":"2020-06-12T02:37:09.205938+0000","last_became_active":"2020-06-12T02:36:31.985154+0000","last_became_peered":"2020-06-12T02:36:31.985154+0000","last_unstale":"2020-06-12T02:37:09.205938+0000","last_undegraded":"2020-06-12T02:37:09.205938+0000","last_fullsized":"2020-06-12T02:37:09.205938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'92","last_scrub_stamp":"2020-06-12T02:36:55.406429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:55.406429+0000","log_size":92,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14034149,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":42,"num_write_kb":15786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":23143041,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.8","version":"88'85","reported_seq":"85","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.206265+0000","last_change":"2020-06-12T02:36:41.392685+0000","last_active":"2020-06-12T02:37:09.206265+0000","last_peered":"2020-06-12T02:37:09.206265+0000","last_clean":"2020-06-12T02:37:09.206265+0000","last_became_active":"2020-06-12T02:36:31.984707+0000","last_became_peered":"2020-06-12T02:36:31.984707+0000","last_unstale":"2020-06-12T02:37:09.206265+0000","last_undegraded":"2020-06-12T02:37:09.206265+0000","last_fullsized":"2020-06-12T02:37:09.206265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'85","last_scrub_stamp":"2020-06-12T02:36:41.392546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.392546+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13495005,"num_objects":6,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":8037,"num_write":35,"num_write_kb":14351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":25932970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.7","version":"86'170","reported_seq":"403","reported_epoch":"106","state":"down","last_fresh":"2020-06-12T02:37:09.205741+0000","last_change":"2020-06-12T02:36:40.985157+0000","last_active":"2020-06-12T02:36:34.949384+0000","last_peered":"2020-06-12T02:36:33.332966+0000","last_clean":"2020-06-12T02:36:28.212298+0000","last_became_active":"2020-06-12T02:36:33.293059+0000","last_became_peered":"2020-06-12T02:36:33.293059+0000","last_unstale":"2020-06-12T02:37:09.205741+0000","last_undegraded":"2020-06-12T02:37:09.205741+0000","last_fullsized":"2020-06-12T02:37:09.205741+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":170,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17595493,"num_objects":10,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":54,"num_read_kb":48924,"num_write":75,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,7],"acting":[1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.6","version":"91'81","reported_seq":"324","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.165226+0000","last_change":"2020-06-12T02:36:37.966550+0000","last_active":"2020-06-12T02:37:08.165226+0000","last_peered":"2020-06-12T02:37:08.165226+0000","last_clean":"2020-06-12T02:37:08.165226+0000","last_became_active":"2020-06-12T02:35:25.066950+0000","last_became_peered":"2020-06-12T02:35:25.066950+0000","last_unstale":"2020-06-12T02:37:08.165226+0000","last_undegraded":"2020-06-12T02:37:08.165226+0000","last_fullsized":"2020-06-12T02:37:08.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'73","last_scrub_stamp":"2020-06-12T02:36:30.051303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:30.051303+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9847642,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":32,"num_read_kb":28345,"num_write":33,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.1","version":"91'48","reported_seq":"298","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.165197+0000","last_change":"2020-06-12T02:36:54.056863+0000","last_active":"2020-06-12T02:37:08.165197+0000","last_peered":"2020-06-12T02:37:08.165197+0000","last_clean":"2020-06-12T02:37:08.165197+0000","last_became_active":"2020-06-12T02:35:25.065215+0000","last_became_peered":"2020-06-12T02:35:25.065215+0000","last_unstale":"2020-06-12T02:37:08.165197+0000","last_undegraded":"2020-06-12T02:37:08.165197+0000","last_fullsized":"2020-06-12T02:37:08.165197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'48","last_scrub_stamp":"2020-06-12T02:36:54.056647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:54.056647+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5192245,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":24,"num_read_kb":35519,"num_write":16,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"86","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.205918+0000","last_change":"2020-06-12T02:36:51.476689+0000","last_active":"2020-06-12T02:37:09.205918+0000","last_peered":"2020-06-12T02:37:09.205918+0000","last_clean":"2020-06-12T02:37:09.205918+0000","last_became_active":"2020-06-12T02:36:42.026509+0000","last_became_peered":"2020-06-12T02:36:42.026509+0000","last_unstale":"2020-06-12T02:37:09.205918+0000","last_undegraded":"2020-06-12T02:37:09.205918+0000","last_fullsized":"2020-06-12T02:37:09.205918+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:36:51.476479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:51.476479+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.2","version":"88'214","reported_seq":"561","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.929800+0000","last_change":"2020-06-12T02:36:41.101523+0000","last_active":"2020-06-12T02:37:08.929800+0000","last_peered":"2020-06-12T02:37:08.929800+0000","last_clean":"2020-06-12T02:37:08.929800+0000","last_became_active":"2020-06-12T02:36:34.964571+0000","last_became_peered":"2020-06-12T02:36:34.964571+0000","last_unstale":"2020-06-12T02:37:08.929800+0000","last_undegraded":"2020-06-12T02:37:08.929800+0000","last_fullsized":"2020-06-12T02:37:08.929800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'214","last_scrub_stamp":"2020-06-12T02:36:41.101376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:41.101376+0000","log_size":214,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22113349,"num_objects":10,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":39,"num_read_kb":27696,"num_write":84,"num_write_kb":29495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":56823939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.3","version":"86'148","reported_seq":"451","reported_epoch":"106","state":"down","last_fresh":"2020-06-12T02:37:09.197585+0000","last_change":"2020-06-12T02:36:40.980118+0000","last_active":"2020-06-12T02:36:34.951718+0000","last_peered":"2020-06-12T02:36:34.003732+0000","last_clean":"2020-06-12T02:36:29.990455+0000","last_became_active":"2020-06-12T02:36:33.289911+0000","last_became_peered":"2020-06-12T02:36:33.289911+0000","last_unstale":"2020-06-12T02:37:09.197585+0000","last_undegraded":"2020-06-12T02:37:09.197585+0000","last_fullsized":"2020-06-12T02:37:09.197585+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:35:24.033052+0000","log_size":148,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29701358,"num_objects":14,"num_object_clones":8,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":56,"num_read_kb":56070,"num_write":62,"num_write_kb":23647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":48151560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7],"acting":[4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"23","length":"2"},{"start":"30","length":"1"},{"start":"34","length":"1"}]},{"pgid":"1.4","version":"88'199","reported_seq":"445","reported_epoch":"105","state":"active+clean","last_fresh":"2020-06-12T02:37:08.428507+0000","last_change":"2020-06-12T02:36:40.811641+0000","last_active":"2020-06-12T02:37:08.428507+0000","last_peered":"2020-06-12T02:37:08.428507+0000","last_clean":"2020-06-12T02:37:08.428507+0000","last_became_active":"2020-06-12T02:35:25.069777+0000","last_became_peered":"2020-06-12T02:35:25.069777+0000","last_unstale":"2020-06-12T02:37:08.428507+0000","last_undegraded":"2020-06-12T02:37:08.428507+0000","last_fullsized":"2020-06-12T02:37:08.428507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"88'199","last_scrub_stamp":"2020-06-12T02:36:40.811411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:36:40.811411+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26861505,"num_objects":12,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":69,"num_read_kb":85329,"num_write":84,"num_write_kb":22490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]},{"pgid":"1.5","version":"97'197","reported_seq":"441","reported_epoch":"106","state":"active+clean","last_fresh":"2020-06-12T02:37:09.197395+0000","last_change":"2020-06-12T02:37:03.616931+0000","last_active":"2020-06-12T02:37:09.197395+0000","last_peered":"2020-06-12T02:37:09.197395+0000","last_clean":"2020-06-12T02:37:09.197395+0000","last_became_active":"2020-06-12T02:36:45.011966+0000","last_became_peered":"2020-06-12T02:36:45.011966+0000","last_unstale":"2020-06-12T02:37:09.197395+0000","last_undegraded":"2020-06-12T02:37:09.197395+0000","last_fullsized":"2020-06-12T02:37:09.197395+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'197","last_scrub_stamp":"2020-06-12T02:37:03.616781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-06-12T02:35:24.033052+0000","last_clean_scrub_stamp":"2020-06-12T02:37:03.616781+0000","log_size":197,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28971752,"num_objects":13,"num_object_clones":8,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":47,"num_read_kb":38628,"num_write":85,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3],"acting":[4,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"32","length":"1"},{"start":"3a","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"},{"start":"45","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":16,"stat_sum":{"num_bytes":202261399,"num_objects":99,"num_object_clones":57,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":9,"num_read":474,"num_read_kb":455956,"num_write":639,"num_write_kb":209746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":191934092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421171200,"data_stored":510935040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1521,"ondisk_log_size":1521,"up":48,"acting":48,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095468,"kb_used_data":46884,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276372,"statfs":{"total":96636764160,"available":95515004928,"internally_reserved":1073741824,"allocated":48009216,"data_stored":60177975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":2.4700000000000002},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.1699999999999999,"5min":4.1699999999999999,"15min":4.1699999999999999},"last":3.1339999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.855,"5min":1.855,"15min":1.855},"min":{"1min":1.24,"5min":1.24,"15min":1.24},"max":{"1min":4.3860000000000001,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":2.351},{"interface":"front","average":{"1min":2.069,"5min":2.069,"15min":2.069},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.2450000000000001,"5min":3.2450000000000001,"15min":3.2450000000000001},"last":1.96}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.8359999999999999,"5min":2.8359999999999999,"15min":2.8359999999999999},"last":1.464},{"interface":"front","average":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"min":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":1.827}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.583,"5min":1.583,"15min":1.583},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":1.756},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":2.7909999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":3.9380000000000002,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":2.7250000000000001},{"interface":"front","average":{"1min":3.2109999999999999,"5min":3.2109999999999999,"15min":3.2109999999999999},"min":{"1min":1.595,"5min":1.595,"15min":1.595},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":3.298}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"min":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"max":{"1min":5.415,"5min":5.415,"15min":5.415},"last":3.028},{"interface":"front","average":{"1min":3.0329999999999999,"5min":3.0329999999999999,"15min":3.0329999999999999},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.2510000000000003,"5min":4.2510000000000003,"15min":4.2510000000000003},"last":3.5489999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.7809999999999997,"5min":4.7809999999999997,"15min":4.7809999999999997},"last":3.7389999999999999},{"interface":"front","average":{"1min":3.363,"5min":3.363,"15min":3.363},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"max":{"1min":5.5220000000000002,"5min":5.5220000000000002,"15min":5.5220000000000002},"last":3.2490000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088536,"kb_used_data":39952,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283304,"statfs":{"total":96636764160,"available":95522103296,"internally_reserved":1073741824,"allocated":40910848,"data_stored":55714910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.327,"5min":3.327,"15min":3.327},"last":1.5229999999999999}]},{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"min":{"1min":1.262,"5min":1.262,"15min":1.262},"max":{"1min":2.6629999999999998,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":2.5249999999999999},{"interface":"front","average":{"1min":2.2829999999999999,"5min":2.2829999999999999,"15min":2.2829999999999999},"min":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":2.1190000000000002}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.919}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":1.3200000000000001},{"interface":"front","average":{"1min":2.669,"5min":2.669,"15min":2.669},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.4329999999999998,"5min":3.4329999999999998,"15min":3.4329999999999998},"last":2.0430000000000001}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"min":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":2.2130000000000001},{"interface":"front","average":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"min":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"max":{"1min":4.306,"5min":4.306,"15min":4.306},"last":2.6110000000000002}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.052,"5min":3.052,"15min":3.052},"min":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6749999999999998},{"interface":"front","average":{"1min":2.9620000000000002,"5min":2.9620000000000002,"15min":2.9620000000000002},"min":{"1min":1.956,"5min":1.956,"15min":1.956},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":2.9620000000000002}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.5939999999999999,"15min":3.5939999999999999},"min":{"1min":2.895,"5min":2.895,"15min":2.895},"max":{"1min":4.3890000000000002,"5min":4.3890000000000002,"15min":4.3890000000000002},"last":3.0830000000000002},{"interface":"front","average":{"1min":3.468,"5min":3.468,"15min":3.468},"min":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"max":{"1min":5.1120000000000001,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":3.4009999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":114715119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":1.556},{"interface":"front","average":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.637}]},{"osd":1,"last update":"Fri Jun 12 02:37:10 2020","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":2.3690000000000002,"15min":2.4009999999999998},"min":{"1min":1.268,"5min":1.022,"15min":1.022},"max":{"1min":4.1840000000000002,"5min":5.8300000000000001,"15min":5.8300000000000001},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.9930000000000001,"5min":2.2309999999999999,"15min":2.2709999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":2.9750000000000001,"5min":5.758,"15min":5.758},"last":2.1219999999999999}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.117,"15min":2.117},"min":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":4.6950000000000003,"5min":4.6950000000000003,"15min":4.6950000000000003},"last":2.1899999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"min":{"1min":1.254,"5min":1.254,"15min":1.254},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.093}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"min":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"max":{"1min":4.4809999999999999,"5min":4.4809999999999999,"15min":4.4809999999999999},"last":1.7170000000000001},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":4.8369999999999997,"5min":4.8369999999999997,"15min":4.8369999999999997},"last":2.0219999999999998}]},{"osd":5,"last update":"Fri Jun 12 02:37:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.722,"15min":2.762},"min":{"1min":1.2969999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":3.2370000000000001,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":2.6509999999999998},{"interface":"front","average":{"1min":2.4969999999999999,"5min":2.7250000000000001,"15min":2.7629999999999999},"min":{"1min":1.236,"5min":1.236,"15min":1.236},"max":{"1min":4.3899999999999997,"5min":5.0350000000000001,"15min":5.0350000000000001},"last":1.236}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":2.218},{"interface":"front","average":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":5.3689999999999998},"last":2.5630000000000002}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.1259999999999999,"5min":3.1259999999999999,"15min":3.1259999999999999},"min":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":5.0979999999999999,"5min":5.0979999999999999,"15min":5.0979999999999999},"last":2.988},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"min":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":3.085}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137696,"kb_used_data":89112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234144,"statfs":{"total":96636764160,"available":95471763456,"internally_reserved":1073741824,"allocated":91250688,"data_stored":91187695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.544},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":2.242}]},{"osd":2,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.625}]},{"osd":3,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"min":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":3.2360000000000002,"5min":3.2360000000000002,"15min":3.2360000000000002},"last":1.7769999999999999},{"interface":"front","average":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7400000000000002},"last":2.0129999999999999}]},{"osd":4,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.431,"15min":2.431},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":3.7200000000000002,"5min":3.7200000000000002,"15min":3.7200000000000002},"last":1.7230000000000001},{"interface":"front","average":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.6219999999999999,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":1.9119999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":2.7320000000000002},{"interface":"front","average":{"1min":2.827,"5min":2.827,"15min":2.827},"min":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"max":{"1min":4.5880000000000001,"5min":4.5880000000000001,"15min":4.5880000000000001},"last":2.4239999999999999}]},{"osd":6,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":2.2010000000000001},{"interface":"front","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":4.742,"5min":4.742,"15min":4.742},"last":3.1869999999999998}]},{"osd":7,"last update":"Fri Jun 12 02:36:12 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"min":{"1min":1.758,"5min":1.758,"15min":1.758},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":2.988},{"interface":"front","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.411},"max":{"1min":4.0670000000000002,"5min":4.0670000000000002,"15min":4.0670000000000002},"last":2.6659999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071532,"kb_used_data":22948,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93300308,"statfs":{"total":96636764160,"available":95539515392,"internally_reserved":1073741824,"allocated":23498752,"data_stored":27748847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.6299999999999999,"15min":1.6319999999999999},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.462},{"interface":"front","average":{"1min":2.3929999999999998,"5min":1.9159999999999999,"15min":1.8360000000000001},"min":{"1min":1.395,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":2.456}]},{"osd":1,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":1.6519999999999999,"5min":1.9419999999999999,"15min":1.99},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.5590000000000002,"5min":4.0750000000000002,"15min":4.0750000000000002},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.9450000000000001,"5min":2.0219999999999998,"15min":2.0350000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":3.585,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":1.8600000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"min":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":2.024},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.5059999999999998,"15min":2.5059999999999998},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":2.2280000000000002}]},{"osd":3,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":2.512,"5min":2.3570000000000002,"15min":2.331},"min":{"1min":1.2869999999999999,"5min":1.258,"15min":1.258},"max":{"1min":8.6389999999999993,"5min":8.6389999999999993,"15min":8.6389999999999993},"last":2.5190000000000001},{"interface":"front","average":{"1min":3.1720000000000002,"5min":2.802,"15min":2.7400000000000002},"min":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"max":{"1min":8.7919999999999998,"5min":8.7919999999999998,"15min":8.7919999999999998},"last":3.3170000000000002}]},{"osd":4,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.694,"15min":2.71},"min":{"1min":1.579,"5min":1.377,"15min":1.377},"max":{"1min":5.2859999999999996,"5min":5.2859999999999996,"15min":5.2859999999999996},"last":2.819},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8359999999999999,"15min":2.8399999999999999},"min":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":2.7120000000000002}]},{"osd":6,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.5209999999999999,"15min":2.508},"min":{"1min":1.895,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":4.1909999999999998,"5min":4.1909999999999998,"15min":4.1909999999999998},"last":2.2130000000000001},{"interface":"front","average":{"1min":3.0800000000000001,"5min":3.0600000000000001,"15min":3.0569999999999999},"min":{"1min":2.1669999999999998,"5min":2.0289999999999999,"15min":2.0289999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":3.0859999999999999}]},{"osd":7,"last update":"Fri Jun 12 02:37:09 2020","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.5030000000000001,"15min":3.5590000000000002},"min":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":4.8789999999999996,"5min":8.7759999999999998,"15min":8.7759999999999998},"last":3.0310000000000001},{"interface":"front","average":{"1min":2.7400000000000002,"5min":3.0059999999999998,"15min":3.0499999999999998},"min":{"1min":1.516,"5min":1.516,"15min":1.516},"max":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"last":2.927}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094260,"kb_used_data":45676,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277580,"statfs":{"total":96636764160,"available":95516241920,"internally_reserved":1073741824,"allocated":46772224,"data_stored":56484958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.742,"5min":3.742,"15min":3.742},"last":1.4219999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":8.4280000000000008,"5min":8.4280000000000008,"15min":8.4280000000000008},"last":1.7050000000000001}]},{"osd":2,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.472}]},{"osd":3,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"min":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":2.927}]},{"osd":4,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.194,"5min":1.194,"15min":1.194},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.4239999999999999},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"min":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":2.4870000000000001}]},{"osd":5,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"min":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"max":{"1min":3.544,"5min":3.544,"15min":3.544},"last":1.855},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"min":{"1min":2.056,"5min":2.056,"15min":2.056},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":3.04}]},{"osd":6,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"min":{"1min":1.889,"5min":1.889,"15min":1.889},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":3.347},{"interface":"front","average":{"1min":2.9740000000000002,"5min":2.9740000000000002,"15min":2.9740000000000002},"min":{"1min":1.458,"5min":1.458,"15min":1.458},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":2.2330000000000001}]},{"osd":7,"last update":"Fri Jun 12 02:36:09 2020","interfaces":[{"interface":"back","average":{"1min":2.972,"5min":2.972,"15min":2.972},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":3.1360000000000001},{"interface":"front","average":{"1min":3.1619999999999999,"5min":3.1619999999999999,"15min":3.1619999999999999},"min":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":2.665}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073496,"kb_used_data":24912,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298344,"statfs":{"total":96636764160,"available":95537504256,"internally_reserved":1073741824,"allocated":25509888,"data_stored":33336887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":1.611},{"interface":"front","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":4.641,"5min":4.641,"15min":4.641},"last":2.512}]},{"osd":1,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":2.2919999999999998},{"interface":"front","average":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"min":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":2.4049999999999998}]},{"osd":2,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.6529999999999996,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.111},{"interface":"front","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":5.2800000000000002,"5min":5.2800000000000002,"15min":5.2800000000000002},"last":2.2959999999999998}]},{"osd":4,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"min":{"1min":1.601,"5min":1.601,"15min":1.601},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.8240000000000001},{"interface":"front","average":{"1min":2.8119999999999998,"5min":2.8119999999999998,"15min":2.8119999999999998},"min":{"1min":1.675,"5min":1.675,"15min":1.675},"max":{"1min":4.8520000000000003,"5min":4.8520000000000003,"15min":4.8520000000000003},"last":1.8839999999999999}]},{"osd":5,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9289999999999998,"5min":2.9289999999999998,"15min":2.9289999999999998},"min":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"max":{"1min":4.5700000000000003,"5min":4.5700000000000003,"15min":4.5700000000000003},"last":2.8029999999999999},{"interface":"front","average":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":2.9630000000000001}]},{"osd":6,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"min":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":2.5899999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":3.1960000000000002}]},{"osd":7,"last update":"Fri Jun 12 02:36:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"max":{"1min":4.3650000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":3.0510000000000002},{"interface":"front","average":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"min":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"max":{"1min":4.5010000000000003,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":2.5499999999999998}]}]}]}} 2020-06-12T02:37:15.906 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2020-06-12T02:37:15.908 INFO:tasks.thrashosds.thrasher:not all PGs are active or peered 2020-06-12T02:37:15.908 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 122, in wrapper return func(self) File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 1208, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 880, in test_pool_min_size while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'check for active or peered' reached maximum tries (5) after waiting for 25 seconds 2020-06-12T02:37:15.909 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 1076, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 122, in wrapper return func(self) File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 1208, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/ceph_manager.py", line 880, in test_pool_min_size while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'check for active or peered' reached maximum tries (5) after waiting for 25 seconds 2020-06-12T02:37:15.909 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:15.898+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:15.910 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:16.004 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:16.002+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:16.029 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:16.029 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:16.030 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:16.030 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:16.040 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:16.105 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:16.102+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:16.154 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:16.155 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:16.155 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:16.156 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:16.156 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:16.172 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:16.207 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:16.206+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:16.260 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:37:16.282 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:16.283 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:16.284 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.133459403, 2020-06-12T02:37:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:37:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:37:16.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:37:16.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:37:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:37:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:37:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:37:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:37:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:37:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:37:16.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:37:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:37:16.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:37:16.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:37:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:37:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:37:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:37:16.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:37:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:37:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.986945891999994, 2020-06-12T02:37:16.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:37:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:37:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:37:16.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:37:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:37:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:37:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:37:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:37:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:37:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:37:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:37:16.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:37:16.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:37:16.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:37:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:37:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:37:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:37:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:37:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.317 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:16.318 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.309397218000001, 2020-06-12T02:37:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:37:16.319 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.321 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:37:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.324 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:16.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:16.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:37:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:37:16.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:37:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:37:16.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:37:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:37:16.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:37:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:37:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:37:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:37:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:37:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:16.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:37:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:37:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:37:16.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:37:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:37:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:37:16.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:37:16.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:37:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:37:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:37:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:37:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:37:16.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:37:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:37:16.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.344 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.308633290000003, 2020-06-12T02:37:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:37:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.345 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:37:16.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:37:16.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:37:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:37:16.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:37:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:37:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:37:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:37:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:37:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:37:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:37:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:37:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:37:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:37:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:16.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:37:16.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:37:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:37:16.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:37:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:37:16.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.085828234999994, 2020-06-12T02:37:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:37:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.362 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:37:16.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:16.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:16.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:37:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:37:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:37:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:37:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:37:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:37:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:37:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:37:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:37:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:37:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:37:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:37:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:37:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:37:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:37:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:37:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:37:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.379 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.077541948000004, 2020-06-12T02:37:16.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:37:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:16.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:37:16.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:37:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:37:16.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:37:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:37:16.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:37:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:37:16.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:37:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:37:16.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:37:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:37:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:37:16.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:37:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:37:16.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:37:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:37:16.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:37:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:37:16.397 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.398 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.070512703999995, 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.399 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:37:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.400 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:16.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:16.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:37:16.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:37:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:37:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:37:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:37:16.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:37:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:37:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:37:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:37:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:37:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:37:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:37:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:37:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:37:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:37:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:37:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:37:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:37:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:37:16.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:16.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 72.070375252999995, 2020-06-12T02:37:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:37:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:37:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:37:16.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:37:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:37:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:37:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:37:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:37:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:37:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:37:16.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:37:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:37:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:37:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:16.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:37:16.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:37:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:37:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:37:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:37:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:37:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:37:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:37:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.434 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:16.435 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 67.269587513999994, 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.436 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:37:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:37:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:37:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:37:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:37:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:37:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:16.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:37:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:37:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:37:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:37:16.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:37:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:37:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:37:16.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:37:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:37:16.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:37:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:37:16.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:37:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:37:16.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:37:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:37:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:37:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.456 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 67.269440900000006, 2020-06-12T02:37:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:37:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.457 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.458 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:37:16.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:37:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:37:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:37:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:37:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:37:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:37:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:37:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:37:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:37:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:37:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:37:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:37:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:37:16.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:37:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:37:16.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:37:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.313428025999997, 2020-06-12T02:37:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:37:16.473 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.474 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:16.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:16.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:37:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:37:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:37:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:37:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:37:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:37:16.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:37:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:37:16.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:37:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:37:16.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:37:16.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:37:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:37:16.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:37:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:37:16.486 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.307696513000003, 2020-06-12T02:37:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:37:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.488 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:37:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:37:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:37:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:37:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:37:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:37:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:37:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:37:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:37:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:37:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:37:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:37:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:37:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:37:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:37:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:37:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:37:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.307202996999997, 2020-06-12T02:37:16.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.503 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:37:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:37:16.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:37:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:37:16.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:37:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:37:16.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:37:16.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:37:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:37:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:37:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:37:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:37:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:37:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:37:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:37:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:37:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:37:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:16.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:37:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:37:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:37:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:37:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.517 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:16.518 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.307108990000003, 2020-06-12T02:37:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:37:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:37:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:37:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:37:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:37:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:37:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:37:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:37:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:37:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:37:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:37:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:16.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:37:16.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:37:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:37:16.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:37:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:37:16.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:37:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.268947961000002, 2020-06-12T02:37:16.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:37:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:37:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:37:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:37:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:37:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:37:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:37:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:37:16.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:37:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:37:16.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:37:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:37:16.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:37:16.542 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.543 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 55.228150968000001, 2020-06-12T02:37:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:37:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.544 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:37:16.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:37:16.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:37:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:37:16.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:37:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:37:16.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:37:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:37:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:37:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:37:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:37:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:37:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.554 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:16.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 55.227908902000003, 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:37:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:37:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:37:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:37:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:37:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:37:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:37:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:37:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:37:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:37:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:37:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:37:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:37:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:37:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 55.227699211000001, 2020-06-12T02:37:16.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:37:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:16.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:16.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:37:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:37:16.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:37:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:37:16.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:37:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:37:16.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:37:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:37:16.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:37:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:37:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:37:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:37:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:37:16.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:37:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:37:16.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.580 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:37:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 55.212165050000003, 2020-06-12T02:37:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:37:16.581 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.582 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:37:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:37:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:37:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:37:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:37:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:37:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:37:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:37:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:37:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:37:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:37:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:37:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:37:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:37:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 46.314105015999999, 2020-06-12T02:37:16.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:16.594 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:37:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:16.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:16.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:37:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:16.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:37:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:37:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:37:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:37:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:37:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:37:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:37:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:37:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:16.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:37:16.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:37:16.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:37:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:37:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:37:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:37:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.611 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.611 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.611 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:16.611 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:16.611 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:16.613 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:16.370+0000 7f842340f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:16.613 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:16.386+0000 7f84221ad700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:16.614 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:16.609+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:16.614 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:16.674 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:16.720 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:16.718+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:16.772 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:16.773 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:16.789 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:16.778+0000 7f34aaae8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:16.790 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:16.799 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:16.786+0000 7f34a9886700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:16.815 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:16.810+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:16.827 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:16.849 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:16.874 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:16.899 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:16.915 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:16.909+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:16.918 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:16.918 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:16.918 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:16.918 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:16.919 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:16.924 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:16.935 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:16.950 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:16.975 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:16.976 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.976 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.976 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:16.976 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:16.977 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.977 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.977 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.977 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.977 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:16.978 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:16.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:17.026 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:17.021+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:17.094 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.095 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.104 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:17.151 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:17.141+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:17.226 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:17.222+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:17.252 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:37:17.273 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.273 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.283 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:17.334 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:17.329+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:17.390 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.390 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.399 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:17.430 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:17.426+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:17.531 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:17.526+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:17.551 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.551 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.561 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:17.638 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:17.633+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:17.679 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.680 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.690 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:17.739 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:17.733+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:17.795 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.796 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.805 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:17.854 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:17.850+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:17.907 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:17.907 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:17.916 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:17.960 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:17.958+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:18.050 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:18.046+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:18.068 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.068 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.078 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:18.164 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:18.162+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:18.229 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.229 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.238 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:18.280 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:18.278+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:18.356 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:18.353+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:18.386 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.389 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.395 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:18.460 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:18.453+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:18.516 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.516 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.530 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:18.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:18.557+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:18.653 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.653 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.662 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:18.658+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:18.663 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:18.763 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:18.757+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:18.814 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.814 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.823 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:18.865 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:18.862+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:18.946 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:18.947 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:18.957 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:18.966 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:18.962+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:18.982 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:19.067 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:19.061+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:19.068 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:19.068 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:19.077 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:19.097 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:19.090+0000 7f2522b45700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:19.101 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:19.098+0000 7f25218e3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:19.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:19.154 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:19.168 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:19.161+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:19.181 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:19.205 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:19.238 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:19.243 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.10505335800001, 2020-06-12T02:37:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.094161977, 2020-06-12T02:37:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.270 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:19.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.271 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:19.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:19.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:19.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:19.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:19.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.093029933, 2020-06-12T02:37:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.092774748, 2020-06-12T02:37:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.092615561, 2020-06-12T02:37:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:19.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 102.948292983, 2020-06-12T02:37:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.207223486000004, 2020-06-12T02:37:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.269521084999994, 2020-06-12T02:37:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.287645005000002, 2020-06-12T02:37:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.287451688999994, 2020-06-12T02:37:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:19.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:19.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:19.419 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.420 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.422 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.423 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:19.423 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:19.423 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.287303234000007, 2020-06-12T02:37:19.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:19.423 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.424 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.424 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.424 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.424 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.425 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:19.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.425 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:19.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:19.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:19.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:19.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:19.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:19.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:19.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:19.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:19.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:19.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:19.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:19.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:19.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:19.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:19.438 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.438 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.439 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:19.439 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.279870283999998, 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:19.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:19.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:19.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:19.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:19.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:19.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:19.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:19.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.449 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:19.449 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:19.449 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.277461783999996, 2020-06-12T02:37:19.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:19.449 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.450 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:19.450 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:19.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:19.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:19.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:19.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:19.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:19.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:19.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:19.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:19.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:19.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:19.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:19.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:19.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:19.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:19.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.462 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.462 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.462 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:19.463 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:19.463 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.275434638999997, 2020-06-12T02:37:19.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:19.464 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.464 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:19.464 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:19.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:19.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:19.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:19.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:19.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:19.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:19.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:19.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:19.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:19.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:19.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:19.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:19.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:19.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:19.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.477 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.478 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.478 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:19.478 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 73.264384805999995, 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:19.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:19.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:19.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:19.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:19.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:19.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:19.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:19.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:19.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:19.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:19.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:19.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:19.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:19.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:19.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.489 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.490 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:19.490 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:19.490 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.260171788999997, 2020-06-12T02:37:19.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:19.491 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.491 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.491 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.491 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.492 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:19.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.492 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:19.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:19.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:19.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:19.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:19.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:19.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:19.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:19.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:19.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:19.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:19.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:19.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:19.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:19.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:19.504 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.505 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.505 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.259988590000006, 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.506 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.507 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.507 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:19.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.507 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:19.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:19.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:19.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:19.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:19.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:19.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:19.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:19.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:19.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:19.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:19.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:19.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:19.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:19.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:19.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.520 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.803070546000001, 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.521 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:19.522 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:19.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:19.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:19.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:19.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:19.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:19.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:19.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:19.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:19.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:19.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:19.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:19.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:19.532 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.272608949000002, 2020-06-12T02:37:19.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:19.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:19.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:19.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:19.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:19.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:19.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:19.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:19.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:19.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:19.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:19.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:19.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:19.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:19.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:19.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.546 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:19.546 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:19.546 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 49.272349830000003, 2020-06-12T02:37:19.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:19.547 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:19.547 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:19.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:19.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:19.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:19.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:19.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:19.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:19.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:19.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:19.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:19.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:19.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:19.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:19.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:19.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:19.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:19.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:19.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:19.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:19.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:19.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:19.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:19.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:19.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:19.560 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.561 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:19.561 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:19.561 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:19.562 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:37:19.564 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:19.564 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.565 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.566 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.566 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.566 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:19.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:19.567 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:19.567 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:19.558+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:19.568 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:19.664 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:19.662+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:19.665 INFO:tasks.daemonwatchdog.daemon_watchdog:OSDThrasher failed 2020-06-12T02:37:19.665 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-06-12T02:37:19.666 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/github.com_tchaikov_ceph_octopus-py3/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 254, in __getattr__ raise AttributeError(name) AttributeError: mounts 2020-06-12T02:37:19.720 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:19.721 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:19.721 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:19.721 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:19.726 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:19.714+0000 7fe5c1ca3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:19.729 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:19.726+0000 7fe5c0a41700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:19.730 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:19.777 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:19.773+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:19.843 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:19.844 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:19.850 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:19.894 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:19.889+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:19.966 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:19.962+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:20.012 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.861876404, 2020-06-12T02:37:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:37:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:37:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:37:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:37:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:37:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:37:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:37:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:37:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:37:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.71536289300001, 2020-06-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.037814218999998, 2020-06-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:37:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:37:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:37:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:37:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:37:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:37:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:37:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:37:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:37:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:37:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:37:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:37:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:37:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:37:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:37:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:37:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:37:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:37:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:37:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:37:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:37:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:37:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.037050291, 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:37:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:37:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:37:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:37:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:37:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:37:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:37:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:37:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:37:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:37:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:37:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:37:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:37:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:37:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:37:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:37:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:37:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:37:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:37:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:37:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:37:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:37:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:37:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.814245236000005, 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.092 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:37:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.093 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:37:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:37:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:37:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:37:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:37:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:37:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:37:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:37:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:37:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:37:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:37:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:37:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:37:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:37:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.805958949000001, 2020-06-12T02:37:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:37:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:37:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:37:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:37:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:37:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:37:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:37:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:37:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:37:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:37:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:37:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:37:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:37:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:37:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:37:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.798929705000006, 2020-06-12T02:37:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:37:20.124 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.125 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:20.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:20.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:37:20.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:37:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:37:20.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:37:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:37:20.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:37:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:37:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:37:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:37:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:37:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:37:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:37:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:37:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.798792254000006, 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:37:20.138 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.139 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:20.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:20.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:37:20.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:37:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:37:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:37:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:37:20.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:37:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:37:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:37:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:37:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:37:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:37:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.998004515000005, 2020-06-12T02:37:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:37:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:37:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:37:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:37:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:37:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:37:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:37:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:37:20.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:37:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:37:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:37:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:37:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:37:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:37:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:37:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:37:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.167 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.997857901000003, 2020-06-12T02:37:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:37:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.168 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.169 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.169 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.169 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.169 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:37:20.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:20.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:20.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:37:20.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:37:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:37:20.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:37:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:37:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:37:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:37:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:37:20.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:37:20.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:37:20.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:37:20.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:37:20.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:37:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:37:20.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:37:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.041845026999994, 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.184 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:37:20.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:20.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:37:20.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:37:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:37:20.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:37:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:37:20.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:37:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:37:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:37:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:37:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:37:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:37:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:37:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:37:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:20.198 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.036113513999993, 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:37:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:37:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:37:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:37:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:37:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:37:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:37:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:37:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:37:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:37:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:37:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:37:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:37:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:37:20.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:37:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:37:20.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.212 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.035619998000001, 2020-06-12T02:37:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:37:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.213 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:37:20.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:37:20.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:37:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:37:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:37:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:37:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:37:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:37:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:37:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:37:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:37:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:37:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:37:20.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:37:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.035525991, 2020-06-12T02:37:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:37:20.227 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:37:20.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:20.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:37:20.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:37:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:37:20.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:37:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:37:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:37:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:37:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:37:20.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:37:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:37:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.997364962000006, 2020-06-12T02:37:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:37:20.240 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:20.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:20.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:37:20.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:37:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:37:20.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:37:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:37:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:37:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:37:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.956567968999998, 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:37:20.251 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.252 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:37:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:20.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:37:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:37:20.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:37:20.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:37:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:37:20.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:37:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:37:20.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:37:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:37:20.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:37:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:37:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.261 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:20.262 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.956325903, 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.263 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:37:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:37:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:37:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:37:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:37:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:37:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:37:20.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:37:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:37:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:37:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:37:20.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.273 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.956116211999998, 2020-06-12T02:37:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:37:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.274 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.275 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:37:20.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:37:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:37:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:37:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:37:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:37:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:37:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:37:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:37:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:37:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 58.940582051, 2020-06-12T02:37:20.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:37:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.286 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.287 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:37:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:37:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:37:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:37:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:37:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:37:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:37:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:37:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:37:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:37:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 50.042522017000003, 2020-06-12T02:37:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:37:20.297 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:37:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:37:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:37:20.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:37:20.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:37:20.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:37:20.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:37:20.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:37:20.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:37:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:37:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.308 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.309 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:37:20.311 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:20.305+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:20.311 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:20.411 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:20.410+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:20.468 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:20.468 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:20.468 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:20.469 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:20.478 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:20.522 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:20.517+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:20.595 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:20.596 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:20.597 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:20.638 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:20.633+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:20.714 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:20.710+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:20.752 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.62480913100001, 2020-06-12T02:37:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:37:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:37:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:37:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:37:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:37:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:37:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:37:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:37:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:37:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:37:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:37:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:37:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:37:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:37:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:37:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:37:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:37:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:37:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:37:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:37:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:37:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:37:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:37:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.62467019499999, 2020-06-12T02:37:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:37:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:37:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:37:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:37:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:37:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:37:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:37:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:37:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:37:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:37:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:37:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:37:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:37:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:37:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:37:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:37:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:37:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:37:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:37:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:37:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:37:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:37:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.624534357, 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:37:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:37:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:37:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:37:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:37:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:37:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:37:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:37:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:37:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:37:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:37:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:37:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:37:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:37:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:37:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:37:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:37:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:37:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:37:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:37:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:37:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:37:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.60086950900001, 2020-06-12T02:37:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:37:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:37:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:37:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:37:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:37:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:37:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:37:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:37:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:37:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:37:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:37:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:37:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:37:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:37:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:37:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:37:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:37:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:37:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:37:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 101.55342559899999, 2020-06-12T02:37:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:37:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:37:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:37:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:37:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:37:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:37:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:37:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:37:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:37:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:37:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:37:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:37:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:37:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:37:20.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:37:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:37:20.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:37:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:37:20.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:37:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:37:20.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:37:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:37:20.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:37:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:37:20.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:37:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:37:20.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:37:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:20.860 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.809688555999998, 2020-06-12T02:37:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:37:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.861 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:37:20.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:37:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:37:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:37:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:37:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:37:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:37:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:37:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:37:20.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:37:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:37:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:37:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:37:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:37:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:37:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:20.873 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.808715186000001, 2020-06-12T02:37:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:37:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.874 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:37:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:37:20.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:37:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:37:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:37:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:37:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:37:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:37:20.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:37:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:37:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:37:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:37:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:37:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.887 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:20.888 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.807506066000002, 2020-06-12T02:37:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:37:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:37:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:37:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:37:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:37:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:37:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:37:20.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:37:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:37:20.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:37:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:37:20.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:37:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:37:20.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:37:20.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.900 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.806243081000005, 2020-06-12T02:37:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:37:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:37:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:37:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:37:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:37:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:37:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:37:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:37:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:37:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:37:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:37:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:37:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:37:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:37:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:37:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:20.914 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.794784953999994, 2020-06-12T02:37:20.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:37:20.915 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.915 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.915 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:37:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:37:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:37:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:37:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:37:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:37:20.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:37:20.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:37:20.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:37:20.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:37:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:37:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:37:20.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:37:20.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:37:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:37:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:37:20.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:37:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:37:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 74.791783914000007, 2020-06-12T02:37:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:37:20.927 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:37:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:37:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:37:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:37:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:37:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:37:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:37:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:37:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:37:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:37:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:37:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:37:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:37:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:37:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:37:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:20.939 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.768957915000001, 2020-06-12T02:37:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:37:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.940 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:37:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:37:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:37:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:37:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:37:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:37:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:37:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:37:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:37:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:37:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:37:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:37:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:37:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:37:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:37:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:37:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:37:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:37:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:37:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:37:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.952 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:20.953 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.768812522999994, 2020-06-12T02:37:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:37:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:20.954 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:37:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.955 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:37:20.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:37:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:37:20.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:37:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:37:20.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:37:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:37:20.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:37:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:37:20.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:37:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:37:20.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:37:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:37:20.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:37:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:37:20.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:37:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:37:20.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:37:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:37:20.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:37:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:37:20.967 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.968 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.736671243999993, 2020-06-12T02:37:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:37:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.969 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:37:20.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:20.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:20.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:37:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:37:20.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:37:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:37:20.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:37:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:37:20.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:37:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:37:20.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:37:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:37:20.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:37:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:37:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:37:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:37:20.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:37:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:37:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:37:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:37:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:37:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:37:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:37:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.731544608999997, 2020-06-12T02:37:20.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:37:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:20.985 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:37:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:37:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:37:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:37:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:37:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:37:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:37:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:37:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:37:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:37:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:37:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:37:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:37:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:37:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:37:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:37:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:37:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:37:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:37:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:37:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:37:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:37:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:20.998 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:20.999 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.731165598999993, 2020-06-12T02:37:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:37:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:37:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:37:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:37:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:37:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:37:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:37:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:37:21.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:37:21.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:37:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:37:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:37:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:37:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:37:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:37:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:37:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:37:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:37:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:37:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:37:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:37:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:37:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:37:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:21.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.730948143999996, 2020-06-12T02:37:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:37:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:37:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:37:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:37:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:37:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:37:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:37:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:37:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:37:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:37:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:37:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:37:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:37:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:37:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:37:21.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:37:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:37:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:37:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:37:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:37:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:37:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.367005899000006, 2020-06-12T02:37:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:37:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:37:21.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:37:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:37:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:37:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:37:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:37:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:37:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:37:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:37:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:37:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:37:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:37:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:37:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:37:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.041 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:37:21.042 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.777953111999999, 2020-06-12T02:37:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:37:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:21.043 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:37:21.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:37:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:37:21.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:37:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:37:21.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:37:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:37:21.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:37:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:37:21.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:37:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:37:21.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:37:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:37:21.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.774919539000003, 2020-06-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:21.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:37:21.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:37:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:37:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:37:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:37:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:37:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:37:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:37:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:37:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:21.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:37:21.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:37:21.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:37:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:37:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:37:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:37:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:37:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:37:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:37:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:37:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.071 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.071 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:21.072 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:21.073 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:21.065+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:21.174 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:21.170+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:21.188 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:21.188 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:21.189 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:21.198 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:21.276 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:21.270+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:21.310 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:21.311 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:21.311 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:21.311 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:21.311 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:21.320 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:21.376 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:21.374+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:21.428 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:21.428 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:21.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:21.429 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:21.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.429 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:37:21.430 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:21.430 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 97.175094709000007, 2020-06-12T02:37:21.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:37:21.431 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.431 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.431 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.432 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.432 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:37:21.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.432 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:21.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:21.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:37:21.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:37:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:37:21.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:37:21.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:37:21.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:37:21.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:37:21.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:37:21.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:37:21.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:37:21.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:37:21.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:37:21.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:37:21.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:37:21.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:37:21.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:37:21.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:37:21.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:37:21.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:37:21.446 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.447 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.447 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:37:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 97.173677656999999, 2020-06-12T02:37:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:37:21.448 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:37:21.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.450 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:21.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:21.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:37:21.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:37:21.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:37:21.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:37:21.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:37:21.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:37:21.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:37:21.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:37:21.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:37:21.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:37:21.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:37:21.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:37:21.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:37:21.460 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.460 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.461 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.461 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.461 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:21.462 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.463113668999995, 2020-06-12T02:37:21.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:37:21.462 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.463 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.463 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:21.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:21.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:37:21.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:37:21.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:37:21.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:37:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:37:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:37:21.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:37:21.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:37:21.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:37:21.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:37:21.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:37:21.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:37:21.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:37:21.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:37:21.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:37:21.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:37:21.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:37:21.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:37:21.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:37:21.479 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.479 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.480 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.480 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.481 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:21.481 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.455432367, 2020-06-12T02:37:21.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:37:21.482 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.482 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.482 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.483 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.483 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:37:21.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.483 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:21.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:37:21.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:37:21.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:37:21.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:37:21.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:37:21.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:37:21.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:37:21.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:37:21.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:37:21.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:37:21.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:37:21.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:37:21.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:37:21.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:37:21.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:37:21.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:37:21.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:37:21.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:37:21.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:37:21.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:37:21.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:37:21.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:37:21.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:37:21.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:37:21.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:37:21.500 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.501 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.501 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.501 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.502 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:21.502 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.446377069999997, 2020-06-12T02:37:21.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:37:21.502 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.502 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.503 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.504 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.504 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.504 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:37:21.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.505 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:21.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:21.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:37:21.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:37:21.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:37:21.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:37:21.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:37:21.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:37:21.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:37:21.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:37:21.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:37:21.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:37:21.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:37:21.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:37:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:37:21.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:37:21.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:37:21.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:37:21.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:37:21.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:37:21.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:37:21.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:37:21.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:37:21.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:37:21.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:37:21.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:37:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:37:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:21.524 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.445437530999996, 2020-06-12T02:37:21.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:37:21.525 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.525 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.525 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.526 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.526 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:37:21.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.526 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:21.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:37:21.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:37:21.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:37:21.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:37:21.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:37:21.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:37:21.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:37:21.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:37:21.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:37:21.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:37:21.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:37:21.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:37:21.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:37:21.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:37:21.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:37:21.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:37:21.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:37:21.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:37:21.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:37:21.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:37:21.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:37:21.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:37:21.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:37:21.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:37:21.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:37:21.543 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.543 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.543 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.544 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:21.544 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:21.545 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.445305583999996, 2020-06-12T02:37:21.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:37:21.545 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.546 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.546 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.547 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:37:21.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.548 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:21.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:21.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:37:21.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:37:21.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:37:21.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:37:21.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:37:21.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:37:21.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:37:21.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:37:21.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:37:21.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:37:21.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:37:21.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:37:21.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:37:21.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:37:21.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:37:21.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:37:21.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:37:21.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:37:21.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:37:21.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:37:21.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:37:21.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:37:21.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:37:21.565 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.565 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.565 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.566 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.566 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:21.567 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.437633286999997, 2020-06-12T02:37:21.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:37:21.567 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.567 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.568 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:37:21.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.569 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:21.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:21.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:37:21.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:37:21.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:37:21.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:37:21.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:37:21.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:37:21.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:37:21.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:37:21.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:37:21.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:37:21.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:37:21.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:37:21.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:37:21.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:37:21.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:37:21.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:37:21.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:37:21.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:37:21.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:37:21.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.588 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.588 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:21.588 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.431658322000004, 2020-06-12T02:37:21.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:37:21.589 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.589 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.590 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.590 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:37:21.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:21.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:21.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:37:21.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:37:21.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:21.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:37:21.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:37:21.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:37:21.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:37:21.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:37:21.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:37:21.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:37:21.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:37:21.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:37:21.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:37:21.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:37:21.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:37:21.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:37:21.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:37:21.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:37:21.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.605 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.606 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:21.606 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.424826760000002, 2020-06-12T02:37:21.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:37:21.606 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.606 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.607 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:37:21.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.608 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:21.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:21.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:37:21.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:37:21.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:37:21.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:37:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:37:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:37:21.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:37:21.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:37:21.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:37:21.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:37:21.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:37:21.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:37:21.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:37:21.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:37:21.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:37:21.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:37:21.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:37:21.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:37:21.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:37:21.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.622 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.424143810999993, 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:37:21.623 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.624 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.625 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:37:21.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.625 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:21.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:21.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:37:21.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:37:21.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:37:21.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:37:21.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:37:21.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:37:21.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:37:21.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:37:21.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:37:21.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:37:21.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:37:21.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:37:21.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:37:21.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:37:21.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:37:21.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:37:21.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:37:21.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:37:21.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:37:21.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:37:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:37:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:37:21.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:37:21.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:37:21.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:37:21.643 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.643 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.643 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.644 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:21.646 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:21.646 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.424057048999998, 2020-06-12T02:37:21.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:37:21.646 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.647 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.647 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.647 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.647 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.647 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:37:21.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.648 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:21.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:21.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:37:21.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:37:21.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:37:21.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:37:21.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:37:21.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:37:21.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:37:21.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:37:21.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:37:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:37:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:37:21.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:37:21.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:37:21.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:37:21.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:37:21.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:37:21.661 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.661 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.661 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:21.662 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 66.045663442999995, 2020-06-12T02:37:21.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:37:21.663 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.663 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.663 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.663 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:21.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:21.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:37:21.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:37:21.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:37:21.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:37:21.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:37:21.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:37:21.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:37:21.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:37:21.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:37:21.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:37:21.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:37:21.673 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.673 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.673 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 66.023241506000005, 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.674 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.675 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.675 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.675 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.675 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:37:21.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.676 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:21.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:37:21.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:37:21.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:37:21.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:37:21.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:37:21.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:21.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:37:21.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:37:21.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:37:21.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:37:21.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:37:21.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:37:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:37:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:37:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:37:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 62.177266809999999, 2020-06-12T02:37:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:37:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:37:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:37:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:37:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:37:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:37:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:37:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:37:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:37:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:37:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:37:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:37:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:37:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:37:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:37:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:37:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:37:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:37:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:37:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 62.176449646000002, 2020-06-12T02:37:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:37:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:37:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:37:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:37:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:37:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:37:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:37:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:37:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:37:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:37:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:37:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:37:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:37:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:37:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:37:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:37:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:37:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:37:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:37:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:37:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:37:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:37:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:37:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 62.176213005999998, 2020-06-12T02:37:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:37:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:37:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:37:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:37:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:37:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:37:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:37:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:37:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:37:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:37:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:37:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:37:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:37:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:37:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:37:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:37:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:37:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:37:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:37:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:37:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:37:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.450720075, 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:37:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:37:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:37:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:37:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:37:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:37:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:37:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:37:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:37:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:37:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:37:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:37:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:37:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:37:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:37:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:37:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:37:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:37:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:37:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.450439262000003, 2020-06-12T02:37:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:37:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:37:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:37:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:37:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:37:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:37:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:37:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:37:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:37:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:37:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:37:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:37:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:37:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:37:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:37:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:37:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:37:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:37:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:37:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:37:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 60.371668026999998, 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:21.775 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:21.776 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:37:21.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.776 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:21.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:21.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:21.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:21.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:21.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:21.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:37:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:37:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:37:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:37:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:37:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:37:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:37:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:37:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:37:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:37:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:37:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:37:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:37:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:21.789 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:21.790 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:21.792 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:21.789+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:21.792 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:21.891 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:21.885+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:21.902 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:21.898+0000 7fd9bc9b1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:21.906 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:21.906 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:21.907 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:21.907 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:21.907 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:21.902+0000 7fd9bc9b1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:21.917 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:21.937 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:21.962 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:21.980 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:21.994 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:21.985+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:22.003 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:22.018 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.018 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.028 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:22.029 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:22.053 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:22.077 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:22.077 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.077 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.078 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:22.078 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:22.078 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.078 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.078 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.079 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.079 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:22.081 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:22.081 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:22.124 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:22.122+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:22.134 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.134 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.144 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:22.194 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:22.189+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:22.294 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:22.289+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:22.299 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.299 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.309 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:22.312 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:37:22.396 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:22.394+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:22.413 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.414 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.423 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:22.458 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:22.446+0000 7f8e881d3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:22.462 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:22.458+0000 7f8e86f71700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:22.496 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:22.493+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.557 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.566 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:22.608 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:22.606+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:22.699 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:22.693+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:22.717 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.718 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.725 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:22.800 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:22.797+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:22.835 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.835 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.845 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:22.901 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:22.898+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:22.949 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:22.949 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:22.958 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:23.017 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:23.009+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:23.075 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.076 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.092 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:23.130 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:23.125+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:23.226 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:23.222+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:23.250 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.250 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.253 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:23.293 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:37:23.330 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:23.325+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:23.370 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.370 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.382 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:23.431 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:23.430+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:23.531 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:23.526+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:23.536 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.537 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.546 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:23.632 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:23.630+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:23.648 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.649 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.668 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:23.760 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:23.749+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:23.808 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.809 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.818 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:23.871 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:23.865+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:23.939 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:23.933+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:23.988 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:23.989 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:23.998 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:24.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:24.045+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:24.082 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:24.141 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:24.133+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:24.167 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:24.167 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:24.175 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:24.198 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:24.194+0000 7f234672c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:24.203 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:24.198+0000 7f234672c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:24.246 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:24.247 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:24.242+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:24.258 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:24.279 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:24.302 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:24.325 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:24.330 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:24.331 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:24.348 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:24.349 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:24.350 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:24.345+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:24.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:24.378 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.379 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.379 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:24.379 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:24.379 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.379 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.380 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.380 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.380 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:24.380 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:24.381 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:24.450 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:24.446+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:24.452 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:24.452 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:24.461 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:24.551 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:24.545+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:24.570 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:24.571 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:24.571 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:24.571 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:24.574 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:24.585 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:24.652 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:24.650+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:24.746 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:24.746 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:24.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:24.746 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:24.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.747 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:37:24.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:24.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.491983797, 2020-06-12T02:37:24.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:37:24.748 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.748 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:24.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.749 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:37:24.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:24.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:37:24.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:37:24.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:37:24.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:37:24.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:37:24.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:37:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:37:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:37:24.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:37:24.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:37:24.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:37:24.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:37:24.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:37:24.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:37:24.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:37:24.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:37:24.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:37:24.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:37:24.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:37:24.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.773 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.774 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.774 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:37:24.775 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:24.775 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.490566745, 2020-06-12T02:37:24.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:37:24.775 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.778 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:24.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.780 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:37:24.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.781 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:24.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:24.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:37:24.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:37:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:37:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:37:24.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:37:24.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:37:24.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:37:24.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:37:24.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:37:24.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:37:24.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:37:24.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:37:24.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:37:24.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.791 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.792 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.793 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.793 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:24.793 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.780002757000005, 2020-06-12T02:37:24.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:37:24.793 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.794 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.794 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:37:24.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.795 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:24.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:24.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:37:24.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:37:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:37:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:37:24.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:37:24.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:37:24.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:37:24.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:37:24.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:37:24.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:37:24.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:37:24.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:37:24.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:37:24.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:37:24.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:37:24.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:37:24.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:37:24.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:37:24.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:37:24.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:37:24.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:37:24.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:37:24.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:37:24.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.810 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.810 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.772321454999997, 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.812 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:37:24.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.812 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:24.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:24.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:37:24.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:37:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:37:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:37:24.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:37:24.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:37:24.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:37:24.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:37:24.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:37:24.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:37:24.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:37:24.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:37:24.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:37:24.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:37:24.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:37:24.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:37:24.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:37:24.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:37:24.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:37:24.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:37:24.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:37:24.827 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.763266157999993, 2020-06-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:37:24.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.831 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:37:24.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:37:24.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:37:24.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:37:24.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:37:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:37:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:37:24.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:37:24.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:37:24.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:37:24.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:37:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:37:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:37:24.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:37:24.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:37:24.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:37:24.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:37:24.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:37:24.845 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.845 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.845 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.846 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.846 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:24.846 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.762326619000007, 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.847 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.848 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:37:24.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.848 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:24.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:24.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:37:24.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:37:24.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:37:24.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:37:24.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:37:24.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:37:24.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:37:24.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:37:24.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:37:24.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:37:24.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:37:24.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:37:24.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:37:24.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:37:24.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:37:24.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:37:24.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:37:24.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:37:24.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:37:24.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:37:24.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:37:24.862 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.862 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:24.863 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.762194672000007, 2020-06-12T02:37:24.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:37:24.864 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.864 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:24.864 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.864 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.865 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.865 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:37:24.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.865 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:24.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:37:24.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:37:24.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:37:24.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:37:24.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:37:24.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:37:24.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:37:24.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:37:24.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:37:24.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:37:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:37:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:37:24.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:37:24.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:37:24.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:37:24.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:37:24.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:37:24.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.878 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.879 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.879 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:24.880 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.754522374999993, 2020-06-12T02:37:24.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:37:24.880 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.881 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.881 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.881 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.881 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.881 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:37:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:24.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:24.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:37:24.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:37:24.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:37:24.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:37:24.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:37:24.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:37:24.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:37:24.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:37:24.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:37:24.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:37:24.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:37:24.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:37:24.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:37:24.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:37:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:37:24.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.894 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:24.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.74854741, 2020-06-12T02:37:24.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:37:24.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.896 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.896 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:37:24.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.897 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:24.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:24.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:37:24.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:37:24.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:24.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:37:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:37:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:37:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:37:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:37:24.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:37:24.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:37:24.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:37:24.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:37:24.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:37:24.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:37:24.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:37:24.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:37:24.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:37:24.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.910 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.911 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.911 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:24.912 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.741715847999998, 2020-06-12T02:37:24.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:37:24.912 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.912 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.912 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:24.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:37:24.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:37:24.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:37:24.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:37:24.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:37:24.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:37:24.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:37:24.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:37:24.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:37:24.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:37:24.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:37:24.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:37:24.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:37:24.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:37:24.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:37:24.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:37:24.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:37:24.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:37:24.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:37:24.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:37:24.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.927 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.741032899000004, 2020-06-12T02:37:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:37:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.929 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.930 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.930 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:37:24.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.930 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:24.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:24.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:37:24.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:37:24.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:37:24.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:37:24.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:37:24.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:37:24.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:37:24.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:37:24.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:37:24.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:37:24.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:37:24.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:37:24.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:37:24.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:37:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:37:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:37:24.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:37:24.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:37:24.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:37:24.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:37:24.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:37:24.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:37:24.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:37:24.947 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.947 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.947 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.948 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:24.948 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:24.948 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 78.740946136999995, 2020-06-12T02:37:24.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:37:24.949 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.949 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:24.949 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.949 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.950 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.950 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:37:24.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.950 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:24.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:37:24.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:37:24.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:37:24.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:37:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:37:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:37:24.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:37:24.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:37:24.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:37:24.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:37:24.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:37:24.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:37:24.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:37:24.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:24.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:37:24.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:37:24.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:37:24.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:37:24.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:37:24.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:37:24.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.963 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.964 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:24.964 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:24.964 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.362552531000006, 2020-06-12T02:37:24.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:37:24.965 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.965 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:24.965 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.965 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:24.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:37:24.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:37:24.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:37:24.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:37:24.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:37:24.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:37:24.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:37:24.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:37:24.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:37:24.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:37:24.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.975 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:37:24.976 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:24.976 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.340130594000001, 2020-06-12T02:37:24.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:37:24.976 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.976 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.977 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:37:24.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.978 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:24.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:37:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:37:24.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:37:24.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:37:24.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:37:24.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:24.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:37:24.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:37:24.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:37:24.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:37:24.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:37:24.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:24.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:37:24.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:37:24.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:24.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:37:24.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:37:24.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:24.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:37:24.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:37:24.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:24.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:37:24.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:37:24.990 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.990 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:24.990 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.494155898000002, 2020-06-12T02:37:24.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:37:24.992 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:24.992 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:24.992 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:24.992 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:24.992 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:24.993 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:37:24.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.993 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:24.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:24.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:24.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:37:24.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:24.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:37:24.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:37:24.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:24.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:37:24.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:37:24.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:24.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:37:24.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:37:24.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:24.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:37:24.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:37:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:37:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:37:25.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:37:25.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:37:25.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:37:25.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:37:25.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:37:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:37:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:25.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:37:25.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:37:25.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.006 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:25.007 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:25.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.493338734000005, 2020-06-12T02:37:25.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:37:25.008 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:25.008 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:25.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:25.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.009 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:37:25.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:25.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:25.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:37:25.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:25.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:37:25.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:37:25.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:25.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:37:25.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:37:25.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:37:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:37:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:37:25.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:37:25.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:37:25.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:37:25.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:37:25.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:37:25.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:37:25.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:37:25.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:25.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:37:25.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:37:25.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.023 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.023 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.023 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:25.024 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:25.024 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.493102093999994, 2020-06-12T02:37:25.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:37:25.025 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:25.025 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:25.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:25.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:25.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:25.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:25.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:25.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:37:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:37:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:37:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:37:25.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:37:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:37:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:37:25.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:37:25.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:37:25.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:37:25.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:37:25.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:37:25.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:37:25.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:37:25.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:25.039 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:25.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.767609163000003, 2020-06-12T02:37:25.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:37:25.040 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:25.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:25.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:25.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:25.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:25.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:25.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:25.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:25.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:37:25.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:25.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:37:25.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:37:25.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:25.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:37:25.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:37:25.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:37:25.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:37:25.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:37:25.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:37:25.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:37:25.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:37:25.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:37:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:37:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 64.76732835, 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:37:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:37:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:37:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:37:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:37:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:37:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:37:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:37:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:37:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:37:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:37:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:37:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:37:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:37:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 63.688557115000002, 2020-06-12T02:37:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:37:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:37:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:37:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:25.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:37:25.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:37:25.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:25.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:37:25.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:37:25.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:37:25.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:37:25.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:37:25.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:37:25.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:37:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:37:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:37:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:37:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:25.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:25.079 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:25.079 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:25.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:25.073+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:25.081 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:25.182 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:25.178+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:25.199 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:25.199 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:25.200 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:25.209 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:25.282 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:25.277+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:25.306 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:37:25.376 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:25.377 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:25.377 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:25.377 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:25.377 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:25.384 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:25.377+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:25.386 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:25.419 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:25.406+0000 7fc8a6596700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:25.423 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:25.418+0000 7fc8a5334700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:25.484 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:25.481+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:25.491 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:25.491 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:25.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:25.491 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.39021930200001, 2020-06-12T02:37:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:25.493 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.493 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.494 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:25.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.494 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:25.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:25.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:25.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:25.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:25.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:25.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:25.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:25.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:25.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:25.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:25.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:25.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:25.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:25.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:25.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.508 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:25.508 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:25.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.390048935, 2020-06-12T02:37:25.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.509 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:25.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.510 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:25.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:25.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:25.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:25.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:25.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:25.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:25.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:25.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:25.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:25.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:25.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:25.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:25.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:25.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:25.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:25.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:25.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.371910908, 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.524 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.525 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:25.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.525 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:25.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:25.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:25.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:25.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:25.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:25.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:25.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:25.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:25.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:25.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:25.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:25.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:25.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:25.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:25.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:25.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:25.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:25.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:25.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:25.539 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:25.539 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.365974025, 2020-06-12T02:37:25.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:25.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.540 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.540 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:25.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.541 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:25.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:25.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:25.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:25.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:25.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:25.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:25.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:25.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:25.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:25.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:25.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:25.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:25.553 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:25.553 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.365464954, 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:25.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:25.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:25.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:25.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:25.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:25.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:25.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:25.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:25.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:25.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:25.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:25.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:25.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:25.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:25.567 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.365306688, 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.568 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:25.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:25.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:25.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:25.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:25.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:25.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.29090988599999, 2020-06-12T02:37:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.581 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.582 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:25.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:25.600 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.283899064, 2020-06-12T02:37:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.601 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:25.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:25.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:25.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.615 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:25.616 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.524112521000006, 2020-06-12T02:37:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.617 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:25.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:25.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:25.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:25.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:25.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:25.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:25.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:25.638 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.523984924999993, 2020-06-12T02:37:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.639 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:25.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.109004283999994, 2020-06-12T02:37:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.108859527000007, 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.108728677000002, 2020-06-12T02:37:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.108584355000005, 2020-06-12T02:37:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.108472374000002, 2020-06-12T02:37:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.108319889000001, 2020-06-12T02:37:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:25.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:25.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.087574751000005, 2020-06-12T02:37:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:25.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:25.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:25.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:25.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:25.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:25.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:25.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:25.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:25.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:25.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:25.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:25.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:25.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:25.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:25.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:25.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:25.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:25.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:25.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:25.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:25.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:25.769 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.769 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.770 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.771 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:25.771 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:25.771 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.087249657000001, 2020-06-12T02:37:25.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:25.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.772 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.772 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.772 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.773 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.773 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:25.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.773 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:25.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:25.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:25.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:25.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:25.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:25.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:25.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:25.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:25.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:25.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:25.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:25.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:25.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:25.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:25.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:25.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:25.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:25.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:25.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:25.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:25.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:25.788 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:25.789 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 65.971603173999995, 2020-06-12T02:37:25.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:25.789 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.789 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:25.789 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.790 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.790 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.790 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:25.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.790 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:25.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:25.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:25.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:25.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:25.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:25.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:25.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:25.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:25.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:25.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:25.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:25.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:25.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:25.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:25.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:25.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:25.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:25.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:25.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:25.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:25.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:25.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.816 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:25.817 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:25.817 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 65.971262916000001, 2020-06-12T02:37:25.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:25.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:25.818 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:25.818 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:25.819 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:25.819 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:25.819 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:25.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.820 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:25.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:25.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:25.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:25.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:25.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:25.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:25.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:25.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:25.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:25.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:25.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:25.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:25.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:25.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:25.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:25.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:25.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:25.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:25.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:25.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:25.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:25.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:25.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:25.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:25.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:25.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:25.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:25.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:25.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:25.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:25.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:25.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:25.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:25.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:25.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:25.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:25.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:25.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:25.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:25.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.842 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.843 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.843 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:25.843 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:25.844 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:25.846 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:25.848 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:25.842+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:25.947 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:25.945+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:26.004 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:26.012 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:26.012 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:26.012 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:26.014 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:26.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:26.041+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:26.136 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:26.137 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:26.146 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:26.149 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:26.141+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:26.251 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:26.245+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:26.276 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:26.276 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:26.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:26.277 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:26.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.277 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:26.278 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:26.278 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.536701339, 2020-06-12T02:37:26.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:26.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.278 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.279 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:26.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:26.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:26.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:26.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:26.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:26.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:26.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:26.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:26.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:26.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:26.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:26.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:26.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:26.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:26.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:26.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:26.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:26.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:26.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.306 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:26.306 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:26.306 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 112.10672208699999, 2020-06-12T02:37:26.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:26.306 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.307 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:26.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.308 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:26.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:26.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:26.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:26.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:26.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:26.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:26.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:26.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:26.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:26.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:26.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.319 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:26.320 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:26.320 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.990758922, 2020-06-12T02:37:26.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:26.320 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.320 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.321 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:26.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:26.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:26.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:26.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:26.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:26.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:26.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:26.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:26.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:26.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:26.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:26.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:26.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:26.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:26.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:26.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:26.333 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.333 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.333 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.99038192099999, 2020-06-12T02:37:26.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.335 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.336 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:26.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.336 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:26.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:26.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:26.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:26.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:26.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:26.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:26.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:26.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:26.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:26.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:26.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:26.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:26.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:26.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:26.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:26.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:26.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:26.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:26.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:26.351 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:26.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.98997238600001, 2020-06-12T02:37:26.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:26.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.353 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.353 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.353 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:26.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.354 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:26.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:26.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:26.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:26.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:26.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:26.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:26.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:26.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:26.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:26.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:26.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:26.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:26.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:26.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:26.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.368 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.369 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:26.369 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:26.369 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.989580055, 2020-06-12T02:37:26.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.370 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:26.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:26.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:26.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:26.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:26.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:26.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:26.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:26.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:26.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:26.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:26.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:26.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:26.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:26.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:26.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:26.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:26.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.385 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.385 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:26.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:26.386 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.97264562700001, 2020-06-12T02:37:26.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:26.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.387 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:26.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.388 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:26.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:26.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:26.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:26.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:26.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:26.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:26.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:26.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:26.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:26.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:26.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:26.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:26.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:26.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.966651028, 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.404 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.404 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:26.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.404 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:26.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:26.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:26.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:26.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:26.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:26.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:26.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:26.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:26.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:26.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:26.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:26.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:26.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:26.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:26.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:26.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:26.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:26.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:26.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.965514454, 2020-06-12T02:37:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.419 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:26.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:26.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:26.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:26.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:26.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:26.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:26.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:26.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:26.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:26.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:26.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:26.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:26.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:26.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:26.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:26.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:26.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:26.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:26.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:26.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:26.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.436 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.437 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:26.437 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:26.438 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.96533235699999, 2020-06-12T02:37:26.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:26.438 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:26.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.439 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:26.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:26.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:26.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:26.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:26.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:26.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:26.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:26.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:26.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:26.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:26.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:26.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:26.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:26.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:26.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:26.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:26.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:26.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.453 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:26.453 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:26.453 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.318147035, 2020-06-12T02:37:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.455 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:26.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.455 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:26.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:26.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:26.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:26.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:26.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:26.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:26.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:26.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:26.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:26.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:26.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:26.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:26.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:26.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:26.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:26.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:26.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:26.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:26.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:26.468 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.468 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.469 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.471 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:26.471 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:26.471 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.31783464599999, 2020-06-12T02:37:26.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:26.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.472 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:26.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.474 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:26.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.474 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:26.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:26.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:26.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:26.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:26.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:26.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:26.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:26.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:26.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:26.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:26.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:26.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:26.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:26.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:26.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:26.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:26.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:26.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:26.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:26.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:26.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:26.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.306266054000005, 2020-06-12T02:37:26.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:26.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:26.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.489 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:26.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:26.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:26.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:26.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:26.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:26.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:26.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:26.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:26.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:26.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:26.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:26.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:26.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:26.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:26.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:26.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:26.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:26.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:26.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:26.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:26.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:26.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.305926596000006, 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:26.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:26.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:26.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:26.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:26.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:26.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:26.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:26.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:26.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:26.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:26.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:26.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:26.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:26.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:26.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:26.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:26.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:26.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:26.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:26.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:26.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.305630151000003, 2020-06-12T02:37:26.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:26.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.525 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:26.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:26.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:26.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:26.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:26.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:26.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:26.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:26.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:26.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:26.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:26.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:26.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:26.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:26.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:26.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:26.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:26.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:26.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:26.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:26.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:26.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:26.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:26.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:26.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:26.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:26.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:26.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:26.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.268596375000001, 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.545 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:26.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.545 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:26.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:26.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:26.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:26.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:26.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:26.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:26.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:26.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:26.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:26.555 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:26.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.260989926999997, 2020-06-12T02:37:26.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:26.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:26.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:26.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.557 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:26.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:26.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:26.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:26.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:26.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:26.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:26.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:26.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:26.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:26.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:26.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.257611388999997, 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:26.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:26.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.570 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:26.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:26.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:26.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:26.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:26.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:26.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:26.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:26.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:26.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:26.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:26.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:26.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:26.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:26.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:26.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:26.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:26.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.583 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:26.584 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:26.584 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.257341134999997, 2020-06-12T02:37:26.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:26.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:26.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:26.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:26.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:26.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:26.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:26.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:26.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:26.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:26.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:26.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:26.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:26.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:26.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:26.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:26.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:26.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:26.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:26.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.600 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:26.600 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:26.601 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.257160012999996, 2020-06-12T02:37:26.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:26.601 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:26.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:26.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:26.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:26.602 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:26.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:26.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.603 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:26.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:26.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:26.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:26.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:26.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:26.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:26.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:26.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:26.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:26.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:26.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:26.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:26.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:26.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:26.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:26.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:26.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:26.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:26.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:26.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:26.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:26.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:26.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:26.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:26.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:26.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:26.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:26.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:26.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:26.619 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:26.619 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:26.619 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:26.620 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:26.622 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:37:26.623 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:26.617+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:26.722 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:26.717+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:26.775 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:26.770+0000 7f46bf694700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:26.778 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:26.774+0000 7f46bf694700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:26.781 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:26.782 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:26.792 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:26.814 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:26.823 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:26.817+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:26.838 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:26.856 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:26.879 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:26.893 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:26.893 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:26.903 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:26.904 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:26.923 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:26.917+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:26.939 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:26.977 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:26.978 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.978 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.978 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:26.978 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:26.978 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.979 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.979 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.979 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.979 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:26.980 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:26.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:27.015 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.016 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.029 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:27.046 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:27.021+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:27.130 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:27.125+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:27.162 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.163 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.172 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:27.231 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:27.226+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:27.323 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.324 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.332 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:27.330+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:27.334 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:27.434 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:27.429+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:27.438 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.438 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.449 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:27.535 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:27.530+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:27.599 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.599 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.609 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:27.663 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:27.649+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:27.715 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.716 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.725 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:27.769 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:27.765+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:27.837 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:27.834+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:27.880 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.880 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:27.889 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:27.938 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:27.933+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:27.997 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:27.997 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.007 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:28.051 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:28.038+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:28.140 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:28.138+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:28.159 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.159 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.168 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:28.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:28.237+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:28.280 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.280 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.289 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:28.377 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:28.373+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:28.442 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:28.437+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:28.443 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.443 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.453 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:28.544 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:28.537+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:28.605 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.605 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.614 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:28.623 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:37:28.675 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:28.670+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:28.742 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:28.730+0000 7fbec5487700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:28.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:28.741+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:28.746 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:28.742+0000 7fbebffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:28.767 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.768 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.777 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:28.847 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:28.845+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:28.884 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:28.884 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:28.895 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:28.959 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:28.953+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:28.982 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:29.009 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:29.010 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:29.014 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:29.060 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:29.058+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:29.091 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:29.082+0000 7f3a80664700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:29.092 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:29.090+0000 7f3a7f402700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:29.128 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:29.154 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:29.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:29.153+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:29.168 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:29.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:29.169 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.06642919399999, 2020-06-12T02:37:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.170 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:29.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:29.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:29.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.066258827, 2020-06-12T02:37:29.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:29.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:29.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:29.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:29.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:29.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:29.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:29.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:29.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:29.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:29.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:29.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:29.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.203 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:29.203 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:29.203 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.04812080000001, 2020-06-12T02:37:29.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.204 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:29.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:29.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.042183917, 2020-06-12T02:37:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.04167484600001, 2020-06-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.04151658000001, 2020-06-12T02:37:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.967119778, 2020-06-12T02:37:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.960108956, 2020-06-12T02:37:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:29.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:29.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:29.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:29.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:29.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:29.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.320 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.321 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:29.321 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:29.322 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.200322412999995, 2020-06-12T02:37:29.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:29.322 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.322 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.322 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.323 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.323 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.323 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:29.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.323 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:29.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:29.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:29.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:29.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:29.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:29.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:29.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:29.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:29.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:29.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:29.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:29.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:29.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:29.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:29.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:29.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:29.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:29.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:29.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:29.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:29.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:29.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:29.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:29.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:29.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:29.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.341 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.342 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:29.342 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:29.342 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.200194816999996, 2020-06-12T02:37:29.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:29.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:29.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:29.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:29.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:29.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:29.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:29.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:29.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:29.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:29.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:29.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:29.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:29.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:29.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:29.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:29.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:29.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:29.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:29.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:29.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:29.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:29.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:29.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:29.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:29.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:29.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:29.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:29.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:29.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.361 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.785214175999997, 2020-06-12T02:37:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:29.364 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.365 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.365 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:29.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.366 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:29.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:29.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:29.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:29.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:29.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:29.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:29.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:29.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:29.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:29.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:29.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.375 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:29.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:29.377 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.785069418999996, 2020-06-12T02:37:29.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:29.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.378 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.378 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.378 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:29.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.379 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:29.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:29.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:29.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:29.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:29.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:29.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:29.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:29.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:29.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:29.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:29.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.784938569000005, 2020-06-12T02:37:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:29.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.784794246999994, 2020-06-12T02:37:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.784682266000004, 2020-06-12T02:37:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.784529781000003, 2020-06-12T02:37:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.763784642999994, 2020-06-12T02:37:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.763459549000004, 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.647813065999998, 2020-06-12T02:37:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.647472808000003, 2020-06-12T02:37:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:29.516 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:29.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:29.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:29.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:29.520 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:29.520 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:29.520 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.520 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.520 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:29.521 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:29.521 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.521 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.521 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.521 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.522 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:29.522 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:29.522 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:29.522 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:37:29.523 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:29.513+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:29.524 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:29.619 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:29.614+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:29.677 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:29.678 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:29.687 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:29.720 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:29.713+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:29.821 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:29.818+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:29.840 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:29.840 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:29.840 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:29.841 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:29.841 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:29.850 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:29.922 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:29.917+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:30.006 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:30.006 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:30.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:30.007 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:30.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:30.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:30.008 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 121.284894118, 2020-06-12T02:37:30.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:30.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.008 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.009 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.009 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.009 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:30.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:30.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:30.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:30.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:30.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:30.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:30.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:30.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:30.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:30.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:30.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:30.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:30.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:30.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:30.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:30.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:30.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:30.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.024 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.026 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:30.026 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:30.026 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.854914866, 2020-06-12T02:37:30.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:30.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.027 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.027 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:30.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.028 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:30.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:30.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:30.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:30.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:30.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:30.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:30.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:30.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:30.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:30.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:30.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:30.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:30.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:30.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:30.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:30.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.039 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.738951701, 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.040 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:30.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:30.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:30.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:30.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:30.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:30.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:30.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:30.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:30.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:30.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:30.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:30.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:30.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:30.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:30.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:30.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:30.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.053 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.056 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:30.056 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:30.056 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.7385747, 2020-06-12T02:37:30.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:30.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.057 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.057 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.062 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.062 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.062 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:30.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.062 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:30.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:30.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:30.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:30.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:30.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:30.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:30.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:30.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:30.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:30.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:30.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:30.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:30.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:30.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:30.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:30.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:30.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.076 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.077 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:30.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.738165165, 2020-06-12T02:37:30.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:30.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.078 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:30.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.079 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:30.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:30.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:30.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:30.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:30.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:30.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:30.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:30.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:30.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:30.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:30.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:30.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:30.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:30.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:30.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:30.091 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:30.091 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.737772834, 2020-06-12T02:37:30.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:30.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.093 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:30.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.093 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:30.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:30.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:30.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:30.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:30.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:30.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:30.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:30.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:30.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:30.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:30.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:30.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:30.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:30.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:30.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:30.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:30.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:30.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.106 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:30.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.720838406, 2020-06-12T02:37:30.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:30.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:30.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:30.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:30.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:30.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:30.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:30.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:30.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:30.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:30.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:30.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:30.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:30.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:30.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:30.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.122 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.122 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:30.122 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.71484380699999, 2020-06-12T02:37:30.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:30.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:30.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.124 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:30.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:30.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:30.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:30.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:30.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:30.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:30.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:30.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:30.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:30.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:30.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:30.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:30.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:30.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:30.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:30.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:30.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:30.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:30.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.136 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.136 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.71370723299999, 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.137 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:30.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:30.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:30.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:30.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:30.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:30.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:30.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:30.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:30.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:30.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:30.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:30.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:30.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:30.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:30.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:30.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:30.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.151 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:30.151 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:30.152 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.713525136, 2020-06-12T02:37:30.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:30.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.153 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:30.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.154 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:30.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:30.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:30.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:30.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:30.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:30.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:30.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:30.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.166 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:30.166 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:30.166 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.066339814, 2020-06-12T02:37:30.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:30.166 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.167 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.167 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.167 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.167 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.167 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:30.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.168 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:30.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:30.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:30.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:30.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:30.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:30.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:30.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:30.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:30.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:30.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:30.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:30.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:30.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.180 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:30.180 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:30.180 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.066027425, 2020-06-12T02:37:30.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:30.181 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.181 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.181 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.181 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.181 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.182 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:30.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.182 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:30.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:30.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:30.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:30.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:30.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:30.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.193 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.194 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:30.194 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:30.194 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.054458832999998, 2020-06-12T02:37:30.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:30.194 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.195 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.195 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.195 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.195 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.196 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:30.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.196 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:30.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:30.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:30.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:30.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:30.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:30.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:30.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:30.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:30.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:30.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:30.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:30.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:30.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:30.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.054119374999999, 2020-06-12T02:37:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:30.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.212 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.053822929999995, 2020-06-12T02:37:30.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:30.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:30.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:30.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:30.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:30.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:30.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.016789154000001, 2020-06-12T02:37:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:30.245 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.246 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:30.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:30.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:30.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:30.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:30.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:30.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:30.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:30.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.009182705999997, 2020-06-12T02:37:30.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:30.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:30.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:30.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:30.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:30.271 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.005804167999997, 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:30.284 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.005533913999997, 2020-06-12T02:37:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:30.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:30.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.296 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:30.297 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.005352791999996, 2020-06-12T02:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.310 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.310 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:30.311 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:30.310+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:30.312 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:30.413 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:30.405+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:30.473 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:30.473 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:30.474 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:30.474 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:30.483 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:30.528 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:30.526+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:30.596 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:30.597 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:30.597 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:30.597 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:30.597 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:30.606 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:30.648 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:30.646+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:30.715 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:30.709+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:30.759 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:30.760 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:30.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:30.760 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:30.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.760 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:30.761 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:30.761 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.635395868, 2020-06-12T02:37:30.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:30.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.761 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.762 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.762 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:30.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.763 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:30.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:30.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:30.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:30.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:30.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:30.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:30.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:30.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:30.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:30.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:30.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:30.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.774 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.635172426, 2020-06-12T02:37:30.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.776 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:30.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:30.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:30.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:30.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:30.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:30.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:30.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.592693317, 2020-06-12T02:37:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.59235842299999, 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.391482539999998, 2020-06-12T02:37:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.391322727000002, 2020-06-12T02:37:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:30.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:30.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.391242013999999, 2020-06-12T02:37:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.390995461000003, 2020-06-12T02:37:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:30.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:30.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:30.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:30.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:30.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:30.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:30.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:30.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:30.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:30.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:30.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.893 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:30.893 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:30.893 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.377645138000005, 2020-06-12T02:37:30.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:30.894 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.894 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.894 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.895 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.895 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.895 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:30.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.896 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:30.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:30.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:30.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:30.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:30.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:30.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:30.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:30.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:30.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:30.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:30.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:30.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:30.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:30.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:30.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:30.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:30.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:30.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:30.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:30.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:30.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.908 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.909 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:30.909 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:30.910 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.377458884000006, 2020-06-12T02:37:30.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:30.910 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.910 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.910 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.911 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.911 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.911 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:30.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.911 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:30.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:30.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:30.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:30.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:30.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:30.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:30.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:30.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:30.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:30.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:30.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:30.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:30.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:30.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:30.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:30.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:30.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:30.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:30.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:30.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:30.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:30.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:30.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.926 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.927 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:30.927 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:30.927 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.377258173000001, 2020-06-12T02:37:30.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:30.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.928 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:30.928 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.928 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.929 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.929 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:30.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.929 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:30.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:30.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:30.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:30.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:30.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:30.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:30.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:30.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:30.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:30.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:30.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:30.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:30.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:30.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:30.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:30.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:30.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:30.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:30.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:30.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:30.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:30.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:30.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:30.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:30.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:30.944 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.944 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.946 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:30.946 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:30.946 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.784770211999998, 2020-06-12T02:37:30.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:30.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.947 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.947 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.948 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.948 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:30.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.948 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:30.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:30.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:30.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:30.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:30.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:30.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:30.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:30.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:30.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:30.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:30.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:30.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:30.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:30.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:30.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:30.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:30.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:30.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:30.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:30.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:30.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.966 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:30.967 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:30.967 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.784346464999999, 2020-06-12T02:37:30.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:30.967 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:30.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:30.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:30.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:30.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:30.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:30.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:30.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:30.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:30.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:30.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:30.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:30.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:30.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:30.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:30.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:30.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:30.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:30.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:30.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:30.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:30.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:30.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:30.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:30.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:30.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:30.984 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:30.984 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.784192606999994, 2020-06-12T02:37:30.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:30.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:30.985 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:30.985 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:30.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:30.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:30.986 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:30.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.987 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:30.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:30.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:30.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:30.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:30.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:30.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:30.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:30.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:30.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:30.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:30.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:30.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:30.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:30.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:30.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:30.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:30.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:30.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:30.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:30.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:30.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:30.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:30.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:30.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:30.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:30.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:31.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:31.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.002 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.781461819, 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.003 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:31.004 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.004 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.004 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.004 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:31.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:31.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:31.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:31.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:31.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:31.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:31.014 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.014 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.781041492, 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.016 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:31.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:31.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:31.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:31.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:31.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:31.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:31.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:31.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.028 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:31.028 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:31.029 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.780946658999994, 2020-06-12T02:37:31.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:31.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:31.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.030 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:31.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.031 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:31.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:31.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:31.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:31.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:31.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:31.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:31.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:31.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:31.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:31.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:31.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:31.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:31.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:31.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:31.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:31.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:31.041 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.041 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.042 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:31.042 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:31.043 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.751167304999996, 2020-06-12T02:37:31.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:31.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.043 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.044 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:31.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:31.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:31.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:31.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:31.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:31.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:31.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:31.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:31.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:31.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:31.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:31.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:31.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:31.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:31.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:31.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:31.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:31.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:31.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:31.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:31.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:31.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.061 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.061 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.061 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.750701692000007, 2020-06-12T02:37:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.063 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:31.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:31.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:31.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:31.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:31.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:31.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:31.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:31.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:31.081 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.750527757, 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:31.082 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:31.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:31.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:31.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:31.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:31.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:31.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:31.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.095 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:31.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:31.096 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:31.097 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:31.093+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:31.098 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:31.198 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:31.193+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:31.222 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:31.309 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:31.305+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:31.377 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:31.378 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:31.378 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:31.378 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:31.379 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:31.387 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:31.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:31.429+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:31.501 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:31.497+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:31.524 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:31.526 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:37:31.547 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:31.547 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:31.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:31.548 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:31.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.548 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:31.548 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:31.548 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.41060105299999, 2020-06-12T02:37:31.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:31.549 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.549 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.549 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.550 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.550 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.550 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:31.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.550 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:31.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:31.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:31.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:31.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:31.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:31.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:31.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:31.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:31.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:31.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:31.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:31.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:31.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:31.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:31.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:31.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:31.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:31.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:31.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:31.565 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:31.566 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:31.567 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.399709672, 2020-06-12T02:37:31.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:31.567 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.567 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.568 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:31.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.568 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:31.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:31.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:31.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:31.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:31.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:31.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:31.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:31.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:31.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:31.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:31.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:31.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:31.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:31.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:31.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:31.581 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.582 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.583 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.583 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:31.584 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:31.584 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.398577628, 2020-06-12T02:37:31.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.585 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:31.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.586 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:31.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:31.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:31.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:31.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:31.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:31.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:31.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:31.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:31.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:31.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:31.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:31.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:31.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:31.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:31.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:31.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:31.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:31.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:31.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:31.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:31.598 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.598 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.599 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:31.599 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:31.600 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.398322443, 2020-06-12T02:37:31.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:31.600 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.603 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.603 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.604 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.604 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:31.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.605 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:31.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:31.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:31.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:31.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:31.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:31.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:31.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:31.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:31.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:31.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:31.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:31.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:31.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:31.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:31.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:31.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:31.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.619 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.619 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:31.620 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:31.620 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.398163256, 2020-06-12T02:37:31.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:31.620 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.620 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.621 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:31.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.622 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:31.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:31.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:31.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:31.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:31.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:31.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:31.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:31.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:31.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:31.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:31.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:31.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:31.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:31.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:31.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:31.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:31.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:31.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.634 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.635 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:31.635 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:31.635 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.253840678, 2020-06-12T02:37:31.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:31.635 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:31.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.637 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:31.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:31.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:31.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:31.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:31.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:31.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:31.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:31.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:31.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:31.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:31.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:31.645 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.646 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.646 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.647 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:31.647 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:31.647 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 91.512771181000005, 2020-06-12T02:37:31.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:31.647 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:31.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.649 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:31.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:31.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:31.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:31.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:31.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:31.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:31.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:31.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:31.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:31.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:31.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:31.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:31.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:31.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:31.662 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.663 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.663 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.663 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 87.575068779999995, 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.664 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:31.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:31.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:31.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:31.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:31.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:31.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:31.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:31.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:31.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:31.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:31.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:31.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:31.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:31.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.680 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:31.680 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:31.680 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.593192700000003, 2020-06-12T02:37:31.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:31.680 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.681 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.682 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:31.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.682 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:31.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:31.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:31.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:31.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:31.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:31.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:31.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:31.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:31.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:31.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:31.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:31.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:31.693 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.693 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.693 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.592999383999995, 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.694 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.695 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.695 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:31.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:31.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:31.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:31.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:31.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:31.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:31.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:31.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:31.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:31.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:31.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:31.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:31.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:31.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:31.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.706 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.707 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.707 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:31.707 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.592850928999994, 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.709 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.710 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:31.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.710 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:31.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:31.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:31.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:31.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:31.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:31.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:31.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:31.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:31.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:31.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:31.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:31.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:31.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:31.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.722 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.722 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.585417978999999, 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:31.723 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:31.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:31.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:31.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:31.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:31.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:31.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:31.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:31.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:31.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:31.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:31.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.733 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.734 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:31.735 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:31.735 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.583009478999998, 2020-06-12T02:37:31.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:31.736 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.736 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:31.736 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:31.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:31.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:31.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:31.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:31.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:31.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:31.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:31.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:31.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:31.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:31.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:31.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:31.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:31.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:31.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.746 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.747 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.747 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:31.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:31.748 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.580982333999998, 2020-06-12T02:37:31.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:31.750 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.750 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:31.750 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:31.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:31.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:31.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:31.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:31.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:31.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:31.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:31.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:31.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:31.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:31.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:31.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:31.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:31.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:31.764 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.765 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.765 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.765 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:31.766 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:31.766 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.569932500999997, 2020-06-12T02:37:31.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:31.766 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.766 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:31.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:31.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:31.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:31.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:31.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:31.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:31.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:31.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:31.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:31.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:31.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:31.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.777 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:31.777 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:31.777 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.565719483999999, 2020-06-12T02:37:31.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:31.778 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.778 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.778 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.778 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.778 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.779 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:31.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.779 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:31.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:31.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:31.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:31.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:31.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:31.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:31.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:31.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:31.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:31.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:31.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:31.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:31.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:31.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:31.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:31.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.794 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.795 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:31.795 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:31.795 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.565536284999993, 2020-06-12T02:37:31.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:31.795 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:31.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:31.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:31.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:31.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:31.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:31.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:31.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:31.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:31.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:31.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:31.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:31.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:31.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:31.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:31.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:31.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:31.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:31.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:31.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:31.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:31.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:31.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:31.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:31.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:31.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.811 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:31.812 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:31.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 76.108618241000002, 2020-06-12T02:37:31.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:31.814 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:31.814 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:31.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:31.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:31.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:31.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:31.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:31.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.578156644000003, 2020-06-12T02:37:31.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:31.827 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.827 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:31.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.829 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:31.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:31.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:31.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:31.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:31.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:31.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:31.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:31.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:31.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:31.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:31.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:31.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:31.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:31.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:31.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:31.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:31.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:31.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:31.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:31.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:31.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.841 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 61.577897524999997, 2020-06-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:31.842 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:31.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:31.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:31.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:31.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:31.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:31.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:31.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:31.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:31.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:31.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:31.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:31.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:31.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:31.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:31.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:31.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:31.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:31.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:31.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:31.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:31.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:31.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:31.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:31.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:31.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:31.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:31.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:31.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:31.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:31.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:31.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:31.857 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.857 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:31.858 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:31.859 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:31.862 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:31.630+0000 7f418f222700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:31.862 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:31.638+0000 7f418dfc0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:31.862 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.862 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.862 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:31.863 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:31.863 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.863 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.863 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.863 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.864 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:31.864 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:31.634+0000 7f66c5fa4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:31.864 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:31.646+0000 7f66c4d42700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:31.864 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:31.864 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:31.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:31.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:31.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:31.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:31.865 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:31.866 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:31.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:31.866 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:31.858+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:31.867 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:31.961 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:31.957+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:32.023 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.023 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.033 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:32.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:32.073+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:32.164 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:32.157+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:32.192 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.192 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.203 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:32.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:32.285+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:32.356 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:37:32.357 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.357 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.366 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:32.362+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:32.368 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:32.470 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:32.465+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:32.523 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.524 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.533 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:32.572 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:32.566+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:32.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:32.665+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:32.693 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.693 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.702 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:32.773 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:32.770+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:32.860 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.860 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.870 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:32.874 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:32.870+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:32.971 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:32.972 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:32.975 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:32.969+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:32.981 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:33.077 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:33.074+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:33.136 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.136 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.145 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:33.178 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:33.174+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:33.253 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.254 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.267 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:33.335 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:33.322+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:33.380 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:33.373+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:33.388 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.389 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.399 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:33.484 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:33.482+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:33.549 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.550 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.559 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:33.600 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:33.598+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:33.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:33.677+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:33.712 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.712 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.722 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:33.787 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:33.782+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:33.828 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.829 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:33.839 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:33.867 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:33.932 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:33.930+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:33.993 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:33.986+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:33.994 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:33.982+0000 7f68fff27700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:33.995 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:33.990+0000 7f68fecc5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:33.998 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:33.998 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:34.009 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:34.024 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:34.047 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:34.068 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:34.321 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:34.321 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:34.322 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:34.322 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:34.322 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:34.322 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:34.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:34.323 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:34.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.323 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:34.323 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 125.411788367, 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.324 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.325 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:34.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.325 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:34.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:34.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:34.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:34.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:34.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:34.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:34.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:34.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:34.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:34.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:34.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:34.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:34.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:34.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:34.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:34.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:34.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:34.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:34.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:34.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:34.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.345 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.345 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:34.346 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:34.346 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 119.981809115, 2020-06-12T02:37:34.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:34.346 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.347 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:34.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:34.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:34.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:34.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:34.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:34.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:34.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:34.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:34.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:34.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:34.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:34.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:34.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:34.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:34.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:34.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:34.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:34.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.363 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:34.363 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:34.364 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.86584594999999, 2020-06-12T02:37:34.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:34.364 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.364 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.365 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:34.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.365 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:34.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:34.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:34.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:34.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:34.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:34.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:34.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:34.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:34.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:34.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:34.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:34.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.377 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.377 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.377 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:34.378 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:34.378 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.865468949, 2020-06-12T02:37:34.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:34.378 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.378 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.379 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:34.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:34.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:34.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:34.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:34.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:34.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:34.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:34.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:34.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:34.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:34.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:34.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:34.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:34.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:34.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:34.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:34.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:34.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:34.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:34.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:34.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:34.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.395 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:34.396 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.865059414, 2020-06-12T02:37:34.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:34.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:34.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:34.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:34.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:34.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:34.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:34.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:34.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:34.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:34.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:34.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:34.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:34.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:34.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:34.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.864667083, 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.412 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.413 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:34.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.414 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:34.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:34.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:34.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:34.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:34.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:34.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:34.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:34.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:34.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:34.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:34.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:34.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:34.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:34.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:34.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:34.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:34.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:34.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:34.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.427 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.847732655, 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:34.428 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.429 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.429 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.429 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.429 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:34.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:34.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:34.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:34.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:34.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:34.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:34.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:34.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:34.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:34.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:34.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:34.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:34.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:34.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:34.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:34.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:34.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:34.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:34.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.447 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.841738056, 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:34.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:34.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.450 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:34.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:34.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:34.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:34.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:34.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:34.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:34.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:34.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:34.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:34.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.840601482, 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:34.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.465 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:34.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:34.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:34.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:34.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 117.840419385, 2020-06-12T02:37:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.19323406300001, 2020-06-12T02:37:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.192921674, 2020-06-12T02:37:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.181353082, 2020-06-12T02:37:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.181013624, 2020-06-12T02:37:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.180717179, 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.143683402999997, 2020-06-12T02:37:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.136076955, 2020-06-12T02:37:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:34.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:34.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:34.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:34.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.597 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:34.598 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:34.598 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.132698417, 2020-06-12T02:37:34.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:34.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:34.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.600 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:34.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:34.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:34.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:34.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:34.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:34.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:34.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:34.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:34.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:34.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:34.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:34.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:34.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:34.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:34.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:34.613 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.132428163, 2020-06-12T02:37:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:34.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:34.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:34.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:34.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:34.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:34.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:34.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.132247040999999, 2020-06-12T02:37:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:34.629 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:34.630 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:34.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:34.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:34.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:34.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:34.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:34.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:34.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:34.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:34.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:34.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:34.651 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:34.652 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:34.653 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.653 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.653 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:34.653 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:34.654 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.654 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.654 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.654 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.654 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:34.654 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:34.655 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:34.655 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:37:34.656 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:34.321+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:34.658 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:34.653+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:34.759 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:34.754+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:34.774 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:34.775 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:34.775 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:34.775 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:34.778 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:34.766+0000 7fae13660700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:34.781 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:34.778+0000 7fae123fe700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:34.785 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:34.859 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:34.853+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:34.934 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:34.934 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:34.935 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:34.935 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:34.943 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:34.960 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:34.953+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:35.065 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:35.065 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:35.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:35.066 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:35.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.066 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:35.067 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:35.067 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.92987777499999, 2020-06-12T02:37:35.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:35.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.068 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.068 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.069 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:35.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:35.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:35.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:35.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:35.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:35.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:35.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:35.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:35.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:35.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:35.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:35.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:35.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:35.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:35.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:35.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:35.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:35.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:35.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.084 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.929654333, 2020-06-12T02:37:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.086 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:35.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:35.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:35.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:35.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:35.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:35.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:35.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:35.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:35.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:35.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:35.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:35.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:35.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:35.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:35.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:35.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:35.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.103 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:35.103 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:35.103 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.887175224, 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.104 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.105 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:35.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.105 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:35.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:35.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:35.127 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.88684033, 2020-06-12T02:37:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:35.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:35.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:35.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:35.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:35.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:35.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:35.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.685964447000003, 2020-06-12T02:37:35.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.146 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:35.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:35.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:35.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:35.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:35.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:35.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:35.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.685804633999993, 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.685723921000005, 2020-06-12T02:37:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.685477367999994, 2020-06-12T02:37:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.672127044999996, 2020-06-12T02:37:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.671940790999997, 2020-06-12T02:37:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.671740080000006, 2020-06-12T02:37:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.079252119000003, 2020-06-12T02:37:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:35.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:35.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:35.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:35.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:35.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:35.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:35.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:35.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:35.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:35.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:35.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:35.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:35.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:35.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:35.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:35.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:35.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:35.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.278 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:35.278 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:35.278 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.078828372000004, 2020-06-12T02:37:35.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:35.279 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.279 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.280 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:35.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.280 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:35.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:35.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:35.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:35.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:35.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:35.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:35.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:35.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:35.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:35.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:35.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:35.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:35.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:35.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:35.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:35.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:35.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:35.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:35.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:35.296 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:35.297 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.078674513999999, 2020-06-12T02:37:35.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:35.297 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:35.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.298 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:35.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.299 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:35.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:35.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:35.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:35.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:35.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:35.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:35.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:35.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:35.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:35.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:35.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:35.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:35.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:35.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:35.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:35.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:35.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:35.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:35.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.312 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.313 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:35.313 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:35.313 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.075943726000006, 2020-06-12T02:37:35.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:35.314 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.314 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:35.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.315 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:35.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.316 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:35.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:35.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:35.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:35.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:35.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:35.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:35.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:35.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:35.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:35.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:35.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:35.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:35.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:35.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:35.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:35.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:35.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:35.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.327 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.328 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:35.329 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:35.329 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.075523399000005, 2020-06-12T02:37:35.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:35.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.330 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:35.330 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.330 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.331 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:35.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.331 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:35.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:35.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:35.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:35.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:35.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:35.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:35.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:35.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:35.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:35.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:35.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:35.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:35.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:35.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:35.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:35.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.344 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:35.345 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:35.345 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.075428565999999, 2020-06-12T02:37:35.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:35.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.346 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.347 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.347 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:35.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.347 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:35.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:35.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:35.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:35.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:35.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:35.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:35.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:35.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:35.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:35.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:35.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:35.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:35.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:35.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:35.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:35.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:35.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:35.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:35.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:35.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.360 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:35.362 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:35.362 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.045649212000001, 2020-06-12T02:37:35.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:35.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.363 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:35.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.364 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:35.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:35.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:35.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:35.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:35.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:35.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:35.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:35.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:35.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:35.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:35.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:35.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:35.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:35.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:35.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:35.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:35.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:35.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:35.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:35.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:35.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:35.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:35.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:35.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.379 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.045183598999998, 2020-06-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:35.380 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:35.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:35.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:35.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:35.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:35.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:35.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:35.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:35.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:35.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:35.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:35.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:35.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:35.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:35.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:35.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:35.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:35.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:35.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:35.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:35.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:35.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:35.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:35.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:35.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:35.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:35.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:35.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:35.399 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.399 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.399 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.400 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:35.400 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:35.401 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.045009664000006, 2020-06-12T02:37:35.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:35.401 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:35.402 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:35.402 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:35.402 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:35.402 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.403 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:35.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.403 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:35.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:35.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:35.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:35.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:35.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:35.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:35.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:35.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:35.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:35.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:35.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:35.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:35.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:35.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:35.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:35.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:35.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:35.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:35.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:35.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:35.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:35.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:35.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:35.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:35.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:35.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:35.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:35.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:35.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:35.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:35.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:35.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:35.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:35.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:35.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:35.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:35.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:35.418 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:35.418 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:35.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:35.061+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:35.419 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:35.421 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:37:35.422 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:35.418+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:35.522 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:35.518+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:35.531 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:35.531 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:35.531 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:35.547 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:35.624 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:35.622+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:35.656 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:35.656 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:35.657 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:35.657 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:35.665 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:35.724 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:35.722+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:35.777 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:35.777 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:35.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.63970890900001, 2020-06-12T02:37:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:35.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.794 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:35.796 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.628817528, 2020-06-12T02:37:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:35.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:35.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:35.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:35.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:35.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:35.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:35.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:35.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:35.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.811 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:35.812 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:35.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.627685484, 2020-06-12T02:37:35.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:35.813 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.813 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.813 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:35.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:35.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:35.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:35.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:35.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:35.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:35.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:35.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:35.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:35.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:35.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:35.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:35.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:35.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:35.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:35.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:35.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.627430299, 2020-06-12T02:37:35.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:35.828 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.828 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:35.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:35.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:35.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:35.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:35.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:35.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:35.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:35.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:35.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:35.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:35.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:35.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:35.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:35.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:35.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:35.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:35.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.841 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:35.842 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.627271112, 2020-06-12T02:37:35.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:35.843 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.843 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:35.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.844 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:35.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.844 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:35.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:35.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:35.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:35.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:35.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:35.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:35.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:35.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:35.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:35.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:35.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:35.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:35.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:35.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:35.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:35.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:35.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.856 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.856 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.856 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:35.857 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:35.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.482948534, 2020-06-12T02:37:35.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:35.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:35.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:35.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:35.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:35.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:35.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:35.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:35.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:35.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:35.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:35.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:35.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:35.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:35.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:35.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:35.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.872 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.873 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:35.874 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:35.874 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.741879037000004, 2020-06-12T02:37:35.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:35.874 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.874 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.875 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:35.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.876 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:35.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:35.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:35.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:35.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:35.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:35.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:35.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:35.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:35.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:35.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:35.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:35.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:35.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:35.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:35.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:35.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:35.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:35.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:35.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:35.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:35.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:35.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:35.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.892 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.893 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:35.893 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:35.893 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 91.804176635999994, 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.895 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:35.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.895 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:35.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:35.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:35.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:35.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:35.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:35.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:35.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:35.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:35.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:35.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:35.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:35.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:35.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:35.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:35.910 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.822300556000002, 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.911 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:35.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:35.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:35.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:35.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:35.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.922 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:35.923 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.822107239999994, 2020-06-12T02:37:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.924 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:35.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:35.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:35.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:35.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:35.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.935 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:35.936 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.821958785000007, 2020-06-12T02:37:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:35.937 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:35.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:35.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:35.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:35.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.949 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.814525834999998, 2020-06-12T02:37:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.950 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:35.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:35.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:35.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:35.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:35.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:35.958 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.959 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.812117334999996, 2020-06-12T02:37:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.960 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:35.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:35.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:35.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:35.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:35.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:35.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:35.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.970 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.810090189999997, 2020-06-12T02:37:35.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:35.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:35.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:35.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:35.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:35.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:35.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:35.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:35.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:35.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:35.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:35.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:35.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:35.981 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.981 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.982 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:35.982 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.799040356999996, 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:35.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:35.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:35.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:35.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:35.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:35.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:35.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:35.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:35.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:35.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:35.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:35.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:35.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:35.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:35.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:35.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:35.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.993 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:35.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:35.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.994 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:35.994 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:35.994 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.794827339999998, 2020-06-12T02:37:35.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:35.995 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:35.995 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:35.995 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:35.995 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:35.995 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:35.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:35.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:35.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:35.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:35.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:35.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:35.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:36.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:36.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:36.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:36.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:36.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:36.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:36.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:36.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:36.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:36.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.008 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:36.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:36.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.794644141000006, 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.010 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:36.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.010 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:36.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:36.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:36.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:36.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:36.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:36.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:36.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:36.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:36.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:36.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:36.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:36.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:36.023 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.337726097000001, 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:36.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:36.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:36.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:36.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:36.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:36.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.035 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:36.035 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:36.035 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.807264500000002, 2020-06-12T02:37:36.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:36.035 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:36.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.037 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:36.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:36.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:36.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:36.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:36.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 65.807005380999996, 2020-06-12T02:37:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:36.049 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.050 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:36.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:36.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:36.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:36.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:36.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:36.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:36.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:36.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:36.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:36.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:36.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:36.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:36.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.063 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.064 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:36.066 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:36.066 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:36.062+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:36.167 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:36.161+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:36.184 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:36.184 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:36.184 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:36.184 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:36.193 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:36.268 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:36.266+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:36.348 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:36.348 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:36.348 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:36.349 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:36.349 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:36.358 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:36.405 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:36.401+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:36.485 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:36.494 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:36.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:36.494 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:36.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.495 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:36.495 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:36.504 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.315951869, 2020-06-12T02:37:36.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:37:36.504 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.505 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:36.505 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:36.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:36.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:37:36.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:37:36.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:37:36.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:37:36.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:37:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:37:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:37:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:37:36.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:37:36.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:37:36.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:37:36.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:37:36.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:37:36.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:37:36.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:37:36.520 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.521 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.521 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.521 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:37:36.522 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:36.522 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.16943835799999, 2020-06-12T02:37:36.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:37:36.522 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.522 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:36.523 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:36.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:36.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:37:36.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:37:36.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:37:36.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:37:36.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:37:36.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:37:36.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:37:36.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:37:36.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:37:36.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:37:36.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.533 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:36.534 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:36.534 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.491889684, 2020-06-12T02:37:36.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:37:36.534 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.535 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.535 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.536 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.536 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:37:36.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.536 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:36.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:36.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:37:36.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:37:36.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:37:36.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:37:36.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:37:36.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:37:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:37:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:37:36.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:37:36.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:36.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:37:36.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:37:36.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:37:36.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:37:36.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:37:36.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:37:36.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:37:36.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:37:36.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:37:36.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:37:36.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:37:36.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:37:36.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:37:36.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:37:36.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.553 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:36.553 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:36.554 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.491125756000002, 2020-06-12T02:37:36.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:37:36.554 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:36.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:36.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:37:36.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:37:36.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:37:36.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:37:36.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:37:36.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:37:36.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:37:36.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:36.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:37:36.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:37:36.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:37:36.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:37:36.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:36.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:37:36.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:37:36.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:37:36.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:37:36.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:36.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:37:36.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:37:36.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:37:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:37:36.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:37:36.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:37:36.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.572 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.573 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:36.573 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:36.574 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.268320700999993, 2020-06-12T02:37:36.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:37:36.574 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.574 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.575 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:37:36.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.575 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:36.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:36.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:37:36.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:37:36.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:37:36.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:37:36.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:37:36.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:37:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:37:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:37:36.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:37:36.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:37:36.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:37:36.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:37:36.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:37:36.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:37:36.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:37:36.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:37:36.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:37:36.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:37:36.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:37:36.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:37:36.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:37:36.594 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.594 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.594 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.596 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:36.596 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:36.596 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.260034414000003, 2020-06-12T02:37:36.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:37:36.597 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.597 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.598 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:37:36.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.599 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:36.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:36.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:37:36.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:37:36.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:37:36.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:37:36.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:37:36.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:37:36.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:37:36.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:37:36.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:37:36.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:37:36.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:37:36.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:37:36.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:37:36.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:37:36.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:37:36.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:37:36.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:37:36.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.612 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:36.613 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:36.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.253005169999994, 2020-06-12T02:37:36.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:37:36.614 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.614 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:36.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:36.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:37:36.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:37:36.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:37:36.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:37:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:37:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:37:36.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:37:36.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:37:36.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:37:36.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:37:36.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:37:36.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:37:36.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:37:36.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:37:36.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:37:36.627 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.627 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.627 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.628 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:36.628 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:36.628 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 92.252867718999994, 2020-06-12T02:37:36.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:37:36.629 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.629 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.629 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.630 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:37:36.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.630 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:36.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:37:36.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:37:36.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:37:36.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:37:36.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:37:36.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:37:36.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:37:36.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:36.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:37:36.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:37:36.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:37:36.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:37:36.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:37:36.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:37:36.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.641 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.641 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.641 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 87.452079979999993, 2020-06-12T02:37:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:37:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.642 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.643 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:36.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:36.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:37:36.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:37:36.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:37:36.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:37:36.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:36.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:37:36.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:37:36.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:37:36.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:37:36.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:37:36.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:37:36.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:37:36.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:37:36.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:37:36.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:37:36.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:37:36.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:37:36.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.657 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.658 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.658 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:36.658 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:36.659 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 87.451933366000006, 2020-06-12T02:37:36.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:37:36.659 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.659 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.660 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.660 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.660 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.660 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:37:36.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:36.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:36.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:37:36.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:37:36.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:37:36.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:37:36.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:37:36.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:37:36.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:37:36.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:37:36.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:37:36.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:37:36.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:37:36.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:36.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:37:36.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:37:36.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:37:36.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:37:36.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:37:36.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:37:36.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:37:36.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:37:36.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:37:36.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:37:36.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:37:36.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:37:36.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:37:36.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:37:36.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:36.688 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:36.689 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.495920491999996, 2020-06-12T02:37:36.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:37:36.689 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.689 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.690 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:37:36.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.691 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:36.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:37:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:37:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:37:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:37:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:37:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:37:36.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:37:36.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:37:36.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:37:36.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:37:36.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:37:36.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:37:36.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:37:36.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:37:36.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:37:36.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:37:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:37:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:37:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:37:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.490188978999996, 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:37:36.704 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.705 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.705 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:37:36.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.706 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:36.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:36.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:37:36.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:37:36.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:37:36.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:37:36.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:37:36.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:37:36.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:37:36.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:37:36.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:37:36.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:37:36.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:37:36.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:37:36.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:37:36.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:37:36.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:37:36.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:37:36.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:37:36.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:37:36.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:37:36.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.721 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.489695463000004, 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.722 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:36.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.723 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:37:36.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.724 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:36.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:36.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:37:36.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:37:36.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:37:36.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:37:36.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:37:36.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:37:36.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:37:36.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:37:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:37:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:37:36.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:37:36.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:37:36.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:37:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:37:36.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:37:36.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:37:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:37:36.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.737 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:36.738 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:36.738 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.489601456000003, 2020-06-12T02:37:36.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:37:36.738 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.739 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:37:36.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.740 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:36.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:36.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:37:36.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:37:36.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:37:36.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:37:36.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:37:36.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:37:36.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:37:36.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:37:36.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:37:36.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:37:36.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:37:36.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:37:36.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:37:36.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.753 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:37:36.753 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:36.753 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.451440426999994, 2020-06-12T02:37:36.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:37:36.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.754 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:36.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:36.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:37:36.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:37:36.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:37:36.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:37:36.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:37:36.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:37:36.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:37:36.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:37:36.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:37:36.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:36.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:37:36.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:37:36.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:37:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:37:36.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.764 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.765 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.410643433999994, 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.766 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.767 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.767 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.767 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.767 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:37:36.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.768 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:36.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:36.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:37:36.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:37:36.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:37:36.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:37:36.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:37:36.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:37:36.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:37:36.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:37:36.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:37:36.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:37:36.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:37:36.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:37:36.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:37:36.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:37:36.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:37:36.778 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.778 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.778 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.779 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:36.779 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:36.779 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.410401367999995, 2020-06-12T02:37:36.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:37:36.780 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.780 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.780 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:37:36.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.781 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:36.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:36.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:37:36.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:37:36.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:37:36.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:37:36.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:37:36.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:37:36.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:37:36.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:37:36.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:37:36.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:37:36.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:37:36.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:37:36.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:37:36.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:37:36.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:37:36.793 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.793 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.794 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:36.795 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:36.795 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.410191677, 2020-06-12T02:37:36.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:37:36.796 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.796 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.798 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:36.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.798 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:36.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:36.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:37:36.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:37:36.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:37:36.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:37:36.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:37:36.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:37:36.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:37:36.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:37:36.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:37:36.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:37:36.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:37:36.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:37:36.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:37:36.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:37:36.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:37:36.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.813 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.814 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:37:36.815 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:36.815 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 75.394657515999995, 2020-06-12T02:37:36.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:37:36.816 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.816 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.816 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.817 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.817 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.817 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:36.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.818 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:36.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:36.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:37:36.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:37:36.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:37:36.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:37:36.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:37:36.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:37:36.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:37:36.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:37:36.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:37:36.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:37:36.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:37:36.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:37:36.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:37:36.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:37:36.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:37:36.832 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.832 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.833 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.834 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:37:36.834 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:36.834 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 66.496597481999999, 2020-06-12T02:37:36.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:37:36.835 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:36.836 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:36.836 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:36.836 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:36.837 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:36.837 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:37:36.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.838 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:36.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:36.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:36.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:36.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:36.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:36.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:37:36.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:36.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:37:36.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:37:36.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:36.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:37:36.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:37:36.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:36.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:37:36.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:37:36.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:36.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:37:36.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:37:36.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:36.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:37:36.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:37:36.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:36.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:37:36.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:37:36.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:36.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:36.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:36.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:37:36.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:37:36.852 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.853 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.853 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.853 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:36.854 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:36.854 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:36.854 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:36.474+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:36.855 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:36.857 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:36.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:36.853+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:36.958 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:36.954+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:36.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:36.966+0000 7f9245edd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:36.973 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:36.973 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:36.973 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:36.974 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:36.975 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:36.974+0000 7f9244c7b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:36.983 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:37.058 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:37.053+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:37.097 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:37.098 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:37.098 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:37.098 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:37.098 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:37.104 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:37.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.149 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:37.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:37.149 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.150 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:37.153 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:37.154 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:37.196 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:37.194+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:37.259 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:37.259 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:37.262 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:37.257+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:37.269 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:37.363 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:37.357+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:37.424 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:37:37.430 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:37.430 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:37.439 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:37.481 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:37.477+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:37.549 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:37.538+0000 7f76605b5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:37.555 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:37.550+0000 7f765f353700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:37.564 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:37.562+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:37.591 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:37.591 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:37.600 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:37.665 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:37.662+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:37.709 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:37.710 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:37.717 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:37.766 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:37.762+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:37.831 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:37.831 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:37.841 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:37.884 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:37.882+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:37.967 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:37.966+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:38.005 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.006 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.006 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:38.068 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:38.061+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:38.159 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.159 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.169 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:38.170 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:38.161+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:38.270 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:38.266+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:38.274 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.274 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.286 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:38.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:38.365+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:38.402 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:37:38.440 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.440 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.449 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:38.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:38.465+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:38.578 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:38.570+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:38.618 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.618 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.626 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:38.672 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:38.665+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:38.774 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:38.769+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:38.778 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.778 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.789 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:38.875 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:38.870+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:38.893 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:38.894 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:38.907 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:38.976 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:38.973+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:39.056 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:39.057 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:39.066 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:39.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:39.109+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:39.156 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:39.185 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:39.182+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:39.187 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:39.187 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:39.199 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:39.289 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:39.285+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:39.293 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:39.286+0000 7fe59381c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:39.298 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:39.294+0000 7fe5925ba700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:39.331 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:39.351 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:39.356 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:39.356 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:39.366 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:39.370 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:39.387 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:39.382+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:39.395 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:39.420 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:39.452 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:39.475 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:39.475 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.476 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.476 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:39.476 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:39.476 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.476 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.477 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.477 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.477 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:39.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:39.479 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:39.500 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:39.493+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:39.524 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:39.525 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:39.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:39.525 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:39.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.526 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:39.526 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:39.526 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.38433105999999, 2020-06-12T02:37:39.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:39.526 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.527 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.527 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.529 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:39.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.529 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:39.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:39.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:39.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:39.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:39.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:39.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:39.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:39.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:39.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:39.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:39.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:39.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:39.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:39.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:39.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:39.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:39.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:39.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:39.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:39.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:39.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:39.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:39.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:39.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:39.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:39.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:39.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:39.550 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.550 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.551 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.551 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:39.551 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:39.552 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.373439679, 2020-06-12T02:37:39.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:39.552 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.552 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.553 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:39.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:39.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:39.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:39.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:39.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:39.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:39.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:39.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:39.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:39.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:39.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:39.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:39.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:39.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:39.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:39.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:39.565 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.565 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.565 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.566 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:39.566 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:39.566 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.372307635, 2020-06-12T02:37:39.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:39.567 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.567 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.567 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:39.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:39.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:39.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:39.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:39.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:39.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:39.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:39.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:39.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:39.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:39.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:39.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:39.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:39.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:39.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:39.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:39.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:39.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:39.581 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.581 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.581 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.582 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:39.582 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:39.582 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.37205245000001, 2020-06-12T02:37:39.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:39.583 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.583 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:39.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:39.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:39.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:39.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:39.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:39.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:39.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:39.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:39.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:39.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:39.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:39.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:39.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:39.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:39.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.597 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:39.597 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:39.597 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.371893263, 2020-06-12T02:37:39.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:39.598 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.598 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.598 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:39.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:39.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:39.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:39.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:39.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:39.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:39.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:39.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:39.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:39.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:39.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:39.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:39.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:39.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:39.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.610 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.227570685, 2020-06-12T02:37:39.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:39.612 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.612 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.613 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:39.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.613 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:39.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:39.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:39.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:39.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:39.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:39.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:39.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:39.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:39.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:39.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:39.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.623 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:39.623 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:39.623 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.486501188000005, 2020-06-12T02:37:39.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:39.624 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.624 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.625 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.625 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.625 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:39.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.626 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:39.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:39.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:39.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:39.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:39.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:39.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:39.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:39.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:39.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:39.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:39.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:39.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:39.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:39.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:39.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:39.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:39.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:39.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.639 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.640 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:39.640 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:39.640 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.548798786999996, 2020-06-12T02:37:39.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:39.641 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.641 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.641 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.641 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:39.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:39.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:39.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:39.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:39.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:39.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:39.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:39.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:39.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:39.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:39.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:39.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:39.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:39.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:39.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:39.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:39.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:39.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:39.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:39.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:39.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:39.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:39.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:39.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.657 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.658 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:39.658 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:39.658 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.566922707000003, 2020-06-12T02:37:39.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:39.658 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.659 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.659 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:39.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:39.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:39.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:39.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:39.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:39.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:39.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:39.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:39.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:39.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:39.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:39.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:39.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:39.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:39.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:39.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:39.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:39.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.566729390999996, 2020-06-12T02:37:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:39.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:39.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:39.686 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.566580935999994, 2020-06-12T02:37:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:39.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:39.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.699 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.559147985999999, 2020-06-12T02:37:39.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:39.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.709 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.556739485999998, 2020-06-12T02:37:39.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:39.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.554712340999998, 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:39.722 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:39.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:39.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:39.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:39.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.734 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:39.734 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:39.734 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 93.543662507999997, 2020-06-12T02:37:39.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:39.735 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.735 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:39.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:39.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:39.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:39.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:39.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:39.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:39.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:39.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:39.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:39.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:39.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:39.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:39.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:39.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:39.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:39.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:39.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:39.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:39.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.539449490999999, 2020-06-12T02:37:39.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:39.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.753 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:39.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:39.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:39.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:39.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:39.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:39.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:39.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:39.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:39.765 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:39.766 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:39.767 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.539266291999994, 2020-06-12T02:37:39.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:39.767 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.767 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.767 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.768 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.768 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.768 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:39.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.768 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:39.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:39.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:39.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:39.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:39.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:39.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:39.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:39.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:39.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:39.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:39.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:39.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:39.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:39.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:39.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:39.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:39.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:39.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.781 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.781 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.782 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:39.782 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:39.782 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.082348248000002, 2020-06-12T02:37:39.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:39.782 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:39.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:39.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:39.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:39.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:39.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:39.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:39.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:39.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:39.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:39.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:39.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:39.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:39.792 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.792 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.792 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.551886651000004, 2020-06-12T02:37:39.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.795 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:39.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.795 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:39.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:39.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:39.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:39.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:39.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:39.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:39.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:39.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:39.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:39.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:39.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:39.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:39.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:39.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:39.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:39.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:39.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:39.806 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.806 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:39.807 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 69.551627531999998, 2020-06-12T02:37:39.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:39.808 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:39.808 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:39.808 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:39.808 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:39.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:39.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:39.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:39.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:39.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:39.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:39.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:39.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:39.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:39.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:39.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:39.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:39.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:39.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:39.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:39.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:39.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:39.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:39.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:39.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:39.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:39.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:39.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:39.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:39.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:39.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:39.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:39.821 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.822 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.822 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.822 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:39.822 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:39.822 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:39.824 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:39.822+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:39.824 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:39.925 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:39.922+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:39.980 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:39.981 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:39.981 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:39.990 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:40.041 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:40.037+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:40.093 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:40.093 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:40.094 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:40.094 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:40.102 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:40.147 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:40.141+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:40.228 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:40.221+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:40.256 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:40.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 129.10594720899999, 2020-06-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:37:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:37:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:37:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:37:40.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:37:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.959433698, 2020-06-12T02:37:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:37:40.270 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:37:40.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:37:40.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.281885024000005, 2020-06-12T02:37:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:37:40.283 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.284 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:40.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:40.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:37:40.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:37:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:37:40.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:37:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:37:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:37:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:37:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:37:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:37:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:37:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:37:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:37:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:37:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.281121096000007, 2020-06-12T02:37:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:37:40.299 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:37:40.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:40.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:40.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:37:40.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:37:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:37:40.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:37:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:37:40.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:37:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:37:40.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:37:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:37:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:37:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:37:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:37:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:37:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:37:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:37:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:37:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:37:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.058316040999998, 2020-06-12T02:37:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:37:40.317 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.318 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:37:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:40.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:37:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:37:40.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:37:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:37:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:37:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:37:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:37:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:37:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:37:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:37:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:37:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:37:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:37:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:37:40.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:37:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.331 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.332 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.050029753999993, 2020-06-12T02:37:40.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:37:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:37:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:37:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:37:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:37:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:37:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:37:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:37:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:37:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:37:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:37:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:37:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:37:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:37:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:37:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:37:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:37:40.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:37:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.043000509999999, 2020-06-12T02:37:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:37:40.348 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.349 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:37:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:40.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:37:40.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:37:40.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:37:40.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:37:40.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:37:40.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:37:40.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:37:40.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:37:40.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:37:40.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:37:40.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:37:40.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:37:40.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:37:40.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:37:40.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:37:40.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:37:40.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:37:40.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.362 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:40.364 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:40.365 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 96.042863058999998, 2020-06-12T02:37:40.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:37:40.365 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.365 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:40.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:40.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:37:40.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:37:40.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:37:40.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:37:40.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:37:40.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:37:40.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:37:40.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:37:40.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:37:40.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:37:40.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:37:40.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:40.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:37:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:37:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:37:40.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:37:40.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:37:40.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:37:40.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:37:40.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:37:40.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.378 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 91.242075319999998, 2020-06-12T02:37:40.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:37:40.380 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.380 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.381 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:37:40.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.381 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:40.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:40.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:37:40.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:37:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:37:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:37:40.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:40.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:37:40.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:37:40.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:40.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:37:40.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:37:40.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:37:40.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:37:40.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:37:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:37:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:37:40.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:37:40.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:37:40.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:37:40.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:37:40.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:37:40.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:37:40.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:37:40.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.396 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.396 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:40.397 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:40.397 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 91.241928705999996, 2020-06-12T02:37:40.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:37:40.397 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.397 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.398 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:37:40.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.399 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:40.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:40.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:37:40.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:37:40.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:37:40.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:37:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:37:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:37:40.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:37:40.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:37:40.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:37:40.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:40.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:37:40.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:37:40.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:37:40.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:37:40.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:37:40.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:37:40.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:37:40.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:37:40.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:37:40.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:37:40.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:37:40.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:37:40.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:37:40.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:37:40.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.416 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.418 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:40.418 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:40.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.285915832000001, 2020-06-12T02:37:40.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:37:40.419 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.419 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.420 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:37:40.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.420 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:40.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:40.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:37:40.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:37:40.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:37:40.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:37:40.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:37:40.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:37:40.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:37:40.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:37:40.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:37:40.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:37:40.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:37:40.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:37:40.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:37:40.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:37:40.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:37:40.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:37:40.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:37:40.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:37:40.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:37:40.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:37:40.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:37:40.434 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.435 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.435 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.435 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:40.436 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:40.436 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.280184319, 2020-06-12T02:37:40.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:37:40.436 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.437 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.437 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.437 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.437 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.438 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:37:40.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.438 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:40.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:37:40.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:37:40.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:37:40.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:37:40.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:37:40.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:37:40.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:37:40.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:37:40.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:37:40.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:37:40.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:37:40.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:37:40.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:37:40.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:37:40.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:37:40.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:37:40.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:37:40.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:37:40.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:37:40.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:37:40.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:37:40.452 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.452 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.453 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.453 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:40.454 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:40.454 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.279690802999994, 2020-06-12T02:37:40.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:37:40.454 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.455 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.456 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:37:40.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.456 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:40.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:40.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:37:40.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:37:40.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:37:40.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:37:40.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:37:40.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:37:40.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:37:40.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:37:40.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:37:40.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:37:40.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:37:40.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:37:40.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:37:40.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:37:40.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:37:40.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:37:40.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:37:40.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:37:40.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:37:40.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:37:40.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:37:40.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.472 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.472 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.473 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:40.473 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:40.473 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.279596796000007, 2020-06-12T02:37:40.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:37:40.474 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.474 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.474 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.475 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:37:40.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.475 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:40.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:40.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:37:40.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:37:40.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:37:40.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:37:40.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:37:40.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:37:40.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:37:40.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:37:40.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:37:40.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:37:40.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:37:40.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:40.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:37:40.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:37:40.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:37:40.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:37:40.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:37:40.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:37:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:37:40.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:37:40.488 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.488 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.488 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.489 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:37:40.489 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:40.489 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.241435766999999, 2020-06-12T02:37:40.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:37:40.490 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.490 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:40.490 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:40.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:40.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:37:40.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:37:40.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:37:40.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:37:40.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:37:40.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:37:40.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:37:40.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:37:40.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:37:40.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:37:40.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:37:40.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:37:40.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:37:40.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:37:40.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:37:40.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:37:40.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:37:40.502 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.502 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.502 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.503 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:40.503 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:40.503 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.200638773999998, 2020-06-12T02:37:40.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:37:40.504 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.504 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.504 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.504 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.505 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.505 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:37:40.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.505 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:40.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:40.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:37:40.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:37:40.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:37:40.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:37:40.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:37:40.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:37:40.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:37:40.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:37:40.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:37:40.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:37:40.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:37:40.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:37:40.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:37:40.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:37:40.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:37:40.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.516 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.517 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:40.517 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:40.518 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.200396708, 2020-06-12T02:37:40.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:37:40.518 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.518 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.519 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.519 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:37:40.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.520 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:40.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:40.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:37:40.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:37:40.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:37:40.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:37:40.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:37:40.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:37:40.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:37:40.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:37:40.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:37:40.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:37:40.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:37:40.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:37:40.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:37:40.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:37:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:37:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.200187017000005, 2020-06-12T02:37:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:37:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.534 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:40.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:37:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:37:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:37:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:37:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:37:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:37:40.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:37:40.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:37:40.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:37:40.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:37:40.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:37:40.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:37:40.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:37:40.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:37:40.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:37:40.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:37:40.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.546 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.546 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.546 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:37:40.547 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:40.547 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 79.184652856, 2020-06-12T02:37:40.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:37:40.547 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.547 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.548 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.548 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.548 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.548 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:37:40.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.549 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:40.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:37:40.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:37:40.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:37:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:37:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:37:40.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:37:40.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:37:40.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:37:40.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:37:40.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:37:40.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:37:40.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:37:40.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:37:40.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:37:40.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:37:40.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:37:40.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.559 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.560 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:37:40.561 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:40.561 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 70.286592822000003, 2020-06-12T02:37:40.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:37:40.562 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.562 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.563 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:37:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:37:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:37:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:37:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:37:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:37:40.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:37:40.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:37:40.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:37:40.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:37:40.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:37:40.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:37:40.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:37:40.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:37:40.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:37:40.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.576 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.577 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:40.578 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:37:40.580 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:40.581 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:40.573+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:40.680 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:40.678+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:40.707 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:40.690+0000 7f963f54c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:40.708 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:40.702+0000 7f963f54c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:40.738 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:40.738 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:40.739 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:40.739 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:40.749 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:40.782 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:40.778+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:40.854 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:40.855 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:40.855 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:40.863 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:40.909 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:40.905+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:40.979 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:40.979 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:40.980 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.848754157, 2020-06-12T02:37:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:37:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.981 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:37:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:37:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:37:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:37:40.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:37:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:37:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:37:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:40.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:37:40.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:37:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:37:40.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:37:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:37:40.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:37:40.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:37:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:37:40.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:37:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:37:40.996 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:40.997 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.84861522099999, 2020-06-12T02:37:40.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:37:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:40.999 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:37:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:37:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:37:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:37:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:37:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:37:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:37:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:41.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:37:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:37:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:37:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:37:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:37:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:37:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:37:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:37:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:37:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:37:41.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:37:41.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:37:41.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:37:41.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:37:41.015 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.015 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.018 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:41.018 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:41.019 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.84847938300001, 2020-06-12T02:37:41.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:37:41.019 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.019 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:41.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.020 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:37:41.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.021 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:41.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:37:41.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:37:41.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:37:41.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:37:41.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:37:41.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:37:41.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:37:41.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:37:41.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:37:41.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:37:41.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:41.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:37:41.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:37:41.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:37:41.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:37:41.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:37:41.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:37:41.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:37:41.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:37:41.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:37:41.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:37:41.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:37:41.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:37:41.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.039 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.039 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.040 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:41.040 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:41.040 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 129.824814535, 2020-06-12T02:37:41.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:37:41.040 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:41.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:41.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:37:41.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:37:41.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:37:41.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:37:41.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:37:41.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:37:41.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:37:41.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:37:41.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:37:41.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:37:41.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:37:41.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:37:41.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:37:41.050 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:37:41.051 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:41.052 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 121.777370625, 2020-06-12T02:37:41.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:37:41.052 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.052 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:41.052 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.053 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:37:41.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.053 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:41.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:41.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:37:41.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:37:41.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:37:41.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:37:41.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:37:41.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:37:41.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:37:41.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:37:41.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 116.03363358199999, 2020-06-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:37:41.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:37:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:37:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:37:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:37:41.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:37:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:37:41.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:37:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:37:41.083 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.084 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:41.085 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 116.032660212, 2020-06-12T02:37:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:37:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.086 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:41.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:41.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:37:41.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:37:41.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:37:41.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:37:41.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:37:41.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:37:41.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:37:41.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 116.031451092, 2020-06-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.108 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.109 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.109 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:41.109 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:41.110 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 116.030188107, 2020-06-12T02:37:41.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:37:41.110 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.110 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.110 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:41.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:41.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:37:41.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:37:41.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:37:41.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:37:41.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:37:41.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:37:41.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:37:41.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:37:41.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:37:41.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:37:41.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:37:41.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:37:41.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:37:41.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:37:41.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:37:41.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.121 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.121 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:37:41.122 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:41.122 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.018729980000003, 2020-06-12T02:37:41.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:37:41.122 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.122 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.123 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:41.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:37:41.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:37:41.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:37:41.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:37:41.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:37:41.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:37:41.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:37:41.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:37:41.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:37:41.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:37:41.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:37:41.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.133 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:37:41.133 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:41.133 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 95.015728940000002, 2020-06-12T02:37:41.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:41.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:37:41.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:37:41.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:37:41.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:37:41.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:37:41.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:37:41.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:37:41.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:37:41.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:37:41.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:37:41.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:37:41.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:37:41.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.145 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:41.145 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:41.145 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.992902940999997, 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.146 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.147 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:37:41.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.147 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:41.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:37:41.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:37:41.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:37:41.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:37:41.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:37:41.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:37:41.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:37:41.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:37:41.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:37:41.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:37:41.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:37:41.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:37:41.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.157 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.158 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.158 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:41.158 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.992757549000004, 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.159 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.160 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.160 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:37:41.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.160 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:41.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:37:41.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:37:41.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:37:41.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:37:41.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:37:41.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:37:41.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:37:41.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:37:41.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:37:41.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:37:41.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:41.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:37:41.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:37:41.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:41.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:37:41.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:37:41.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:37:41.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:37:41.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.173 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.173 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.960616270000003, 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:41.174 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.182 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:37:41.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.182 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:41.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:37:41.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:37:41.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:37:41.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:37:41.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:37:41.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:37:41.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:37:41.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:37:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:37:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:37:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:37:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:37:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:37:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:37:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:37:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:37:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:37:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:37:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:41.196 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:41.196 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.955489635000006, 2020-06-12T02:37:41.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:37:41.196 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.196 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:41.197 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.197 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.197 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.197 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:37:41.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:41.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:37:41.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:37:41.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:37:41.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:37:41.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:37:41.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:37:41.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:37:41.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:37:41.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:37:41.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:37:41.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:37:41.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:37:41.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:37:41.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:37:41.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:37:41.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:37:41.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.210 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:41.211 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:41.211 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.955110625000003, 2020-06-12T02:37:41.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:37:41.211 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.211 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:41.212 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.212 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.212 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.212 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:37:41.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.213 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:41.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:41.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:37:41.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:37:41.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:37:41.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:37:41.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:37:41.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:37:41.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:37:41.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:37:41.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:37:41.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:37:41.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:37:41.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:37:41.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:37:41.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:37:41.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:37:41.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:37:41.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:37:41.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:41.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:37:41.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:37:41.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:37:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:37:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.233 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:41.235 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:41.236 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.954893170000005, 2020-06-12T02:37:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:37:41.237 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.238 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:37:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:37:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:37:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:37:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:37:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:37:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:37:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:37:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:37:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:37:41.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:37:41.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:41.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:37:41.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:37:41.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:37:41.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:37:41.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:37:41.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:37:41.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.252 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:41.252 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:41.252 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.590950925000001, 2020-06-12T02:37:41.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:37:41.253 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.253 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:41.253 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.253 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.253 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.254 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:37:41.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.254 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:41.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:41.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:37:41.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:37:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:37:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:37:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:37:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:37:41.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:37:41.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:37:41.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:37:41.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:37:41.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:37:41.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:37:41.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:37:41.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:37:41.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:37:41.267 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.268 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.268 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.270 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:37:41.271 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:41.271 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 81.001898138000001, 2020-06-12T02:37:41.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:37:41.271 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.272 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:41.272 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:41.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:41.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:37:41.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:37:41.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:37:41.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:37:41.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:37:41.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:37:41.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:37:41.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:37:41.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:37:41.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:37:41.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:37:41.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:41.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:37:41.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:37:41.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:41.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:37:41.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:37:41.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:37:41.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:37:41.290 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.291 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.291 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.292 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:41.292 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:41.293 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 80.998864565000005, 2020-06-12T02:37:41.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:37:41.293 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:41.293 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:41.294 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:41.295 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:41.295 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:41.295 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:37:41.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:41.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:41.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:41.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:37:41.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:41.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:37:41.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:37:41.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:41.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:37:41.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:37:41.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:41.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:37:41.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:37:41.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:41.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:37:41.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:37:41.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:37:41.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:37:41.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:41.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:37:41.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:37:41.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:37:41.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:37:41.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:41.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:37:41.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:37:41.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:41.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:37:41.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:37:41.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:41.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:37:41.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:37:41.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:41.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:41.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:41.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:37:41.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:37:41.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.312 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.312 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:41.312 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:41.313 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:41.316 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:37:41.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:41.309+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:41.317 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:41.415 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:41.409+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:41.472 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:41.473 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:41.473 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:41.473 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:41.480 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:41.483 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:41.526 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:41.521+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:41.594 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:41.590+0000 7fe64f84c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:41.594+0000 7fe64e5ea700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:41.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:41.609+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:41.631 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:41.641 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:41.641 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:41.641 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:41.642 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:41.642 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:41.646 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:41.650 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:41.674 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:41.696 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:41.718 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:41.736 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:41.729+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:41.742 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:41.770 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.771 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:41.772 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.773 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.774 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:41.774 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:41.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:41.800 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:41.801 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:41.811 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:41.824 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:41.818+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:41.924 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:41.917+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:41.931 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:41.931 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:41.942 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:42.025 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:42.021+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:42.055 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.056 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.065 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:42.127 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:42.125+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:42.171 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.171 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.206 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:42.230 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:42.221+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:42.329 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:42.325+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:42.331 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.331 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.342 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:42.429 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:42.426+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:42.452 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.452 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.461 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:42.548 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:42.546+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:42.613 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.614 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.622 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:42.632 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:42.629+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:42.736 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:42.733+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:42.778 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.779 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.793 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:42.836 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:42.829+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:42.904 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:42.904 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:42.914 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:42.963 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:42.962+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:43.026 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.026 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.037 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:43.082 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:43.078+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:43.141 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:43.138+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:43.154 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.155 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.183 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:43.242 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:43.237+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:43.309 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.310 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.319 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:37:43.320 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:43.367 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:43.366+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:43.443 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:43.430+0000 7fda82acc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:43.446 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:43.438+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:43.446 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:43.442+0000 7fda8186a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:43.474 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.474 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.483 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:43.554 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:43.546+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:43.589 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.589 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.611 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:43.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:43.653+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:43.721 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.721 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.730 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:43.777 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:43.773+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:43.784 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:43.858 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:43.854+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:43.887 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:43.887 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:43.893 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:43.890+0000 7f462d642700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:43.896 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:43.899 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:43.894+0000 7f462d642700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:43.941 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:43.958 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:43.954+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:43.960 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:43.983 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:44.006 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:37:44.007 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:44.008 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:44.019 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:44.020 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:44.038 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:44.066 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:44.054+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:44.066 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:44.084 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.087 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:44.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:44.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:44.136 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:44.136 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:44.137 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:44.137 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:44.138 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:44.159 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:44.158+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:44.252 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:44.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.12737695999999, 2020-06-12T02:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:37:44.254 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.255 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:37:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:37:44.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:37:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:37:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:37:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:37:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:37:44.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:37:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:37:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:37:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:37:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:37:44.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:37:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:37:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:37:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:37:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:37:44.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:37:44.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:37:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:37:44.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:37:44.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:37:44.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:37:44.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:37:44.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:37:44.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:37:44.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:37:44.296 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.296 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.296 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.297 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:44.297 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.12723802400001, 2020-06-12T02:37:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:37:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.298 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.301 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.302 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:37:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:37:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:37:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:37:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:37:44.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:37:44.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:37:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:37:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:37:44.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:37:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:37:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:37:44.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:37:44.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:37:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:37:44.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:37:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:37:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:37:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:37:44.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:37:44.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:37:44.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:37:44.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:37:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:37:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:37:44.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:37:44.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.347 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.347 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.349 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:44.349 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:44.350 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.127102186, 2020-06-12T02:37:44.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:37:44.351 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.351 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.351 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.352 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.352 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:37:44.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.353 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:44.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:37:44.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:37:44.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:37:44.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:37:44.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:37:44.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:37:44.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:37:44.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:37:44.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:37:44.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:37:44.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:37:44.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:37:44.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:37:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:37:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:37:44.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:37:44.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:37:44.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:37:44.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:37:44.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:37:44.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:37:44.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:37:44.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:37:44.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:37:44.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:37:44.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:37:44.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.375 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.375 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.376 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:44.377 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:44.377 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 133.10343733799999, 2020-06-12T02:37:44.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:37:44.378 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.378 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.378 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:44.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:37:44.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:37:44.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:37:44.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:37:44.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:37:44.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:37:44.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:37:44.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:37:44.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:37:44.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:37:44.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:37:44.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:37:44.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:37:44.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:37:44.389 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.389 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.389 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.05599342799999, 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.391 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.391 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:37:44.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.392 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:44.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:37:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:37:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:37:44.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:37:44.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:37:44.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:37:44.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:37:44.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:37:44.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:37:44.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:37:44.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:44.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:37:44.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:37:44.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:37:44.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:37:44.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:37:44.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:37:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:37:44.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:37:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:37:44.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:37:44.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:37:44.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:37:44.405 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.406 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.406 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.407 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:44.407 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:44.407 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.312256385, 2020-06-12T02:37:44.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:37:44.408 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.408 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.408 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:44.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:37:44.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:37:44.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:37:44.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:37:44.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:37:44.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:37:44.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:37:44.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:37:44.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:37:44.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:37:44.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:37:44.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:37:44.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.418 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.419 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:44.419 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:44.419 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.311283015, 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:37:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:37:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:37:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:37:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:37:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:37:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:37:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:37:44.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.428 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:37:44.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:37:44.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.429 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.430 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.430 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:37:44.430 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:44.431 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.310073895, 2020-06-12T02:37:44.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:37:44.431 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.431 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.431 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:44.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:37:44.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:37:44.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:37:44.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:37:44.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:37:44.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:37:44.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:37:44.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:37:44.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:37:44.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:37:44.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:37:44.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:37:44.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:37:44.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:37:44.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:37:44.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:37:44.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:37:44.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:37:44.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.447 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.448 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:37:44.448 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:44.449 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.30881091000001, 2020-06-12T02:37:44.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:37:44.449 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.449 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.450 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:44.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:37:44.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:37:44.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.458 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:37:44.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:37:44.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:37:44.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:37:44.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:37:44.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:37:44.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:37:44.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:37:44.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:37:44.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:37:44.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:37:44.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:37:44.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:37:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:37:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:37:44.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:37:44.470 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.471 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.471 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.472 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:37:44.472 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:44.473 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.297352782999994, 2020-06-12T02:37:44.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:37:44.473 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.473 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.474 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:44.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:37:44.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:37:44.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:37:44.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:37:44.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:37:44.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:37:44.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:37:44.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:37:44.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:37:44.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:37:44.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:37:44.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:37:44.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:37:44.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:37:44.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.486 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:37:44.486 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:44.486 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.294351742999993, 2020-06-12T02:37:44.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:37:44.487 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.487 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.488 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:44.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:37:44.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:37:44.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:37:44.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:37:44.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:37:44.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:37:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:37:44.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:37:44.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:37:44.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:37:44.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:37:44.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:37:44.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:37:44.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:37:44.498 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.498 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.498 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.499 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:44.500 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:44.500 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.271525744000002, 2020-06-12T02:37:44.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:37:44.501 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.501 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:44.501 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.502 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:37:44.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.503 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:44.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:37:44.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:37:44.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:37:44.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:37:44.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:37:44.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:37:44.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:37:44.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:37:44.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:37:44.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:37:44.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:37:44.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:37:44.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:37:44.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:37:44.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:37:44.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:37:44.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:37:44.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.516 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:44.517 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:44.517 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.271380351999994, 2020-06-12T02:37:44.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:37:44.517 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.517 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.518 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:37:44.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:37:44.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:37:44.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:37:44.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:37:44.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:37:44.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:37:44.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:37:44.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:37:44.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:44.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:37:44.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:37:44.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:37:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:37:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:44.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:37:44.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:37:44.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:37:44.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:37:44.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:37:44.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:37:44.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.532 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:44.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:44.533 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.239239072999993, 2020-06-12T02:37:44.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:37:44.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.534 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:37:44.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.535 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:44.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:37:44.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:37:44.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:37:44.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:37:44.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:37:44.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:37:44.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:37:44.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:37:44.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:37:44.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:37:44.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:37:44.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:37:44.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:37:44.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:37:44.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:37:44.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:37:44.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:37:44.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:37:44.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.547 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.234112437999997, 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.548 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.549 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.549 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.549 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.549 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:37:44.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.550 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:44.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:37:44.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:37:44.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:37:44.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:37:44.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:37:44.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:37:44.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:37:44.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:37:44.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:37:44.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:37:44.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:37:44.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:37:44.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:37:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:37:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.562 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:44.562 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:44.562 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.233733427999994, 2020-06-12T02:37:44.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:37:44.563 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.563 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:44.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:44.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:37:44.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:37:44.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:37:44.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:37:44.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:37:44.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:37:44.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:37:44.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:37:44.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:37:44.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:37:44.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:37:44.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:37:44.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:37:44.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:37:44.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:37:44.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:37:44.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:44.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:37:44.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:37:44.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.577 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:44.577 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:44.577 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.233515972999996, 2020-06-12T02:37:44.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:37:44.577 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.578 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:37:44.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.579 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:37:44.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:37:44.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:37:44.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:37:44.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:37:44.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:37:44.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:37:44.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:37:44.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:44.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:37:44.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:37:44.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:37:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:37:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:37:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:37:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.589 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:44.590 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 88.869573728000006, 2020-06-12T02:37:44.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:37:44.591 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.591 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:44.591 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.591 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.592 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.592 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:37:44.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.592 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:37:44.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:37:44.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:37:44.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:37:44.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:37:44.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:37:44.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:37:44.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:37:44.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:37:44.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:37:44.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.601 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:37:44.602 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:44.602 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.280520941000006, 2020-06-12T02:37:44.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:37:44.602 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.602 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:44.603 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:44.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:37:44.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:37:44.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:37:44.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:37:44.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:37:44.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:37:44.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:37:44.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:37:44.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:37:44.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:44.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:37:44.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:37:44.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:37:44.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:37:44.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.612 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.613 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:44.613 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:44.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 84.277487367999996, 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:44.614 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:44.615 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:37:44.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.615 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:44.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:44.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:44.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:44.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:44.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:37:44.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:37:44.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:44.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:37:44.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:37:44.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:44.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:37:44.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:37:44.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:37:44.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:37:44.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:44.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:37:44.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:37:44.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:44.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:37:44.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:37:44.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:44.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:37:44.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:37:44.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:44.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:44.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:44.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:37:44.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:37:44.627 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.627 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:44.628 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:44.628 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:44.630 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:44.635 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:44.629+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:44.738 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:44.734+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:44.760 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:44.761 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:44.761 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:44.761 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:44.770 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:44.838 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:44.834+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:44.897 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:44.897 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:44.898 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:44.898 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:44.906 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:44.933 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:44.930+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:45.033 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:45.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:37:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:45.034 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.781966064, 2020-06-12T02:37:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:37:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:37:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.036 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:45.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:37:45.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:37:45.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:37:45.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:37:45.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:37:45.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:37:45.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:37:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:37:45.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:37:45.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:37:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:37:45.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:37:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:37:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:37:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:37:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:37:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:37:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:37:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:37:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:37:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.052 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.054 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:37:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.78054901199999, 2020-06-12T02:37:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:37:45.055 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:37:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:37:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:37:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:37:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:37:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:37:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:37:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:37:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:37:45.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:37:45.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:37:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:37:45.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:37:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:37:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:37:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:37:45.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:37:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.069985024000005, 2020-06-12T02:37:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:37:45.088 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.089 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:37:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:37:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:37:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:37:45.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:37:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:37:45.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:37:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:37:45.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:37:45.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:37:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:37:45.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:37:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:37:45.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:37:45.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:37:45.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:37:45.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:37:45.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:37:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:37:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:37:45.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:37:45.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:37:45.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:37:45.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.104 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.105 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.105 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.106 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:45.106 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.062303721999996, 2020-06-12T02:37:45.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:37:45.106 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.106 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.107 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.107 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.107 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.107 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:37:45.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:37:45.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:37:45.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:37:45.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:37:45.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:37:45.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:37:45.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:37:45.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:37:45.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:37:45.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:37:45.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:37:45.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:37:45.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:37:45.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:37:45.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:37:45.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:37:45.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:37:45.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:37:45.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:37:45.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:37:45.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.121 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.121 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.122 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.122 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:45.122 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.053248425000007, 2020-06-12T02:37:45.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.123 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:37:45.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.124 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:37:45.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:37:45.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:37:45.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:37:45.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:37:45.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:37:45.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:37:45.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:37:45.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:37:45.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:37:45.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:37:45.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:37:45.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:37:45.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:37:45.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:37:45.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:37:45.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:37:45.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:37:45.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:37:45.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:37:45.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:37:45.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:37:45.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:37:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:37:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.142 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.142 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.142 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.143 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:45.143 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.052308886000006, 2020-06-12T02:37:45.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:37:45.143 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.143 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.144 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:45.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:37:45.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:37:45.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:37:45.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:37:45.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:37:45.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:37:45.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:37:45.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:37:45.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:37:45.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:37:45.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:37:45.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:37:45.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:37:45.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:37:45.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:37:45.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:37:45.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:37:45.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:37:45.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:37:45.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:37:45.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.160 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:45.160 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:45.160 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.052176939000006, 2020-06-12T02:37:45.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:37:45.160 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.161 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.162 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:37:45.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.163 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:45.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:37:45.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:37:45.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:37:45.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:37:45.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:37:45.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:37:45.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:37:45.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:37:45.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:37:45.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:37:45.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:37:45.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:37:45.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:37:45.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:37:45.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:37:45.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:37:45.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:37:45.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:37:45.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:37:45.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:37:45.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.179 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.180 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.180 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:45.180 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.044504642000007, 2020-06-12T02:37:45.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:37:45.181 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.181 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.181 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:45.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:37:45.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:37:45.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:37:45.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:37:45.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:37:45.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:37:45.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:37:45.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:37:45.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:37:45.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:37:45.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:37:45.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:37:45.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:37:45.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:37:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:37:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:37:45.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:37:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:37:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.197 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.197 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:45.197 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.038529677, 2020-06-12T02:37:45.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:37:45.197 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.198 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.198 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:45.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:37:45.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:37:45.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:37:45.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:45.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:37:45.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:37:45.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:37:45.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:37:45.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:37:45.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:37:45.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:37:45.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:37:45.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:37:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:37:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:37:45.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:37:45.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.213 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.213 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:45.213 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.031698114999998, 2020-06-12T02:37:45.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:37:45.213 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:37:45.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:45.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:37:45.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:37:45.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:37:45.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:37:45.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:37:45.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:37:45.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:37:45.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:37:45.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:37:45.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:37:45.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:37:45.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:37:45.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:37:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:37:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:37:45.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:37:45.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:37:45.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:37:45.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:37:45.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:37:45.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.229 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.229 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.230 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:37:45.230 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:45.230 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.031015166000003, 2020-06-12T02:37:45.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:37:45.231 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.231 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.232 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:37:45.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.232 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:45.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:37:45.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:37:45.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:37:45.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:37:45.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:45.248 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 99.030928403999994, 2020-06-12T02:37:45.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:37:45.248 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.248 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.248 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.249 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.249 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:37:45.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.249 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:37:45.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:37:45.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:37:45.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:37:45.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:37:45.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.264 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.264 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.265 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:45.265 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:45.266 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.652534798000005, 2020-06-12T02:37:45.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:37:45.266 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.267 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.268 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.268 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.268 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:37:45.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.268 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:45.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:37:45.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:37:45.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:37:45.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:37:45.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:37:45.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:37:45.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:37:45.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:37:45.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:37:45.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:37:45.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:37:45.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:37:45.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:37:45.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:37:45.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:37:45.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.278 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.280 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:37:45.280 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:45.280 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.630112861000001, 2020-06-12T02:37:45.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:37:45.280 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.281 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.281 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.281 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.281 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.281 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:37:45.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.282 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:45.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:37:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:37:45.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:37:45.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:37:45.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:45.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:37:45.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:37:45.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:37:45.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:37:45.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:37:45.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:37:45.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:37:45.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:37:45.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:37:45.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:37:45.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:37:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:37:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:37:45.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.294 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.294 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.295 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:45.295 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:45.295 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.784138165000002, 2020-06-12T02:37:45.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:37:45.296 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.296 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.296 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.297 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:37:45.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.297 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:45.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:37:45.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:37:45.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:37:45.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:37:45.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:37:45.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:37:45.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:37:45.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:37:45.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:37:45.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:37:45.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:37:45.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:37:45.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:37:45.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:37:45.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:37:45.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:37:45.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:37:45.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:37:45.312 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.313 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.313 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.313 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:45.314 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:45.314 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.783321001000004, 2020-06-12T02:37:45.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:37:45.314 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.314 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.315 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:37:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:45.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:37:45.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:37:45.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:37:45.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:37:45.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:37:45.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:37:45.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:37:45.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:37:45.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:37:45.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:37:45.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:37:45.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:37:45.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:37:45.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:37:45.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:37:45.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:37:45.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:37:45.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:37:45.330 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.330 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.330 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.331 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:45.331 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:45.331 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.783084360999993, 2020-06-12T02:37:45.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:37:45.332 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.332 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:45.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:37:45.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:37:45.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:37:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:37:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:37:45.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:37:45.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:37:45.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:37:45.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:37:45.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:37:45.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:37:45.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:37:45.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:37:45.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:37:45.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:37:45.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:37:45.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:37:45.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:37:45.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:37:45.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:37:45.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:37:45.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:37:45.347 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.347 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.348 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.348 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:45.348 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.057591430000002, 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.349 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.350 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.350 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:37:45.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.350 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:45.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:37:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:37:45.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:37:45.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:37:45.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:37:45.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:37:45.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:37:45.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:37:45.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:37:45.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:37:45.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:37:45.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:37:45.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:45.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:37:45.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:37:45.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:37:45.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:37:45.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:37:45.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:37:45.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.362 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.057310616999999, 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:37:45.363 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.364 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.364 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.364 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.364 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.364 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:37:45.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.365 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:45.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:37:45.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:37:45.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:37:45.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:37:45.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:37:45.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:37:45.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:37:45.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:37:45.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:45.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:37:45.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:37:45.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:37:45.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:37:45.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:37:45.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:37:45.376 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.376 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.377 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.377 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:37:45.377 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:45.378 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 83.978539381999994, 2020-06-12T02:37:45.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:37:45.378 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:45.378 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:45.378 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:45.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:45.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.379 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:37:45.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.379 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:45.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:37:45.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:37:45.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:45.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:37:45.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:37:45.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:45.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:37:45.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:37:45.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:37:45.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:37:45.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:37:45.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:37:45.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:45.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:37:45.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:37:45.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:45.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:37:45.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:37:45.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:45.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:45.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:45.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:37:45.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:37:45.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.390 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.390 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:45.391 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:45.391 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:45.391 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:45.029+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:45.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:45.137+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:45.392 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:45.394 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:45.390+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:45.495 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:45.494+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:45.514 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:45.515 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:45.524 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:45.612 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:45.610+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:45.680 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:45.680 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:45.681 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:45.681 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:45.688 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:45.705 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:45.697+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:45.803 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:45.802+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:45.838 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.73911204300001, 2020-06-12T02:37:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:45.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:45.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:45.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:45.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.738941676, 2020-06-12T02:37:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:45.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:45.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.887 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.888 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:45.888 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:45.888 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.720803649, 2020-06-12T02:37:45.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:45.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:45.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:45.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:45.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:45.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:45.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:45.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:45.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:45.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:45.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:45.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:45.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:45.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:45.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:45.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:45.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:45.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:45.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:45.903 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.904 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:45.905 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:45.905 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.714866766, 2020-06-12T02:37:45.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.907 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:45.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.907 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:45.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:45.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:45.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:45.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:45.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:45.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:45.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:45.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:45.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:45.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:45.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.71435769499999, 2020-06-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:45.921 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.922 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.922 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.922 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.922 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:45.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.923 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:45.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:45.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:45.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:45.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:45.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:45.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:45.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:45.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:45.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:45.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:45.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:45.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:45.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:45.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:45.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:45.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:45.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:45.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:45.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:45.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:45.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:45.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:45.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:45.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:45.938 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:45.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.71419942899999, 2020-06-12T02:37:45.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:45.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:45.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.939 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:45.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.940 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:45.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:45.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:45.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:45.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:45.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:45.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:45.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:45.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:45.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:45.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:45.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:45.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:45.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:45.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:45.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 120.63980262699999, 2020-06-12T02:37:45.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:45.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.954 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.954 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.954 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.955 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.955 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:45.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.955 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:45.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:45.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:45.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:45.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:45.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:45.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:45.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:45.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:45.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:45.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:45.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:45.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:45.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:45.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:45.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:45.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:45.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:45.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.967 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:45.968 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 120.632791805, 2020-06-12T02:37:45.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:45.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.969 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:45.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.969 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:45.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:45.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:45.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:45.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:45.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:45.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:45.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:45.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:45.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:45.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:45.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:45.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:45.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:45.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:45.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.982 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.87300526200001, 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:45.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:45.985 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:45.985 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:45.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.985 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:45.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:45.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:45.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:45.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:45.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:45.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:45.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:45.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:45.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:45.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:45.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:45.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:45.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:45.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:45.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:45.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:45.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:45.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:45.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:45.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:45.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:45.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:45.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:45.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:45.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:45.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:45.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:45.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:45.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:45.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:46.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:46.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:46.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:46.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:46.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:46.003 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.003 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.003 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.004 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:46.004 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:46.004 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.87287766599999, 2020-06-12T02:37:46.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:46.004 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.005 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.005 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.005 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:46.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.006 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:46.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:46.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:46.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:46.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:46.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:46.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:46.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:46.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:46.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457897024999994, 2020-06-12T02:37:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:46.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:46.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:46.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:46.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:46.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:46.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:46.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457752267999993, 2020-06-12T02:37:46.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.038 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:46.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457621418000002, 2020-06-12T02:37:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:46.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:46.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:46.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:46.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:46.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:46.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:46.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:46.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:46.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:46.061 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457477096000005, 2020-06-12T02:37:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.062 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:46.076 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457365115000002, 2020-06-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.078 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:46.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:46.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:46.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:46.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:46.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:46.091 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.457212630000001, 2020-06-12T02:37:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:46.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:46.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:46.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:46.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:46.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:46.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:46.106 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:46.106 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.436467492000006, 2020-06-12T02:37:46.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:46.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.108 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:46.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:46.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:46.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:46.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:46.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:46.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:46.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:46.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:46.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:46.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:46.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:46.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:46.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:46.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:46.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.436142398000001, 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:46.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.123 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:46.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:46.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:46.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:46.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:46.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:46.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:46.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:46.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:46.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:46.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:46.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:46.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:46.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:46.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:46.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:46.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:46.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:46.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:46.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:46.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:46.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.138 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:46.138 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:46.138 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.320495914999995, 2020-06-12T02:37:46.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:46.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.139 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:46.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.139 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:46.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.140 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:46.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:46.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:46.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:46.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:46.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:46.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:46.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:46.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:46.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:46.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:46.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:46.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:46.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:46.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:46.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.154 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.154 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:46.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:46.155 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.320155657000001, 2020-06-12T02:37:46.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:46.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:46.155 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.156 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:46.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:46.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:46.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:46.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:46.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:46.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:46.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:46.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:46.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:46.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:46.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:46.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:46.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:46.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:46.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:46.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:46.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:46.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:46.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:46.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:46.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:46.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:46.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:46.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:46.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:46.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:46.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:46.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:46.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:46.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:46.172 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:46.172 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:37:46.173 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:46.175 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:46.169+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:46.175 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:46.283 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:46.282+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:46.314+0000 7ff9c0a6c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:46.322+0000 7ff9bb59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:46.331 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:46.322+0000 7ff7c57fb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:46.336 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:46.330+0000 7ff7bffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:46.346 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:46.347 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:46.347 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:46.347 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:46.356 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:46.357 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:46.389 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:46.390 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:46.386+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:46.409 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:46.431 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:46.469 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:46.470 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:46.470 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:46.472 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:46.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:46.469+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:46.483 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:46.509 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:46.509 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.510 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.510 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:46.510 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:46.510 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.510 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.517 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.517 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.518 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:46.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:46.518 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:46.585 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:46.574+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:46.590 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:46.591 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:46.600 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:46.693 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:46.690+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:46.751 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:46.751 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:46.762 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:46.804 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:46.802+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:46.883 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:46.878+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:46.913 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:46.913 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:46.922 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:46.985 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:46.981+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:47.016 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:37:47.079 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.080 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.085 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:47.082+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:47.089 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:47.197 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:47.190+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:47.203 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.203 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.213 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:47.293 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:47.290+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:47.324 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.324 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.333 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:47.395 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:47.389+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:47.442 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.443 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.451 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:47.496 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:47.494+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:47.615 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.616 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.616 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:47.609+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:47.616 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:47.716 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:47.709+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:47.764 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.764 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.773 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:47.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:47.813+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:47.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:47.913+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:47.930 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:47.931 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:47.936 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:48.019 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:48.014+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:48.091 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.091 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.100 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:48.120 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:48.118+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:48.209 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.209 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.220 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:48.240 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:48.230+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:48.342 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:48.338+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:48.343 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.343 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.353 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:48.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:48.437+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:48.460 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.461 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.470 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:48.520 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:48.557 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:48.553+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:48.618 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.618 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.628 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:48.626+0000 7f8ecf421700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:48.634+0000 7f8ece1bf700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:48.648 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:48.646+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:48.678 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:48.693 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:48.714 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:48.739 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:48.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:48.745+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:48.764 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:48.782 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:48.783 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:48.787 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:48.797 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:48.812 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:48.812 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.813 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.813 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:48.813 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:48.813 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.813 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.814 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.814 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.814 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:48.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:48.816 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:48.850 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:48.845+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:48.910 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:48.911 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:48.931 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:48.975 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:48.974+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:49.029 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:37:49.044 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:49.045 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:49.046 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:49.046 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:49.046 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:49.054 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:49.050+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:49.055 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:49.137 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:49.126+0000 7efc5f289700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:49.141 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:49.138+0000 7efc5f289700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:49.160 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:49.149+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:49.207 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:49.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:49.209 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.10847392299999, 2020-06-12T02:37:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.210 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:49.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:49.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:49.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:49.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:49.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.10830355600001, 2020-06-12T02:37:49.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:49.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:49.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:49.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:49.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:49.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:49.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:49.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:49.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:49.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:49.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:49.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:49.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:49.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:49.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:49.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.09016552899999, 2020-06-12T02:37:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:49.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:49.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:49.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:49.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:49.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:49.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:49.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.280 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:49.281 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.08422864600001, 2020-06-12T02:37:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.284 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:49.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:49.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:49.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:49.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:49.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.083719575, 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.303 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:49.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:49.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:49.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:49.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.316 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:49.317 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.083561309, 2020-06-12T02:37:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.318 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.319 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:49.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:49.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 124.00916450699999, 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:49.333 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.334 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:49.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 124.002153685, 2020-06-12T02:37:49.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:49.349 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.24236714200001, 2020-06-12T02:37:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.24223954599999, 2020-06-12T02:37:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.827258904999994, 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.827114148000007, 2020-06-12T02:37:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.826983298000002, 2020-06-12T02:37:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.826838976000005, 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:49.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.826726995000001, 2020-06-12T02:37:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.82657451, 2020-06-12T02:37:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:49.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:49.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:49.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:49.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:49.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.493 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.805829372000005, 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.494 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.495 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:49.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:49.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:49.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:49.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:49.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:49.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:49.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:49.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:49.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:49.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:49.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:49.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.509 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.509 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:49.510 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:49.510 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.805504278000001, 2020-06-12T02:37:49.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:49.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.512 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:49.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:49.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:49.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:49.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:49.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:49.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:49.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:49.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:49.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:49.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:49.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:49.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:49.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:49.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:49.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:49.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:49.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:49.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.527 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:49.527 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:49.527 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.689857794999995, 2020-06-12T02:37:49.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:49.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:49.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.528 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.528 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:49.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:49.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:49.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:49.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:49.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:49.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:49.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:49.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:49.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:49.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:49.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:49.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:49.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:49.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:49.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:49.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:49.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:49.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:49.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:49.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:49.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:49.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:49.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:49.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:49.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:49.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:49.543 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:49.543 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.689517537, 2020-06-12T02:37:49.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:49.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:49.544 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:49.544 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:49.545 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:49.545 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:49.545 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:49.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.545 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:49.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:49.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:49.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:49.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:49.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:49.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:49.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:49.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:49.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:49.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:49.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:49.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:49.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:49.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:49.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:49.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:49.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:49.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:49.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:49.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:49.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:49.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:49.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:49.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:49.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:49.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:49.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:49.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:49.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:49.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:49.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:49.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:49.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:49.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:49.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:49.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:49.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:49.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:49.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:49.565 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:49.574 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:49.561+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:49.575 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:49.670 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:49.666+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:49.730 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:49.730 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:49.731 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:49.731 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:49.741 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:49.806 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:49.782+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:49.871 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:49.865+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:49.917 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:49.918 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:49.928 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:49.971 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:49.965+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:50.053 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:37:50.065 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:50.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.067 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 141.34389941800001, 2020-06-12T02:37:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.068 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:50.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:50.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:50.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:50.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:50.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:50.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:50.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:50.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:50.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.913920166, 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:50.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:50.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:50.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:50.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:50.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:50.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:50.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.79795700099999, 2020-06-12T02:37:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.105 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:50.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:50.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:50.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:50.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:50.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:50.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.124 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.79758000000001, 2020-06-12T02:37:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:50.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:50.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:50.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:50.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:50.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:50.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:50.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:50.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:50.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:50.140 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.79717046499999, 2020-06-12T02:37:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:50.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:50.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:50.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.79677813399999, 2020-06-12T02:37:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:50.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.157 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:50.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:50.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:50.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:50.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:50.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:50.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:50.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:50.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:50.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:50.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:50.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:50.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:50.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.175 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:50.177 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.77984370600001, 2020-06-12T02:37:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.178 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:50.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:50.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:50.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:50.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.77384910699999, 2020-06-12T02:37:50.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.203 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:50.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:50.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:50.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:50.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.772712533, 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:50.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.220 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:50.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:50.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:50.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:50.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:50.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:50.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:50.233 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.77253043600001, 2020-06-12T02:37:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.234 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:50.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:50.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:50.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:50.245 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:50.246 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.125345114, 2020-06-12T02:37:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.247 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.248 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:50.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:50.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.12503272500001, 2020-06-12T02:37:50.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:50.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:50.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:50.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:50.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:50.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:50.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:50.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:50.273 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 116.11346413299999, 2020-06-12T02:37:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.274 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.275 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:50.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:50.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:50.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:50.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:50.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:50.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:50.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.289 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 116.11312467499999, 2020-06-12T02:37:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.291 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:50.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:50.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.306 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 116.11282823000001, 2020-06-12T02:37:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:50.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:50.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:50.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:50.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:50.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:50.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:50.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:50.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:50.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:50.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:50.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:50.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:50.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:50.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:50.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.323 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:50.323 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:50.323 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.075794454000004, 2020-06-12T02:37:50.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:50.323 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.324 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:50.324 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.324 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.324 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.324 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:50.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:50.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:50.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:50.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:50.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:50.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:50.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:50.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:50.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:50.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.335 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:50.335 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:50.335 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.068188006, 2020-06-12T02:37:50.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:50.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:50.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:50.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:50.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:50.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:50.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:50.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:50.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:50.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:50.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:50.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:50.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:50.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:50.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:50.347 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.064809468000007, 2020-06-12T02:37:50.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:50.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:50.348 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.348 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:50.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:50.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:50.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:50.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:50.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:50.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:50.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:50.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:50.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:50.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:50.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:50.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:50.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:50.359 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:50.360 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.064539214000007, 2020-06-12T02:37:50.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:50.360 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.360 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:50.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:50.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:50.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:50.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:50.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:50.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:50.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:50.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:50.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:50.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:50.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:50.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:50.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:50.372 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:50.372 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.064358092000006, 2020-06-12T02:37:50.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:50.372 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:50.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.373 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:50.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:50.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:50.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:50.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:50.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:50.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:50.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:50.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:50.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:50.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:50.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:50.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.389 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.390 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.390 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:50.391 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:50.389+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:50.392 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:50.492 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:50.490+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:50.548 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:50.549 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:50.549 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:50.549 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:50.559 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:50.599 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:50.598+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:50.695 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:50.693+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:50.714 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:50.714 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:50.715 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:50.715 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:50.715 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:50.731 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:50.796 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:50.789+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:50.819 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:50.842 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:50.842 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:50.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:50.842 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.71603897599999, 2020-06-12T02:37:50.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.844 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:50.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.845 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:50.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:50.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:50.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:50.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:50.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:50.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:50.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:50.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:50.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:50.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:50.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:50.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:50.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:50.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:50.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.866 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:50.866 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:50.866 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.715815534, 2020-06-12T02:37:50.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:50.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.867 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.868 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.868 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.868 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:50.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:50.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:50.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:50.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:50.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:50.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:50.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:50.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:50.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:50.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:50.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:50.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:50.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:50.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:50.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:50.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:50.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:50.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:50.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:50.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.901 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:50.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:50.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 134.673336425, 2020-06-12T02:37:50.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:50.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.902 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.902 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:50.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:50.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:50.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:50.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:50.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:50.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:50.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:50.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:50.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:50.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:50.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:50.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:50.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:50.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:50.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:50.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:50.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:50.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:50.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:50.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:50.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:50.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:50.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:50.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:50.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:50.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.921 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:50.921 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:50.921 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 134.67300153100001, 2020-06-12T02:37:50.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:50.921 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.923 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:50.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:50.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:50.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:50.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:50.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:50.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:50.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:50.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:50.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:50.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:50.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:50.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:50.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:50.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:50.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:50.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:50.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:50.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:50.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:50.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.940 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:50.940 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:50.940 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.472125648000002, 2020-06-12T02:37:50.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:50.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.941 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.941 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.941 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:50.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:50.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:50.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:50.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:50.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:50.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:50.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:50.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:50.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:50.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:50.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:50.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:50.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:50.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:50.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:50.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:50.955 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.471965835000006, 2020-06-12T02:37:50.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:50.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:50.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.956 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:50.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.957 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:50.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:50.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:50.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:50.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:50.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:50.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:50.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:50.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:50.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:50.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:50.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:50.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:50.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:50.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:50.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.471885122000003, 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.971 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:50.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.971 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:50.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:50.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:50.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:50.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:50.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:50.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:50.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:50.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:50.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:50.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:50.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:50.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:50.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:50.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:50.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:50.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.982 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:50.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:50.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.983 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:50.983 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:50.983 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.471638569000007, 2020-06-12T02:37:50.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:50.984 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:50.984 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:50.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:50.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:50.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:50.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:50.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:50.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:50.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:50.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:50.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:50.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:50.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:50.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:50.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:50.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:50.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:50.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:50.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:50.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:50.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:50.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:50.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:50.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:50.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:50.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:50.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:51.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.003 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:51.004 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:51.005 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.458288245999995, 2020-06-12T02:37:51.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:51.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:51.006 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.006 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:51.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.008 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:51.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:51.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:51.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:51.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:51.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:51.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:51.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:51.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:51.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:51.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:51.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:51.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:51.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:51.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:51.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:51.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:51.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:51.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:51.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:51.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:51.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.026 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.028 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:51.028 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:51.028 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.458101991999996, 2020-06-12T02:37:51.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:51.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:51.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.030 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.031 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:51.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.031 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:51.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.457901281000005, 2020-06-12T02:37:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.865413320000002, 2020-06-12T02:37:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.864989573000003, 2020-06-12T02:37:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.864835714999998, 2020-06-12T02:37:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.862104927000004, 2020-06-12T02:37:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.139 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:51.139 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:51.139 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.861684600000004, 2020-06-12T02:37:51.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:51.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.140 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:51.140 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.140 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.140 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.141 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:51.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.141 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:51.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:51.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:51.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:51.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:51.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:51.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:51.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:51.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:51.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:51.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:51.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:51.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:51.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:51.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:51.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.151 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:51.151 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:51.151 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.861589766999998, 2020-06-12T02:37:51.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:51.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:51.152 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.152 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.152 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:51.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:51.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:51.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:51.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:51.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:51.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:51.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.831810412999999, 2020-06-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.167 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:51.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:51.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:51.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:51.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:51.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:51.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:51.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:51.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:51.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:51.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:51.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:51.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:51.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:51.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:51.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:51.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:51.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:51.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:51.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:51.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:51.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:51.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:51.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:51.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.831344799999997, 2020-06-12T02:37:51.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:51.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.183 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:51.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.184 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:51.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:51.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:51.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:51.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:51.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:51.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:51.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:51.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:51.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:51.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:51.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:51.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:51.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:51.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:51.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:51.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:51.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:51.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:51.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:51.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.198 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.198 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.205 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:51.205 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:51.205 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.831170865000004, 2020-06-12T02:37:51.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:51.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:51.206 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:51.206 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:51.206 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:51.206 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:51.207 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:51.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.207 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:51.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:51.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:51.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:51.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:51.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:51.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:51.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:51.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:51.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:51.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:51.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:51.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:51.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:51.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:51.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:51.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:51.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:51.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:51.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:51.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:51.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:51.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:51.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:51.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:51.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:51.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:51.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:51.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:51.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:51.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:51.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:51.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.221 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:51.222 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:51.222 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:51.224 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:50.918+0000 7fd3f3818700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:50.926+0000 7fd3f3818700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.227 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.227 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.227 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:51.227 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:51.227 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:51.228 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:51.228 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:51.228 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:51.228 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:51.228 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:51.229 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:51.229 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:51.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:51.221+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:51.230 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:51.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:51.317+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:51.348 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:51.349 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:51.358 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:51.434 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:51.426+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:51.523 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:51.524 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:51.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:51.525+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:51.533 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:51.635 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:51.630+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:51.691 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:51.691 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:51.700 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:51.745 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:51.741+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:51.811 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:51.812 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:51.823 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:51.836 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:51.834+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:51.937 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:51.934+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:51.979 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:51.979 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.000 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:52.053 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:52.049+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:52.065 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:37:52.114 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.114 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.123 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:52.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:52.161+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:52.186 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:52.170+0000 7f874a024700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:52.187 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:52.182+0000 7f874a024700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:52.245 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:52.237+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:52.277 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.277 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.287 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:52.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:52.373+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:52.442 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.442 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.446 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:52.442+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:52.452 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:52.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:52.541+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:52.616 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.616 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.625 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:52.649 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:52.646+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:52.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:52.745+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:52.774 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.774 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.794 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:52.865 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:52.862+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:52.946 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:52.947 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:52.956 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:53.001 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:52.997+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:53.064 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:53.064 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:53.065 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:53.062+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:53.070 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:37:53.076 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:53.165 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:53.165+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:53.178 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:53.178 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:53.195 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:53.230 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:53.295 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:53.294+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:53.315 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:53.316 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:53.325 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:53.351 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:53.342+0000 7fde198d7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:53.350+0000 7fde13fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:53.368 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:53.361+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:53.383 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:53.401 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:53.430 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:53.447 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:53.465 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:53.466 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:53.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:53.466 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:53.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.467 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:53.467 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:53.467 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.35552232699999, 2020-06-12T02:37:53.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:37:53.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.468 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.469 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.469 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.469 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:37:53.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.470 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:53.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:37:53.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:37:53.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:37:53.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:37:53.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:37:53.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:37:53.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:37:53.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:37:53.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:37:53.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:37:53.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:37:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:37:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:37:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:37:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:37:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:37:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:37:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:37:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:37:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:37:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:37:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:37:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.35535196000001, 2020-06-12T02:37:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:37:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:37:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:37:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:37:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:37:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:37:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:37:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:37:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:37:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:37:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:37:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:37:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:37:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:37:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:37:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:37:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:37:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:37:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:37:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:37:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:37:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:37:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:37:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:37:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:37:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:37:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.33721393299999, 2020-06-12T02:37:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:37:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:37:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:37:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:37:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:37:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:37:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:37:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:37:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:37:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:37:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:37:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:37:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:37:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:37:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:37:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:37:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:37:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:37:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:37:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:37:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:37:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:37:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.33127705000001, 2020-06-12T02:37:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:37:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:37:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:37:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:37:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:37:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:37:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:37:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:37:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:37:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:37:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:37:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:37:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:37:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:37:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:37:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:37:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:37:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:37:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:37:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:37:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:37:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:37:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:37:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:37:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:37:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.330767979, 2020-06-12T02:37:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:37:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:37:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:37:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:37:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:37:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:37:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:37:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:37:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:37:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:37:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:37:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.330609713, 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:37:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:37:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:37:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:37:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:37:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:37:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:37:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:37:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:37:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:37:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:37:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:37:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:37:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:37:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:37:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 128.25621291100001, 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:37:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:37:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:37:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:37:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:37:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 128.24920208899999, 2020-06-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:37:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:37:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:37:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:37:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:37:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:37:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:37:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:37:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:37:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:37:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:37:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:37:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:37:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:37:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:37:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.489415546, 2020-06-12T02:37:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:37:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:37:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:37:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:37:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:37:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:37:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:37:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:37:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:37:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:37:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:37:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:37:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:37:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:37:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:37:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:37:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:37:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:37:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:37:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:37:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:37:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:37:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:37:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:37:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:37:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.48928795, 2020-06-12T02:37:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:37:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:37:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:37:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:37:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:37:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:37:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:37:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:37:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:37:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:37:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:37:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:37:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:37:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:37:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:37:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:37:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:37:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:37:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:37:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:37:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:37:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:37:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:37:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.074307309000005, 2020-06-12T02:37:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:37:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:37:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:37:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:37:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:37:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:37:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:37:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:37:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:37:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:37:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:37:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.074162552000004, 2020-06-12T02:37:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:37:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:37:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:37:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:37:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:37:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:37:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:37:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:37:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:37:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:37:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:37:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:37:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:37:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.074031701999999, 2020-06-12T02:37:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:37:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:37:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:37:53.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:37:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:37:53.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:37:53.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:37:53.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:37:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:37:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:37:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:37:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:37:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:37:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:37:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:37:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.073887380000002, 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:37:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:37:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:37:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:37:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:37:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:37:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:37:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:37:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:37:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:37:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:37:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:37:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:37:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.073775398999999, 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:37:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:37:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:37:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:37:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:37:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:37:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:37:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:37:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:37:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:37:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:37:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:37:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:37:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:37:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.073622913999998, 2020-06-12T02:37:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:37:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:37:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:37:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:37:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:37:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:37:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:37:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:37:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:37:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:37:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:37:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:37:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:37:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:37:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.052877776000003, 2020-06-12T02:37:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:37:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:37:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:37:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:37:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:37:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:37:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:37:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:37:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:37:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:37:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:37:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:37:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:37:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.052552681999998, 2020-06-12T02:37:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:37:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:37:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:37:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:37:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:37:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:37:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:37:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:37:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:37:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:37:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:37:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:37:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:37:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:37:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:37:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:37:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.936906199000006, 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:37:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:37:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:37:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:37:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:37:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:37:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:37:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:37:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:37:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:37:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:37:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:37:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.936565940999998, 2020-06-12T02:37:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:37:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:37:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:37:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:37:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:37:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:37:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:37:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:37:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:37:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:37:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:37:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:53.813 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:53.813 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:53.813 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:53.816 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:53.816 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:53.816 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:53.816 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:53.818 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:53.819 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:53.819 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:53.814+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:53.917 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:53.913+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:53.978 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:53.979 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:53.985 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:54.017 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:54.013+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:54.095 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:54.096 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:54.096 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:54.096 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:54.096 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:54.105 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:54.118 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:54.113+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:54.211 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:54.211 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:54.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:54.212 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:54.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.212 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:37:54.212 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:54.212 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 145.48782354599999, 2020-06-12T02:37:54.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:37:54.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.216 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.217 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.217 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.217 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:37:54.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.217 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:54.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:37:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:37:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:37:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:37:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:37:54.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:37:54.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:37:54.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:37:54.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:37:54.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:37:54.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:37:54.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:37:54.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:37:54.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:37:54.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:37:54.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:37:54.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:37:54.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.234 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 140.05784429400001, 2020-06-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:37:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:54.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:37:54.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:37:54.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:54.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:37:54.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:37:54.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.251 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.252 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:54.252 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:54.252 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.941881129, 2020-06-12T02:37:54.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:37:54.253 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.253 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.254 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.254 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:37:54.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.254 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:54.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:37:54.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:37:54.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:37:54.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:37:54.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:37:54.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:37:54.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:37:54.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:37:54.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:37:54.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:37:54.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:37:54.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:37:54.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:37:54.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:37:54.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:37:54.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:37:54.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:37:54.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:37:54.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.270 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:54.270 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:54.270 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.94150412799999, 2020-06-12T02:37:54.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:37:54.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.271 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:37:54.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.272 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:37:54.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:37:54.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:37:54.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:37:54.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:37:54.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:37:54.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:37:54.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:37:54.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:37:54.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:37:54.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:54.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:37:54.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:37:54.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:37:54.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:37:54.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:37:54.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:37:54.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:37:54.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:37:54.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:37:54.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:37:54.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:37:54.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:37:54.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.296 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.297 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:54.297 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:54.298 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.941094593, 2020-06-12T02:37:54.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:37:54.298 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.299 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.299 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.300 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:37:54.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.300 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:54.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:37:54.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:37:54.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:37:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:37:54.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:37:54.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:37:54.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:37:54.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:37:54.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:37:54.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:37:54.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:37:54.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:37:54.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:37:54.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:37:54.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:37:54.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:37:54.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:37:54.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.314 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.940702262, 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.316 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:54.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:37:54.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:54.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:37:54.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:37:54.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:37:54.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:37:54.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:37:54.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:37:54.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:37:54.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:37:54.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.330 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:54.332 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.92376783399999, 2020-06-12T02:37:54.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:37:54.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.334 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.335 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:37:54.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.335 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:54.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:37:54.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:37:54.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:37:54.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:37:54.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:37:54.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:37:54.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:37:54.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:37:54.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:37:54.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:37:54.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:37:54.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:37:54.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:37:54.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:37:54.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:37:54.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:37:54.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:37:54.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:37:54.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:37:54.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:37:54.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:37:54.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:37:54.355 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.356 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:54.357 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:54.357 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.917773235, 2020-06-12T02:37:54.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:37:54.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.358 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.359 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.359 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:37:54.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.359 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:54.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:37:54.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:37:54.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:37:54.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:37:54.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:37:54.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:37:54.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:37:54.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:37:54.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:37:54.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:37:54.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:37:54.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:37:54.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:37:54.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:37:54.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:37:54.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:37:54.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:37:54.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:37:54.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:37:54.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:37:54.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.373 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.374 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:54.375 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:54.375 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.91663666100001, 2020-06-12T02:37:54.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:37:54.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.376 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:37:54.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.377 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:54.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:37:54.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:37:54.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:37:54.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:54.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:37:54.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:37:54.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:37:54.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:37:54.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:37:54.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:37:54.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:37:54.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:37:54.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:37:54.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:37:54.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:37:54.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:37:54.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:37:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:37:54.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:37:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:37:54.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:54.396 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 137.91645456399999, 2020-06-12T02:37:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:37:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:37:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.398 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:37:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:37:54.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:37:54.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:37:54.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:37:54.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:37:54.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:37:54.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:37:54.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:37:54.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:37:54.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:37:54.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:37:54.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:37:54.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:37:54.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:37:54.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:37:54.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.412 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:54.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:54.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.26926924200001, 2020-06-12T02:37:54.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:37:54.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.413 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.414 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:37:54.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.414 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:54.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:37:54.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:37:54.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:37:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:37:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:37:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:37:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:37:54.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:37:54.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:37:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:37:54.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:37:54.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:37:54.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:37:54.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:37:54.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:37:54.426 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:54.426 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.26895685299999, 2020-06-12T02:37:54.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:37:54.426 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.427 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:37:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:37:54.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:37:54.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:37:54.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:37:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:37:54.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:37:54.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:37:54.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:37:54.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:37:54.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:37:54.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:37:54.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:37:54.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:54.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:37:54.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:37:54.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:37:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:37:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:37:54.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:37:54.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.439 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 120.257388261, 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:37:54.440 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.441 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.441 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.441 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.441 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.441 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:37:54.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.442 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:54.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:37:54.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:37:54.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:37:54.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:37:54.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:37:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:37:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:37:54.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:37:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:37:54.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:37:54.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:37:54.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:37:54.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:37:54.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:37:54.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:37:54.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:37:54.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:37:54.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:37:54.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:37:54.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:37:54.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.456 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.456 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 120.257048803, 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.458 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.458 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.458 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.458 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:37:54.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:37:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:37:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:37:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:37:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:37:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:37:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:37:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:37:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:37:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:37:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:37:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:37:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:37:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:37:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:37:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:37:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:37:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:37:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:37:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.473 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:37:54.473 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:54.473 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 120.256752358, 2020-06-12T02:37:54.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:37:54.474 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.474 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.474 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:37:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:37:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:37:54.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:37:54.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:37:54.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:37:54.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:37:54.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:37:54.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:37:54.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:37:54.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:54.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:37:54.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:37:54.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:37:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:37:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:37:54.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:37:54.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:37:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:37:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:37:54.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:37:54.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:37:54.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:37:54.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.499 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.219718581999999, 2020-06-12T02:37:54.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:37:54.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.501 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:54.501 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.501 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.501 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.502 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:37:54.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.502 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:54.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:37:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:37:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:37:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:37:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:37:54.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:37:54.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:37:54.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:37:54.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:54.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:37:54.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:37:54.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:37:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:37:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.513 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:54.513 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:54.513 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.212112133999995, 2020-06-12T02:37:54.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:37:54.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.514 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:54.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.514 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.514 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:37:54.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:37:54.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:37:54.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:37:54.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:37:54.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:37:54.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:37:54.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:37:54.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:37:54.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:37:54.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:54.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:37:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:37:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:37:54.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:37:54.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.208733596000002, 2020-06-12T02:37:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:37:54.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.527 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:54.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.527 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.527 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:37:54.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.528 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:54.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:37:54.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:37:54.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:37:54.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:37:54.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:37:54.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:37:54.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:37:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:37:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.540 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:37:54.540 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:54.540 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.208463342000002, 2020-06-12T02:37:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:37:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.541 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.542 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.542 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:37:54.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.542 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:54.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:37:54.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:37:54.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:37:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:37:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:37:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:37:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:37:54.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:37:54.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:37:54.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:37:54.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:37:54.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:37:54.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:37:54.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:37:54.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:54.555 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.208282220000001, 2020-06-12T02:37:54.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:37:54.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:54.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.556 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:54.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:37:54.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:37:54.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:37:54.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:37:54.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:37:54.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:37:54.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:37:54.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:37:54.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:37:54.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:37:54.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:37:54.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:37:54.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:37:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.568 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:54.569 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:54.565+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:54.570 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:54.677 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:54.669+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:54.693 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:54.694 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:54.694 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:37:54.694 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:54.699 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:54.776 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:54.774+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:54.816 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:54.817 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:37:54.817 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:37:54.817 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:37:54.817 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:54.826 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:54.914 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:54.910+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:54.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:37:54.973+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:37:54.981 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:37:54.981 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:37:54.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:37:54.981 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.85761003499999, 2020-06-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:37:54.983 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.983 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:54.983 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:54.983 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:54.983 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:54.984 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:37:54.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.984 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:54.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:54.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:54.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:37:54.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:37:54.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:54.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:37:54.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:37:54.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:54.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:54.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:37:54.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:37:54.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:54.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:37:54.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:37:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:37:54.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:54.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:37:54.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:37:54.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:54.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:37:54.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:37:54.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:54.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:54.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:54.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:54.998 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:54.998 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:54.999 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.857386593, 2020-06-12T02:37:54.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:37:54.999 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:54.999 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:54.999 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:55.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:37:55.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:37:55.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:37:55.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:37:55.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:37:55.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:37:55.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:37:55.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:37:55.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:55.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:37:55.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:37:55.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:37:55.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:37:55.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:37:55.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:37:55.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:37:55.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:37:55.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.013 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.014 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:37:55.014 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:55.014 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.814907484, 2020-06-12T02:37:55.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:37:55.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:37:55.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:55.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:37:55.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:37:55.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:37:55.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:37:55.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:37:55.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:37:55.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:37:55.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:37:55.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:37:55.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:37:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:37:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:37:55.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:37:55.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:37:55.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:37:55.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:37:55.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:37:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.81457259000001, 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.031 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.031 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.031 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.031 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:37:55.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.032 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:55.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:37:55.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:37:55.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:37:55.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:37:55.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:37:55.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:37:55.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:37:55.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:37:55.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:37:55.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:37:55.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:55.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:37:55.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:37:55.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:37:55.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:37:55.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:37:55.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:37:55.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:37:55.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:37:55.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:37:55.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:37:55.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:55.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:55.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.613696707000003, 2020-06-12T02:37:55.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:37:55.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:37:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:55.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:37:55.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:37:55.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:37:55.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:37:55.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:37:55.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:37:55.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:37:55.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:37:55.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:37:55.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:37:55.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:37:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:37:55.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:37:55.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:37:55.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:37:55.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:37:55.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:37:55.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:37:55.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.064 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.064 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.065 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:55.065 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:55.065 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.613536894000006, 2020-06-12T02:37:55.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:37:55.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.066 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.066 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.066 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:55.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:37:55.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:37:55.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:37:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:37:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:37:55.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:37:55.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:37:55.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:37:55.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:37:55.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:37:55.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:37:55.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:37:55.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:37:55.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:37:55.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:37:55.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:37:55.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:37:55.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:37:55.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:37:55.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:37:55.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:37:55.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:37:55.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:55.086 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:55.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.613456181000004, 2020-06-12T02:37:55.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:37:55.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.087 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.088 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.089 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:37:55.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:55.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:37:55.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:37:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:37:55.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:37:55.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:37:55.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:37:55.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:37:55.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:37:55.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:37:55.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:37:55.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:37:55.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:37:55.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.104 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.105 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:37:55.105 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:55.105 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.613209628000007, 2020-06-12T02:37:55.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:37:55.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:37:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:55.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:37:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:37:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:37:55.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:37:55.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:37:55.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:37:55.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:37:55.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:37:55.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:37:55.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:37:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.599859304999995, 2020-06-12T02:37:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:37:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:37:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:37:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:37:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:37:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:37:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:37:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:37:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:37:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:37:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:37:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:37:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:37:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:37:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.599673050999996, 2020-06-12T02:37:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:37:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:37:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:37:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:37:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:37:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:37:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:37:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:37:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:37:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:37:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:37:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:37:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:37:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.599472340000005, 2020-06-12T02:37:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:37:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:37:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:37:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:37:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:37:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:37:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:37:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:37:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:37:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:37:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:37:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:37:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:37:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:37:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:37:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:37:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:37:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:37:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.006984379000002, 2020-06-12T02:37:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:37:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:37:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:37:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:37:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:37:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:37:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:37:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:37:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:37:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:37:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:37:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:37:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:37:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:37:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:37:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.006560632000003, 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:37:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:37:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:37:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:37:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:37:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:37:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:37:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:37:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:37:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:37:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:37:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:37:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:37:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:37:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.006406773999998, 2020-06-12T02:37:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:37:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:37:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:37:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:37:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:37:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:37:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:37:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:37:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:37:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:37:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:37:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:37:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.003675986000005, 2020-06-12T02:37:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:37:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:37:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:37:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:37:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:37:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:37:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:37:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:37:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:37:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:37:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:37:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:37:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.003255659000004, 2020-06-12T02:37:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:37:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:37:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:37:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:37:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:37:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:37:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:37:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:37:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:37:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:37:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:37:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:37:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:37:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:37:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.003160825999998, 2020-06-12T02:37:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:37:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:37:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:37:55.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:37:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:37:55.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:37:55.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:37:55.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:37:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:37:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:37:55.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:37:55.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:37:55.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:37:55.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.973381472, 2020-06-12T02:37:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:37:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.239 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:37:55.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.239 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:55.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:37:55.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:37:55.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:37:55.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:37:55.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:37:55.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:37:55.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:37:55.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:37:55.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:37:55.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:37:55.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:37:55.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:37:55.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:37:55.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:37:55.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:37:55.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:37:55.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:37:55.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:37:55.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.253 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.972915858999997, 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:37:55.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.255 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.255 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:55.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:37:55.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:37:55.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:37:55.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:37:55.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:37:55.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:37:55.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:37:55.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:37:55.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:37:55.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:37:55.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:37:55.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:37:55.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:37:55.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:37:55.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:37:55.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:37:55.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:37:55.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:37:55.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:37:55.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:37:55.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:37:55.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:37:55.270 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.972741924000005, 2020-06-12T02:37:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:37:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:37:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:37:55.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:37:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:37:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:37:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.272 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:37:55.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:37:55.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:55.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:37:55.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:37:55.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:37:55.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:37:55.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:37:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:37:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:37:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:37:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:37:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:37:55.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:37:55.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:37:55.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:37:55.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:37:55.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:37:55.288 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:55.281+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:55.288 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:55.388 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:55.381+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:55.405 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:55.405 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:55.405 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:55.405 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:55.414 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:55.449 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:55.438+0000 7f78ad08d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:55.453 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:55.450+0000 7f78ac88c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:55.505 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:55.501+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:55.577 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:55.577 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:55.578 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:55.578 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:55.591 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:55.592 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:55.590+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:55.691 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:55.685+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:55.749 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:55.749 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:55.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:55.750 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.61042123799999, 2020-06-12T02:37:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.751 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.765 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:55.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:55.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:55.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:55.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:55.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:55.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:55.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.784 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.785 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.59952985699999, 2020-06-12T02:37:55.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.787 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:55.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:55.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:55.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:55.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:55.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:55.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:55.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.59839781299999, 2020-06-12T02:37:55.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:55.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:55.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:55.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:55.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:55.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:55.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:55.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.59814262800001, 2020-06-12T02:37:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:55.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:55.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:55.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:55.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:55.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:55.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:55.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:55.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:55.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:55.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.841 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:55.842 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.597983441, 2020-06-12T02:37:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:55.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:55.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:55.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:55.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:55.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:55.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:55.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:55.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 139.45366086300001, 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.859 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:55.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:55.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:55.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:55.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:55.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:55.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:55.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:55.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:55.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.870 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.871 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:55.872 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.712591366, 2020-06-12T02:37:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.873 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.874 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:55.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:55.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:55.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:55.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.888 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 111.774888965, 2020-06-12T02:37:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:55.890 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.891 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:55.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:55.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:55.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:55.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:55.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:55.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:55.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:55.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:55.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:55.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:55.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:55.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:55.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.908 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.908 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.909 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:55.911 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:55.911 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.793012885, 2020-06-12T02:37:55.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:55.913 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.914 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:55.914 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.915 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.915 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.916 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:55.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.916 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:55.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:55.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:55.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:55.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:55.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:55.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:55.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:55.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:55.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:55.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:55.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:55.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:55.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:55.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:55.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:55.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:55.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:55.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:55.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:55.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:55.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:55.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.935 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.935 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.936 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:55.936 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:55.936 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.792819569, 2020-06-12T02:37:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:55.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:55.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:55.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:55.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:55.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:55.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:55.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:55.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:55.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:55.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:55.951 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.951 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.952 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.952 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:55.953 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:55.953 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.792671114, 2020-06-12T02:37:55.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:55.953 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.954 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:55.954 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:55.954 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:55.954 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:55.954 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:55.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.955 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:55.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:55.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:55.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:55.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:55.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:55.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:55.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:55.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:55.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:55.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:55.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:55.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:55.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:55.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:55.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:55.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:55.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:55.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:55.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:55.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:55.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:55.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:55.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.968 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.968 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.969 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.78523816400001, 2020-06-12T02:37:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:55.970 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:55.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:55.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:55.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:55.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:55.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:55.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:55.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:55.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:55.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:55.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:55.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:55.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:55.981 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.982 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.983 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:55.983 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:55.983 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.782829664, 2020-06-12T02:37:55.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:55.984 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.984 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:55.984 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:55.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:55.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:55.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:55.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:55.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:55.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:55.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:55.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:55.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:55.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:55.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:55.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:55.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.994 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:55.995 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.78080251900001, 2020-06-12T02:37:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:55.996 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:55.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:55.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:56.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.006 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:56.007 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.769752686, 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.018 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.76553966900001, 2020-06-12T02:37:56.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:56.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:56.021 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:56.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.021 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:56.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:56.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:56.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:56.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:56.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:56.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:56.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:56.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:56.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:56.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:56.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:56.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:56.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:56.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:56.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:56.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:56.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.034 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:56.034 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:56.034 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.76535647, 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:56.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:56.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:56.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:56.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:56.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:56.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:56.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:56.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:56.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:56.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:56.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:56.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:56.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:56.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:56.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:56.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:56.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:56.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:56.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:56.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.308438426, 2020-06-12T02:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:56.050 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:56.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:56.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:56.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:56.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:56.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:56.060 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:56.061 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.777976828999996, 2020-06-12T02:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:56.062 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.063 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:56.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:56.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:56.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:56.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:56.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:56.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:56.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:56.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:56.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:56.078 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.079 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.079 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.079 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 85.777717710000005, 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:56.080 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:56.081 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:56.081 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:56.081 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:56.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.081 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:56.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:56.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:56.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:56.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:56.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:56.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:56.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:56.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:56.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:56.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:56.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:56.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:56.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:56.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:56.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:56.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:56.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:56.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:56.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:56.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:56.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:56.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:56.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:56.094 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.094 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.094 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.094 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:56.094 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:56.095 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:56.095 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:37:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:37:56.097 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:56.094+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:56.098 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:56.197 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:56.194+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:56.202 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:56.198+0000 7fa6eaffa700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:56.208 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:56.206+0000 7fa6e9d98700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:56.238 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:56.259 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:56.267 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:56.267 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:56.268 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:56.268 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:56.277 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:56.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:56.308 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:56.324 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:56.324 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:56.321+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:56.347 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:56.373 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:56.373 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.374 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.374 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:56.374 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:56.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.376 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:37:56.377 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:56.377 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:56.387 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:56.387 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:56.399 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:56.443 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:56.437+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:56.503 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:56.502+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:56.554 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:56.555 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:56.564 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:37:56.609 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:56.605+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:56.674 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:56.674 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:56.683 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:37:56.706 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:56.702+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:56.807 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:56.802+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:56.838 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:56.838 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:56.846 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:37:56.918 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:56.901+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:56.956 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:56.957 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:56.967 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:37:57.009 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:57.005+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:57.109 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:57.106+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:57.117 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.117 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.127 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:37:57.211 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:57.206+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:57.234 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.234 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.243 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:37:57.316 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:57.309+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:57.351 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.351 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.357 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:37:57.419 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:37:57.414+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:37:57.481 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.482 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.492 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:37:57.517 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:57.513+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:57.618 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:57.614+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:57.647 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.647 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.656 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:37:57.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:37:57.717+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:37:57.809 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.809 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.818 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:37:57.820 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:57.818+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:57.928 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:57.929 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:57.929 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:57.925+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:57.938 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:37:58.030 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:58.029+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:58.047 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:58.048 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:58.058 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:37:58.106 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:37:58.151 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:58.150+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:58.162 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:58.163 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:58.172 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:37:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:58.206+0000 7feeec5a1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:58.218 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:58.214+0000 7feeeb33f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:58.241 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:58.237+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:58.320 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:58.320 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:58.329 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:37:58.341 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:58.337+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:58.379 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:37:58.435 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:58.436 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:58.442 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:58.441+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:58.445 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:37:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:58.482+0000 7f682825b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:58.495 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:37:58.490+0000 7f6826ff9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:37:58.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:37:58.543 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:58.538+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:58.555 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:37:58.556 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:37:58.556 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:37:58.569 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:37:58.572 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:37:58.593 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:37:58.621 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:37:58.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:37:58.637+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:37:58.644 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:37:58.675 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:37:58.675 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.676 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.677 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:37:58.677 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:37:58.677 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.678 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.678 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.678 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.678 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:37:58.679 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:37:58.679 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:37:58.691 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:58.691 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:58.692 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:58.692 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:58.702 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:37:58.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:58.741+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:58.851 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:58.845+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:58.857 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:58.858 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:58.858 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:58.867 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:37:58.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:37:58.949+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:37:59.023 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:59.024 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.025 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:59.033 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.885560244, 2020-06-12T02:37:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:37:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:37:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.035 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:37:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:37:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:37:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:37:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:37:59.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:37:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:37:59.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:37:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:37:59.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:37:59.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:37:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:37:59.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:37:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:37:59.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:37:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:37:59.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:37:59.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:37:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:37:59.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:37:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:37:59.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:37:59.050 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.051 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.052 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:37:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.87466886300001, 2020-06-12T02:37:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:37:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.053 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:37:59.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:59.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:37:59.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:37:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:37:59.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:37:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:37:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:37:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:37:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:37:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:37:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:37:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:37:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:37:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:37:59.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:37:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:37:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:37:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:37:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:37:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:37:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:37:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.069 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.87353681900001, 2020-06-12T02:37:59.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.071 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:37:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:37:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:37:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:37:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:37:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:37:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:37:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:37:59.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:37:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:37:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:37:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:37:59.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:37:59.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:37:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:37:59.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:37:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:37:59.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:37:59.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:37:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:37:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.87328163399999, 2020-06-12T02:37:59.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:37:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.086 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.087 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:37:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:37:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:37:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:37:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:37:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:37:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:37:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:37:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:37:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:37:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:37:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:37:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:37:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:37:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:37:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:37:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:37:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:37:59.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:37:59.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:37:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.87312244699999, 2020-06-12T02:37:59.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:37:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.104 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.105 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:37:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:37:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:37:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:37:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:37:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:37:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:37:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:37:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:37:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:37:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:37:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:37:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:37:59.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:37:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:37:59.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:37:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:37:59.118 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:37:59.119 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 142.728799869, 2020-06-12T02:37:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:37:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.120 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.121 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:37:59.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.121 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:37:59.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:37:59.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:37:59.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:37:59.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:37:59.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:37:59.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:37:59.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:37:59.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:37:59.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:37:59.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:37:59.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:37:59.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:37:59.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:37:59.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:37:59.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:37:59.133 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.133 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.134 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.134 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:37:59.134 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:59.135 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.987730372, 2020-06-12T02:37:59.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:37:59.135 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.135 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.135 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.136 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.136 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.136 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:37:59.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.136 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:59.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:37:59.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:37:59.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:37:59.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:37:59.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:37:59.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:37:59.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:37:59.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:37:59.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:37:59.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:37:59.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:37:59.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:37:59.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:37:59.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:37:59.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:37:59.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:37:59.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:37:59.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:37:59.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:37:59.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:37:59.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:37:59.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:37:59.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:37:59.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:37:59.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:59.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:59.152 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.05002797100001, 2020-06-12T02:37:59.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:37:59.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.153 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.153 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.154 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:37:59.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.154 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:37:59.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:37:59.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:37:59.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:37:59.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:37:59.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:37:59.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:37:59.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:37:59.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:37:59.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:37:59.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:59.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:37:59.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:37:59.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:37:59.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:37:59.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:37:59.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:37:59.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:37:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:37:59.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:37:59.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:37:59.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:37:59.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.169 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.068151891, 2020-06-12T02:37:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:37:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.170 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.171 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.171 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:37:59.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.172 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:59.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:37:59.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:37:59.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:37:59.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:37:59.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:37:59.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:37:59.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:37:59.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:37:59.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:37:59.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:59.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:37:59.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:37:59.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:37:59.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:37:59.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:37:59.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:37:59.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.183 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.184 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:59.184 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:59.184 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.06795857500001, 2020-06-12T02:37:59.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:37:59.185 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.185 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.185 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:59.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:37:59.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:37:59.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:37:59.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:37:59.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:37:59.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:37:59.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:37:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:37:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:37:59.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:37:59.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:59.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:37:59.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:37:59.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:37:59.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:37:59.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:37:59.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:37:59.198 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.199 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.199 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:37:59.200 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:59.200 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.06781012, 2020-06-12T02:37:59.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:37:59.200 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.200 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.201 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.201 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:37:59.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.202 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:59.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:37:59.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:37:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:37:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:37:59.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:37:59.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:37:59.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:37:59.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:37:59.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:37:59.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:59.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:37:59.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:37:59.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:37:59.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:37:59.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:37:59.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:37:59.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.213 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.213 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.214 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:37:59.214 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:59.214 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.06037717, 2020-06-12T02:37:59.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:37:59.215 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.215 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.215 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:59.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:59.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:37:59.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:37:59.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:37:59.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:37:59.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:37:59.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:37:59.222 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.223 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.223 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.223 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:59.224 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:59.224 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.05796866999999, 2020-06-12T02:37:59.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:59.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:37:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:37:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:37:59.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:37:59.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:37:59.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:37:59.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:37:59.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:37:59.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:37:59.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:37:59.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:37:59.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:37:59.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:37:59.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:37:59.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.235 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.235 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.05594152499999, 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.236 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.237 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:59.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:37:59.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:37:59.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:37:59.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:37:59.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:37:59.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:37:59.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:37:59.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:37:59.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:37:59.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:37:59.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:37:59.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:37:59.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:37:59.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:37:59.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.247 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.247 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.248 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:37:59.248 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:59.248 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 113.04489169199999, 2020-06-12T02:37:59.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:37:59.249 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.249 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.250 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:59.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:37:59.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:37:59.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:37:59.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:37:59.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:37:59.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:37:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:37:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:37:59.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:37:59.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:37:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:37:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:37:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:37:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:37:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:37:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.259 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:59.260 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.040678675, 2020-06-12T02:37:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:37:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:37:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:37:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:37:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:37:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:37:59.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:37:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:37:59.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:37:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:37:59.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:37:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:37:59.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:37:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:37:59.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.274 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.040495476, 2020-06-12T02:37:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:37:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.275 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.276 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:37:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:37:59.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:37:59.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:37:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:37:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:37:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:37:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:37:59.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:37:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:37:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:37:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:37:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:37:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:37:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:37:59.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:37:59.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:37:59.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:37:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:37:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:37:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:37:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:37:59.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:37:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.293 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:37:59.293 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:59.293 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.583577432, 2020-06-12T02:37:59.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:37:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:37:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:37:59.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:37:59.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:37:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:37:59.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:37:59.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:37:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:37:59.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:37:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:37:59.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:37:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:37:59.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:37:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:37:59.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:37:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:37:59.306 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.307 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:37:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.053115835, 2020-06-12T02:37:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:37:59.308 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:59.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:37:59.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:37:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:37:59.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:37:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:37:59.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:37:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:37:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:37:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:37:59.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:37:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:37:59.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:37:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:37:59.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:37:59.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:37:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:37:59.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:37:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:37:59.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.323 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:37:59.323 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:59.323 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.052856715999994, 2020-06-12T02:37:59.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:37:59.323 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.324 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.324 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:59.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:37:59.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:37:59.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:37:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:37:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:37:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:37:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:37:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:37:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:37:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:37:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:37:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:37:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:37:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:37:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:37:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:37:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:37:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:37:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:37:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:37:59.338 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.339 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.339 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:37:59.342 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:37:59.343 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:59.338+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:59.442 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:37:59.438+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:37:59.503 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:59.503 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:37:59.503 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:59.510 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:37:59.543 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:59.542+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:59.622 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:37:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:37:59.623 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:37:59.623 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:37:59.624 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:37:59.644 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:37:59.642+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:37:59.735 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:37:59.735 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:37:59.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:37:59.735 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:37:59.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.736 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:37:59.736 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:59.736 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.584896966, 2020-06-12T02:37:59.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:37:59.737 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.737 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.737 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:37:59.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:37:59.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:37:59.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:37:59.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:37:59.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:37:59.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:37:59.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:37:59.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:37:59.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:37:59.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:37:59.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:37:59.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:37:59.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:37:59.747 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.747 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.747 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.748 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:37:59.748 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:59.748 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.43838345500001, 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:59.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:37:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:37:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:37:59.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:37:59.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:37:59.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:37:59.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:37:59.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:37:59.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:37:59.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:37:59.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:37:59.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:37:59.760 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.760 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.760 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.761 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:59.761 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:59.761 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.760834781, 2020-06-12T02:37:59.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:37:59.762 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.763 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.763 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:37:59.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.764 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:59.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:37:59.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:37:59.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:37:59.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:37:59.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:37:59.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:37:59.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:37:59.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:37:59.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:37:59.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:37:59.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:37:59.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:37:59.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:37:59.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:37:59.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:37:59.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:37:59.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:37:59.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:37:59.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:37:59.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:37:59.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.779 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.780 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:59.780 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:59.780 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.760070853, 2020-06-12T02:37:59.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:37:59.781 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.781 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.782 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.782 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:37:59.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:59.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:37:59.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:37:59.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:37:59.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:37:59.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:37:59.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:37:59.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:37:59.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:37:59.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:37:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:37:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:37:59.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:37:59.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:37:59.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:37:59.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:37:59.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:37:59.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:37:59.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:37:59.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:37:59.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:37:59.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:37:59.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:37:59.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:37:59.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:37:59.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:37:59.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:37:59.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:37:59.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.809 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:59.810 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.53726579800001, 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.812 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:37:59.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.812 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:59.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:37:59.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:37:59.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:37:59.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:37:59.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:37:59.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:37:59.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:37:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:37:59.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:37:59.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:37:59.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:37:59.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:37:59.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:37:59.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:37:59.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:37:59.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:37:59.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:37:59.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:37:59.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:37:59.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:37:59.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.825 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.826 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:59.826 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:59.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.528979511, 2020-06-12T02:37:59.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:37:59.827 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.827 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:37:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:59.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:37:59.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:37:59.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:37:59.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:37:59.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:37:59.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:37:59.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:37:59.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:37:59.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:37:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:37:59.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:37:59.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:37:59.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:37:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:37:59.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:37:59.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:37:59.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:37:59.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:37:59.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.840 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.841 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:37:59.842 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:59.842 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.52195026699999, 2020-06-12T02:37:59.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:37:59.842 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.843 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.844 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:37:59.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.844 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:59.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:37:59.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:37:59.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:37:59.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:37:59.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:37:59.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:37:59.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:37:59.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:37:59.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:37:59.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:37:59.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.858 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:37:59.858 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:59.859 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 115.52181281599999, 2020-06-12T02:37:59.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:37:59.859 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.859 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.859 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.860 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.860 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:37:59.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.861 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:59.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:37:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:37:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:37:59.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:37:59.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:37:59.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:37:59.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:37:59.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:37:59.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:37:59.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:37:59.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:37:59.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:37:59.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:37:59.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:37:59.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:37:59.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:37:59.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:37:59.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:37:59.872 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.872 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:59.873 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:59.874 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.72102507699999, 2020-06-12T02:37:59.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:37:59.874 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.874 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.875 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.875 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:37:59.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:37:59.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:37:59.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:37:59.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:37:59.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:37:59.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:37:59.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:37:59.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:37:59.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:37:59.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:37:59.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:37:59.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:37:59.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:37:59.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:37:59.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:37:59.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:37:59.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:37:59.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:37:59.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:37:59.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:37:59.890 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:37:59.891 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:59.892 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 110.72087846300001, 2020-06-12T02:37:59.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:37:59.892 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.892 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.893 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:37:59.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.893 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:59.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:37:59.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:37:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:37:59.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:37:59.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:37:59.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:37:59.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:37:59.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:37:59.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:37:59.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:37:59.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:37:59.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:37:59.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:37:59.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:37:59.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:37:59.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:37:59.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:37:59.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:37:59.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:37:59.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:37:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:37:59.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:37:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:37:59.908 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.909 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.909 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:59.910 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:59.910 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.764865589, 2020-06-12T02:37:59.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:37:59.912 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.912 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:37:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:59.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:37:59.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:37:59.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:37:59.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:37:59.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:37:59.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:37:59.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:37:59.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:37:59.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:37:59.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:37:59.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:37:59.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:37:59.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:37:59.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:37:59.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:37:59.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:37:59.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:37:59.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:37:59.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:37:59.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:37:59.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:37:59.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:37:59.928 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.928 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.928 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.929 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:59.929 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:59.929 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.759134076, 2020-06-12T02:37:59.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:37:59.931 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.931 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.932 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:37:59.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.932 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:59.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:37:59.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:37:59.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:37:59.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:37:59.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:37:59.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:37:59.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:37:59.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:37:59.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:37:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:37:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:37:59.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:37:59.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:37:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:37:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:37:59.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:37:59.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:37:59.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:37:59.944 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.944 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.945 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.945 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:37:59.946 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:59.946 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.75864056, 2020-06-12T02:37:59.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:37:59.946 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.946 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:37:59.947 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.947 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.947 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.947 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:37:59.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.948 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:59.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:37:59.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:37:59.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:37:59.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:37:59.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:37:59.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:37:59.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:37:59.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:37:59.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:37:59.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:37:59.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:37:59.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:37:59.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:37:59.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:37:59.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:37:59.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:37:59.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:37:59.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.959 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.960 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:37:59.960 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:59.961 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.758546553, 2020-06-12T02:37:59.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:37:59.961 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.961 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.961 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:59.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:37:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:37:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:37:59.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:37:59.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:37:59.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:37:59.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:37:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:37:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:37:59.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:37:59.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:37:59.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:37:59.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:37:59.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:37:59.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:37:59.973 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.973 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.973 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.72038552399999, 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:37:59.974 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.975 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:37:59.975 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:59.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:37:59.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:37:59.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:37:59.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:37:59.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:37:59.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:37:59.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:37:59.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:37:59.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:37:59.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:37:59.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:37:59.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:37:59.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:37:59.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:37:59.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:37:59.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.985 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.985 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.986 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:59.986 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:59.986 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.679588530999993, 2020-06-12T02:37:59.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:37:59.987 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.987 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.987 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:37:59.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:37:59.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:59.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:37:59.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:37:59.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:37:59.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:37:59.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:37:59.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:37:59.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:37:59.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:37:59.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:37:59.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:37:59.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:37:59.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:37:59.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:37:59.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:37:59.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:37:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:37:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:37:59.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:37:59.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:37:59.997 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.997 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:37:59.997 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:37:59.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:37:59.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:37:59.998 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:37:59.998 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:37:59.998 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.679346464999995, 2020-06-12T02:37:59.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:37:59.999 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:37:59.999 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:37:59.999 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:37:59.999 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:00.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:38:00.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:38:00.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:38:00.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:38:00.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:38:00.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:38:00.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:38:00.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:38:00.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:38:00.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:38:00.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:38:00.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.013 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.013 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.014 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:00.014 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:00.014 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.679136774, 2020-06-12T02:38:00.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.015 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:00.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.016 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:00.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:38:00.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:38:00.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:38:00.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:38:00.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:38:00.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:38:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:38:00.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:38:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:38:00.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:38:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:38:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.024 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:38:00.025 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 98.663602612999995, 2020-06-12T02:38:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:38:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.026 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:38:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:38:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:38:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:38:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:38:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:38:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:38:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:38:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:38:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:38:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:38:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 89.765542578999998, 2020-06-12T02:38:00.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.038 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:38:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:38:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:38:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:38:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:38:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:38:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:38:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:38:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:38:00.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:38:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:38:00.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:38:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:38:00.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:38:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.048 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.049 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:00.050 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:00.051 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:00.045+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:00.152 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:00.145+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:00.166 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:00.166 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:00.167 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:00.167 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:00.176 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:00.269 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:00.265+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:00.334 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:00.334 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:00.336 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:00.343 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:00.387 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:00.381+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:00.455 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:00.449+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:00.499 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:00.499 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:00.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:00.500 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:00.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.500 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:00.500 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:00.501 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 150.37321029500001, 2020-06-12T02:38:00.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:00.501 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.501 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.501 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.502 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.502 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:00.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.502 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:00.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:00.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:00.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:00.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:00.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:00.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:00.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:00.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:00.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:00.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:00.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:00.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:00.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:00.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:00.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:00.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:00.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:00.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:00.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:00.527 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.529 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.529 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.529 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:00.530 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:00.531 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 150.37307135899999, 2020-06-12T02:38:00.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:00.531 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.531 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.532 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:00.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:00.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:00.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:00.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:00.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:00.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:00.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:00.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:00.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:00.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:00.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:00.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:00.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:00.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:00.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:00.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:00.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:00.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:00.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:00.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:00.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:00.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:00.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:00.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:00.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:00.550 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.550 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.550 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.551 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:00.551 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:00.551 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 150.37293552099999, 2020-06-12T02:38:00.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:00.552 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.553 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.553 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.554 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:00.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.554 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:00.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:00.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:00.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:00.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:00.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:00.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:00.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:00.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:00.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:00.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:00.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:00.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:00.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:00.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:00.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:00.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:00.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:00.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:00.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:00.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:00.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:00.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:00.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:00.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:00.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:00.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:00.572 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.572 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.572 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.573 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:00.573 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:00.573 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 149.34927067300001, 2020-06-12T02:38:00.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:00.573 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.574 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.574 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:00.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:00.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:00.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:00.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:00.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:00.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:00.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:00.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:00.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:00.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:00.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:00.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:00.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:00.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:00.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:00.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:00.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:00.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:00.586 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.587 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.587 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.30182676300001, 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.588 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.589 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:00.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:00.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:00.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:00.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:00.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:00.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:00.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:00.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:00.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:00.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:00.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:00.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:00.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:00.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:00.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:00.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:00.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:00.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:00.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:00.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:00.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:00.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:00.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:00.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:00.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:00.603 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.603 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.604 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:00.605 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:00.605 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.55808972, 2020-06-12T02:38:00.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:00.605 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.605 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.606 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:00.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:00.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:00.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:00.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:00.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:00.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:00.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:00.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:00.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:00.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:00.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:00.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:00.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:00.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.616 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:00.617 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:00.617 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.55711635, 2020-06-12T02:38:00.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:00.617 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.618 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:00.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:00.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:00.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:00.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:00.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:00.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:00.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:00.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:00.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.628 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.629 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:00.629 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:00.629 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.55590723, 2020-06-12T02:38:00.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:00.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:00.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:00.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:00.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:00.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:00.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:00.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:00.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:00.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:00.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.55464424499999, 2020-06-12T02:38:00.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:00.644 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.644 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.644 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:00.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:00.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:00.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:00.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:00.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:00.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:00.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:00.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:00.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:00.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:00.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:00.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:00.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:00.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:00.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:00.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:00.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.657 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.658 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:00.658 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:00.658 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.54318611799999, 2020-06-12T02:38:00.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:00.659 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.659 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.659 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:00.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:00.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:00.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:00.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:00.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:00.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:00.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:00.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:00.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:00.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:00.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:00.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:00.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.672 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:00.673 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:00.673 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.54018507799999, 2020-06-12T02:38:00.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:00.673 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.674 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.674 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:00.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:00.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:00.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:00.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:00.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:00.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:00.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:00.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:00.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:00.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:00.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:00.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:00.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:00.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:00.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:00.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:00.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:00.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.689 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:00.689 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:00.689 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.517359079, 2020-06-12T02:38:00.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:00.690 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.690 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.690 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:00.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:00.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:00.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:00.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:00.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:00.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:00.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:00.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:00.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:00.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:00.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:00.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:00.702 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.702 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.702 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.703 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:00.704 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:00.704 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.51721368699999, 2020-06-12T02:38:00.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:00.704 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.704 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.705 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:00.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.706 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:00.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:00.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:00.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:00.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:00.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:00.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:00.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:00.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:00.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:00.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:00.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:00.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:00.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:00.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:00.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:00.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:00.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:00.717 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.717 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.717 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.48507240799999, 2020-06-12T02:38:00.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:00.719 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.719 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.720 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:00.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.720 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:00.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:00.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:00.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:00.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:00.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:00.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:00.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:00.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:00.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:00.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:00.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:00.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:00.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:00.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:00.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:00.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:00.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:00.733 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.479945773, 2020-06-12T02:38:00.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:00.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.734 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:00.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.734 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:00.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:00.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:00.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:00.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:00.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:00.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:00.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:00.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:00.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:00.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:00.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:00.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:00.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:00.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:00.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:00.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.747 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:00.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:00.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.47956676299999, 2020-06-12T02:38:00.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:00.748 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.748 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:00.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:00.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:00.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:00.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:00.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:00.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:00.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:00.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:00.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:00.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:00.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:00.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:00.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:00.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:00.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:00.760 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.760 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.760 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.761 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:00.761 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:00.762 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.479349308, 2020-06-12T02:38:00.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:00.762 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.762 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.762 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:00.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:00.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:00.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:00.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:00.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:00.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:00.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:00.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:00.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:00.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:00.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:00.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:00.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:00.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:00.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:00.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:00.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:00.776 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:00.777 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.11540706300001, 2020-06-12T02:38:00.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:00.777 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.777 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.777 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.778 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.778 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.778 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:00.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.778 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:00.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:00.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:00.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:00.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:00.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:00.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:00.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:00.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:00.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:00.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:00.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:00.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.787 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.52635427600001, 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:00.788 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.789 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:00.789 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:00.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:00.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:00.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:00.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:00.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:00.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:00.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:00.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:00.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:00.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:00.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:00.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:00.798 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.799 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.799 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:00.800 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:00.800 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 100.523320703, 2020-06-12T02:38:00.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:00.800 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:00.800 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:00.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:00.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:00.801 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:00.801 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:00.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:00.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:00.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:00.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:00.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:00.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:00.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:00.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:00.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:00.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:00.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:00.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:00.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:00.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:00.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:00.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:00.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:00.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:00.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:00.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:00.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:00.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:00.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:00.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:00.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:00.814 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:00.815 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:00.817 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:00.809+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:00.817 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:00.917 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:00.914+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:00.922+0000 7fcc0b9e8700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:00.935 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:00.934+0000 7fcc0a786700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:00.974 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:00.979 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:00.979 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:00.979 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:00.979 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:00.989 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:00.993 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:01.017 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:01.017 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:01.014+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:01.040 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:01.063 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:01.087 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:01.097 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:01.098 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:01.098 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:01.099 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:01.099 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:01.107 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:01.110 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:01.110 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.110 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.111 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:01.111 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:01.111 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.111 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.111 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.112 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:01.113 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:01.114 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:01.153 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:01.149+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:01.213 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.214 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.218 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:01.213+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:01.222 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:01.320 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:01.318+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:01.341 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.341 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.343 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:38:01.351 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:01.420 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:01.413+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:01.456 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:01.446+0000 7fec58f8b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:01.460 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:01.458+0000 7fec5359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:01.509 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.509 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.518 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:01.521 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:01.518+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:01.624 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.625 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.625 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:01.621+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:01.627 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:01.725 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:01.721+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:01.737 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.739 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.747 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:01.827 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:01.826+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:01.852 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:01.853 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:01.862 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:01.928 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:01.925+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:02.016 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.016 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.025 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:02.028 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:02.025+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:02.110 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:38:02.128 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:02.125+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:02.135 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.135 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.144 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:02.229 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:02.225+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:02.297 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.297 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.306 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:02.330 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:02.329+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:02.410 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.410 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.419 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:02.430 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:02.426+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:02.531 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:02.530+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:02.538 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.539 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.549 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:02.639 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:02.633+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:02.666 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.666 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.675 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:02.774 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:02.769+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:02.834 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:02.829+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:02.838 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:02.838 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:02.847 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:02.941 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:02.937+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:03.003 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:03.004 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:03.012 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:03.042 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:03.038+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:03.116 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:03.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:03.137+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:03.171 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:03.172 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:03.180 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:03.231 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:03.226+0000 7fc189817700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:03.234+0000 7fc189817700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:03.269 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:03.265+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:03.272 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:03.299 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:03.317 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:03.336 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:03.336 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:03.339 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:03.348 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:03.349 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:03.346+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:03.364 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:03.391 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:03.417 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:03.420 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:03.420 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:03.449 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:03.445+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:03.505 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:03.505 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:03.506 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:03.506 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:03.515 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:03.558 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:03.553+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:03.653 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:03.645+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:03.669 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:03.669 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:03.670 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:03.670 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:03.670 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:03.679 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:03.753 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:03.750+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:03.837 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:03.837 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:03.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:03.838 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:03.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.838 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 153.71119382099999, 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:03.839 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:03.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:03.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:03.840 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:03.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.840 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:03.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:03.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:03.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:03.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:03.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:03.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:03.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:03.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:03.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:03.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:03.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:03.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:03.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:03.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:03.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:03.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:03.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:03.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:03.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:03.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:03.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:03.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:03.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.855 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:03.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:03.856 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 153.71105488500001, 2020-06-12T02:38:03.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:03.856 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.856 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:03.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:03.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:03.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:03.857 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:03.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:03.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:03.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:03.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:03.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:03.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:03.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:03.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:03.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:03.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:03.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:03.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:03.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:03.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:03.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:03.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:03.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:03.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:03.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:03.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:03.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:03.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:03.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:03.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:03.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:03.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:03.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:03.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:03.877 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:03.878 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:03.879 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 153.710919047, 2020-06-12T02:38:03.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:03.879 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.879 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:03.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:03.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:03.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:03.880 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:03.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.881 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:03.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:03.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:03.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:03.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:03.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:03.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:03.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:03.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:03.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:03.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:03.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:03.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:03.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:03.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:03.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:03.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:03.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:03.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:03.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:03.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:03.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:03.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:03.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:03.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:03.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:03.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:03.902 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.902 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.902 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.903 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:03.903 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:03.903 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.68725419899999, 2020-06-12T02:38:03.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:03.903 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:03.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:03.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:03.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:03.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:03.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:03.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:03.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:03.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:03.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:03.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:03.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:03.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.914 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.915 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:03.915 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:03.915 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 144.639810289, 2020-06-12T02:38:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:03.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:03.917 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:03.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.917 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:03.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:03.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:03.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:03.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:03.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:03.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:03.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:03.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:03.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:03.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:03.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:03.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:03.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:03.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:03.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:03.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:03.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:03.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:03.931 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.932 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.933 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.933 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:03.933 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:03.934 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.89607324599999, 2020-06-12T02:38:03.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:03.934 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.934 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.934 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:03.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:03.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:03.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:03.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:03.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:03.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:03.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:03.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:03.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:03.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:03.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:03.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:03.945 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.945 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.945 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.946 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:03.946 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:03.946 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.89509987599999, 2020-06-12T02:38:03.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:03.947 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.947 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.947 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:03.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:03.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:03.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:03.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:03.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:03.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:03.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:03.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:03.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:03.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:03.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:03.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:03.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:03.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:03.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:03.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:03.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.958 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.958 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.958 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:03.959 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:03.959 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.89389075599999, 2020-06-12T02:38:03.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:03.959 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.959 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.960 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:03.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:03.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:03.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:03.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:03.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:03.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:03.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:03.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:03.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:03.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:03.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:03.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:03.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:03.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:03.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:03.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:03.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.970 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.971 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:03.971 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:03.971 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.89262777100001, 2020-06-12T02:38:03.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:03.972 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.972 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.972 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:03.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:03.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:03.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:03.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:03.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:03.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:03.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:03.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:03.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:03.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:03.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:03.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:03.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:03.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:03.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.983 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.983 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.984 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:03.984 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:03.984 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 117.881169644, 2020-06-12T02:38:03.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:03.985 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.985 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.985 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:03.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:03.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:03.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:03.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:03.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:03.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:03.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:03.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:03.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:03.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:03.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:03.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:03.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:03.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:03.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:03.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:03.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:03.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:03.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:03.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:03.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:03.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:03.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:03.995 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.995 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:03.996 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:03.997 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 117.878168604, 2020-06-12T02:38:03.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:03.997 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:03.997 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:03.997 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:03.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:03.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:03.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:03.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:04.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:04.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:04.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:04.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:04.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:04.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:04.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:04.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:04.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:04.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:04.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:04.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:04.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:04.008 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.008 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.008 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.009 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:04.009 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:04.009 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.855342605, 2020-06-12T02:38:04.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:04.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.010 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.010 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.010 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.010 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.010 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:04.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.011 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:04.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:04.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:04.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:04.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:04.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:04.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:04.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:04.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:04.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:04.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:04.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:04.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:04.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:04.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:04.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:04.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:04.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:04.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:04.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:04.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:04.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:04.022 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.023 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:04.024 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:04.024 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.855197213, 2020-06-12T02:38:04.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:04.024 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.025 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:04.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.025 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.025 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:04.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.026 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:04.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:04.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:04.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:04.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:04.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:04.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:04.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:04.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:04.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:04.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:04.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:04.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:04.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:04.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:04.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:04.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:04.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:04.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:04.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:04.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:04.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:04.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:04.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.039 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.039 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:04.040 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:04.040 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.823055934, 2020-06-12T02:38:04.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:04.040 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.041 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.041 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.041 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.041 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:04.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.042 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:04.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:04.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:04.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:04.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:04.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:04.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:04.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:04.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:04.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:04.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:04.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:04.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:04.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:04.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:04.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:04.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:04.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:04.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:04.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:04.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:04.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:04.055 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.055 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.055 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.056 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:04.056 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:04.056 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.817929299, 2020-06-12T02:38:04.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:04.057 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.057 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.057 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.057 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:04.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:04.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:04.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:04.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:04.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:04.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:04.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:04.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:04.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:04.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:04.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:04.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:04.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:04.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:04.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:04.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:04.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:04.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:04.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:04.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:04.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:04.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:04.070 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.071 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.071 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.071 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:04.072 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:04.072 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.817550289, 2020-06-12T02:38:04.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:04.072 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.072 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:04.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.074 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:04.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:04.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:04.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:04.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:04.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:04.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:04.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:04.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:04.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:04.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:04.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:04.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:04.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:04.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:04.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:04.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:04.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:04.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:04.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:04.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:04.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.086 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:04.087 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:04.087 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.817332834, 2020-06-12T02:38:04.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:04.088 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.088 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.089 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:04.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:04.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:04.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:04.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:04.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:04.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:04.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:04.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:04.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:04.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:04.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:04.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:04.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:04.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:04.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:04.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:04.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:04.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:04.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:04.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.104 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.104 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:04.105 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:04.105 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.45339058899999, 2020-06-12T02:38:04.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:04.105 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.105 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.107 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:04.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.107 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:04.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:04.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:04.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:04.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:04.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:04.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:04.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:04.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:04.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:04.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:04.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:04.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:04.116 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.116 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.117 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:04.117 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.86433780199999, 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:04.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:04.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:04.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:04.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:04.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:04.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:04.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:04.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:04.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:04.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:04.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:04.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:04.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.128 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.128 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.129 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:04.129 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:04.129 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.861304229, 2020-06-12T02:38:04.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:04.130 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.130 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.130 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.131 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.131 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:04.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.131 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:04.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:04.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:04.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:04.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:04.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:04.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:04.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:04.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:04.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:04.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:04.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:04.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:04.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:04.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:04.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.145 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:04.145 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:38:04.147 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:04.142+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:04.148 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:04.251 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:04.250+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:04.266 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:04.254+0000 7f067cb2c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:04.268 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:04.268 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:04.269 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:04.269 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:04.270 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:04.266+0000 7f067759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:04.278 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:04.352 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:04.350+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:04.382 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:04.382 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:04.382 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:04.383 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:04.383 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:04.392 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:04.453 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:04.449+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:04.503 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:04.503 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:04.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:04.504 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:04.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.504 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:38:04.504 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:04.505 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 140.250162389, 2020-06-12T02:38:04.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:38:04.505 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.505 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.505 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.506 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.506 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.506 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:38:04.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.506 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:04.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:04.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:38:04.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:38:04.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:38:04.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:38:04.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:38:04.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:38:04.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:38:04.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:38:04.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:38:04.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:38:04.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:38:04.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:38:04.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:38:04.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:38:04.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:38:04.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.523 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.523 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 140.248745337, 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.524 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.525 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.525 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.525 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.525 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:38:04.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.526 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:04.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:38:04.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:38:04.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:38:04.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:38:04.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:38:04.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:38:04.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:38:04.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:38:04.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:38:04.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:38:04.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:38:04.535 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.535 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.535 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.536 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.536 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:04.536 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.538181349, 2020-06-12T02:38:04.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:38:04.536 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.537 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.537 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:04.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:04.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:38:04.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:38:04.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:38:04.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:38:04.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:38:04.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:38:04.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:38:04.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:38:04.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:38:04.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:38:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:38:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:38:04.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:38:04.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:38:04.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:38:04.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:38:04.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:38:04.551 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.552 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.552 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.553 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.553 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:04.553 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.530500047, 2020-06-12T02:38:04.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:38:04.554 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.554 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.554 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.554 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:04.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:38:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:38:04.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:38:04.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:38:04.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:38:04.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:38:04.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:38:04.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:38:04.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:38:04.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:38:04.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:38:04.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:38:04.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:38:04.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:38:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:38:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:38:04.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:38:04.569 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.569 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.569 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.52144475, 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:38:04.570 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.571 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.571 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.571 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.571 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.571 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:38:04.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.572 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:04.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:38:04.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:38:04.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:38:04.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:38:04.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:38:04.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:38:04.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:38:04.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:38:04.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:38:04.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:38:04.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:38:04.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:38:04.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:38:04.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:38:04.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:38:04.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:38:04.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:38:04.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:38:04.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:38:04.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:38:04.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.587 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.587 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.588 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.588 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:04.588 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.520505211, 2020-06-12T02:38:04.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:38:04.588 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:38:04.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.590 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:04.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:04.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:38:04.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:38:04.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:38:04.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:38:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:38:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:38:04.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:38:04.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:38:04.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:38:04.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:38:04.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:38:04.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:38:04.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:38:04.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:38:04.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:38:04.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.604 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.520373264, 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:38:04.605 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.606 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.606 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:38:04.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.607 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:04.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:38:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:38:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:38:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:38:04.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:38:04.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:38:04.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:38:04.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:38:04.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:38:04.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:38:04.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:38:04.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:38:04.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:38:04.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:38:04.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:38:04.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:38:04.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:38:04.619 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.620 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:04.621 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.512700967, 2020-06-12T02:38:04.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:38:04.621 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.621 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.621 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:04.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:04.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:38:04.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:38:04.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:38:04.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:38:04.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:38:04.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:38:04.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:38:04.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:38:04.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:38:04.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:38:04.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:38:04.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:38:04.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:38:04.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:38:04.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.635 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.636 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:04.636 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.50672600199999, 2020-06-12T02:38:04.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:38:04.636 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.636 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.637 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:38:04.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:04.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:38:04.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:38:04.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:04.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:38:04.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:38:04.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:38:04.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:38:04.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:38:04.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:38:04.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:38:04.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:38:04.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:38:04.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:38:04.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:38:04.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:38:04.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:38:04.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:38:04.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:38:04.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:38:04.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.49989444000001, 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.654 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.655 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:38:04.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.656 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:04.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:04.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:38:04.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:38:04.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:38:04.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:38:04.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:38:04.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:38:04.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:38:04.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:38:04.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:38:04.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:38:04.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:38:04.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:38:04.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:38:04.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:38:04.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:38:04.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:38:04.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:38:04.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.670 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:04.671 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:04.671 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.499211491, 2020-06-12T02:38:04.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:38:04.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.672 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:38:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:04.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:38:04.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:38:04.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:38:04.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:38:04.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:38:04.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:38:04.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:38:04.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:38:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:38:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:38:04.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:38:04.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:38:04.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:38:04.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:38:04.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:38:04.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:38:04.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.687 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.499124729, 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.688 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.689 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:38:04.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.690 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:04.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:38:04.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:38:04.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:38:04.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:38:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:38:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:38:04.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:38:04.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:38:04.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:38:04.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:38:04.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:38:04.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:38:04.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:38:04.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:38:04.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:38:04.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:38:04.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:38:04.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:38:04.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.704 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:04.705 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:04.705 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.120731123, 2020-06-12T02:38:04.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:38:04.705 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.706 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.706 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.706 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:38:04.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.707 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:04.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:04.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:38:04.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:38:04.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:38:04.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:38:04.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:38:04.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:38:04.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:38:04.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:38:04.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:38:04.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:38:04.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:38:04.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.721 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.722 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:38:04.722 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.09830918599999, 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.723 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:38:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:04.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:38:04.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:38:04.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:38:04.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:38:04.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:38:04.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:38:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:38:04.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:38:04.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:38:04.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:38:04.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:38:04.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:38:04.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:38:04.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:38:04.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:38:04.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:38:04.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.736 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.737 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.738 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:04.738 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:04.738 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.25233449, 2020-06-12T02:38:04.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:38:04.739 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.739 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.739 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.740 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:38:04.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.740 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:04.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:04.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:38:04.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:38:04.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:38:04.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:38:04.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:38:04.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:38:04.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:38:04.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:38:04.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:38:04.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:38:04.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:38:04.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:38:04.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:38:04.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:38:04.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:38:04.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:38:04.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:38:04.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:38:04.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:38:04.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:38:04.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:38:04.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:38:04.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:38:04.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.758 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:04.759 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.251517326, 2020-06-12T02:38:04.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:38:04.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:04.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.761 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.762 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:38:04.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.763 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:04.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:04.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:38:04.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:38:04.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:38:04.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:38:04.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:38:04.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:38:04.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:38:04.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:38:04.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:38:04.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:38:04.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:38:04.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:38:04.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:38:04.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:38:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:38:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:04.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:38:04.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:38:04.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:38:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:38:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:38:04.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:38:04.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.780 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:04.781 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.251280686, 2020-06-12T02:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.784 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.784 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:38:04.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.785 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:04.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:04.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:38:04.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:38:04.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:38:04.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:38:04.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:38:04.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:38:04.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:38:04.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:38:04.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:38:04.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:38:04.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:38:04.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:38:04.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:38:04.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:38:04.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:38:04.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:38:04.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:38:04.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:38:04.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:38:04.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:38:04.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:38:04.800 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.800 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.800 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.801 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:04.801 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:04.801 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.525787755, 2020-06-12T02:38:04.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:38:04.801 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.802 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.802 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.802 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.802 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.802 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:38:04.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.803 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:04.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:04.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:38:04.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:38:04.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:38:04.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:38:04.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:38:04.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:38:04.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:38:04.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:38:04.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:38:04.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:04.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:38:04.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:38:04.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:38:04.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:38:04.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:38:04.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:38:04.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.814 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.815 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.815 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:04.815 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:04.816 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.52550694200001, 2020-06-12T02:38:04.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:38:04.816 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.817 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.817 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.817 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.817 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.817 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:38:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:04.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:04.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:38:04.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:38:04.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:38:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:38:04.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:38:04.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:38:04.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:04.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:38:04.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:38:04.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:38:04.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:38:04.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.829 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:38:04.829 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:04.829 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 103.446735707, 2020-06-12T02:38:04.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:38:04.830 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:04.830 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:04.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:04.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:04.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:38:04.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:38:04.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:04.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:38:04.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:38:04.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:04.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:38:04.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:38:04.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:38:04.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:38:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:04.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:38:04.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:38:04.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:04.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:04.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:04.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:38:04.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:38:04.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.841 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:04.842 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:04.842 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:04.844 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:04.837+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:04.844 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:04.945 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:04.941+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:04.959 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:04.960 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:04.970 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:05.047 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:05.046+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:05.077 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:05.078 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:05.086 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:05.125 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:38:05.148 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:05.141+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.12496752199999, 2020-06-12T02:38:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.12479715500001, 2020-06-12T02:38:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.10665912799999, 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.10072224499999, 2020-06-12T02:38:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.100213174, 2020-06-12T02:38:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.100054908, 2020-06-12T02:38:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 140.02565810600001, 2020-06-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 140.018647284, 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 125.25886074100001, 2020-06-12T02:38:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 125.25873314499999, 2020-06-12T02:38:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.84375250399999, 2020-06-12T02:38:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.84360774699999, 2020-06-12T02:38:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.843476897, 2020-06-12T02:38:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.84333257500001, 2020-06-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.843220594, 2020-06-12T02:38:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.843068109, 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.82232297100001, 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.493 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.821997877, 2020-06-12T02:38:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:05.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.706351394, 2020-06-12T02:38:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.706011136, 2020-06-12T02:38:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:05.543 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:05.544 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:05.546 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:05.541+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:05.546 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:05.646 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:05.641+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:05.698 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:05.694+0000 7f59d683d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:05.698+0000 7f59d55db700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:05.716 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:05.746 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:05.745+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:05.751 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:05.771 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:05.794 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:05.825 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:05.826 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:05.826 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:05.828 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:05.844 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:05.847 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:05.846+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:05.870 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:05.871 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:05.872 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.872 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.872 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.872 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.872 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:05.873 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:05.874 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:05.951 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:05.945+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:05.958 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:05.959 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:06.052 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:06.045+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:06.090 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.091 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.092 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:06.154 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:06.150+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:06.207 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.208 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.217 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:06.255 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:06.249+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:06.359 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:06.358+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:06.370 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.370 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.379 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:06.459 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:06.458+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:06.498 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.498 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:06.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:06.557+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:06.612 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.612 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.624 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:06.662 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:06.658+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:06.764 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:06.757+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:06.783 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.791 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:06.864 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:06.862+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:06.939 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:06.939 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:06.950 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:06.968 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:06.966+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:07.054 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.055 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.063 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:07.110 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:07.105+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:07.137 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:38:07.169 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:07.165+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:07.174 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.175 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.180 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:07.257 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:07.246+0000 7fec8bf48700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:07.261 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:07.258+0000 7fec8ace6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:07.269 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:07.266+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:07.342 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.342 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.351 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:07.374 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:07.366+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:07.462 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.462 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.471 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:07.472 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:07.470+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:07.573 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:07.569+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:07.587 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.587 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.594 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:07.684 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:07.681+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:07.748 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.749 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.758 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:07.801 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:07.797+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:07.876 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:07.877 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:07.873+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:07.911 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:07.911 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:07.920 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:07.978 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:07.974+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:07.995 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:07.986+0000 7f9a55967700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:07.996 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:07.994+0000 7f9a55967700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:08.025 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:08.046 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:08.067 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:08.072 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:08.073 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:08.078 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:08.074+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:08.082 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:08.097 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:08.123 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:08.151 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:38:08.158 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:08.182 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:08.183 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.184 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.184 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:08.185 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:08.185 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.185 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.185 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.185 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.186 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:08.186 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:08.178+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:08.187 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:08.187 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:08.203 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:08.203 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:08.204 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:08.205 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:08.210 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:08.295 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:08.294+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:08.360 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:08.361 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:08.370 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:08.385 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:08.381+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:08.486 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:08.482+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:08.529 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.428598494, 2020-06-12T02:38:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.42842812699999, 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.4102901, 2020-06-12T02:38:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.40435321699999, 2020-06-12T02:38:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.40384414600001, 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.40368588000001, 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.32928907799999, 2020-06-12T02:38:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 143.322278256, 2020-06-12T02:38:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 128.56249171299999, 2020-06-12T02:38:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 128.56236411699999, 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.147383476, 2020-06-12T02:38:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.147238719, 2020-06-12T02:38:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.147107869, 2020-06-12T02:38:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.146963547, 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.146851566, 2020-06-12T02:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:08.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:08.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.14669908099999, 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.125953943, 2020-06-12T02:38:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.12562884899999, 2020-06-12T02:38:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.009982366, 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.00964210799999, 2020-06-12T02:38:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:08.852 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:08.854 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:08.853+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:08.854 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:08.955 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:08.953+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:09.011 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:09.011 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:09.012 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:09.012 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:09.020 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:09.074 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:09.066+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:09.129 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:09.129 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:09.130 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:09.139 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:09.157 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:09.153+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:09.267 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:09.254+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:09.293 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:09.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:09.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 160.57255860800001, 2020-06-12T02:38:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.298 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:09.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:09.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:09.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:09.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:09.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:09.316 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.142579356, 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.317 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:09.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:09.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:09.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:09.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:09.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:09.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:09.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.340 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.02661619099999, 2020-06-12T02:38:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:09.341 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.342 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.350 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:09.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:09.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:09.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:09.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:09.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:09.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:09.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.02623919000001, 2020-06-12T02:38:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:09.369 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:09.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:09.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:09.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:09.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:09.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.025829655, 2020-06-12T02:38:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.386 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.387 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:09.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:09.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:09.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:09.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:09.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.407 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:09.409 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.02543732399999, 2020-06-12T02:38:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.410 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.411 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:09.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:09.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:09.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:09.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:09.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:09.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:09.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:09.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.00850289600001, 2020-06-12T02:38:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:09.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.434 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:09.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.00250829699999, 2020-06-12T02:38:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:09.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:09.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:09.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:09.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.463 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:09.464 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.00137172300001, 2020-06-12T02:38:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.466 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:09.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:09.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:09.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:09.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:09.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:09.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.00118962600001, 2020-06-12T02:38:09.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:09.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:09.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.354004304, 2020-06-12T02:38:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:09.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.496 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.508 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:09.509 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.35369191500001, 2020-06-12T02:38:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:09.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.511 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:09.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:09.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:09.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:09.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:09.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:09.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:09.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.34212332300001, 2020-06-12T02:38:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:09.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.525 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:09.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.540 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:09.541 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.341783865, 2020-06-12T02:38:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.542 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:09.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:09.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:09.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:09.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:09.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.557 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:09.558 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 135.34148741999999, 2020-06-12T02:38:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:09.559 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.560 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:09.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:09.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:09.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:09.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:09.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:09.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:09.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:09.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:09.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:09.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:09.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:09.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:09.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:09.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:09.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:09.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:09.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.578 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:09.578 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:09.578 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.304453644000006, 2020-06-12T02:38:09.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:09.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.579 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:09.580 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.580 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.580 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.581 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:09.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.581 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:09.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:09.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:09.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:09.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:09.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:09.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:09.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:09.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:09.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:09.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:09.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:09.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:09.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:09.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:09.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:09.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.596 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:09.596 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:09.596 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.296847196000002, 2020-06-12T02:38:09.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:09.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.597 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:09.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.598 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.598 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:09.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.598 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:09.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:09.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:09.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:09.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:09.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:09.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:09.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:09.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:09.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:09.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:09.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:09.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.293468657999995, 2020-06-12T02:38:09.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:09.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:09.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.612 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.612 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:09.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.613 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:09.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:09.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:09.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:09.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:09.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:09.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:09.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:09.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:09.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:09.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:09.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:09.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:09.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:09.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:09.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:09.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:09.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:09.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:09.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:09.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.633 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.634 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:09.634 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:09.634 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.293198403999995, 2020-06-12T02:38:09.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:09.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.635 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:09.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.636 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.636 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:09.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.637 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:09.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:09.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:09.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:09.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:09.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:09.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:09.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:09.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:09.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:09.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:09.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:09.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:09.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:09.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:09.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:09.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:09.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.651 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:09.651 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 95.293017281999994, 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:09.652 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:09.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:09.653 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:09.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:09.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:09.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:09.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:09.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:09.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:09.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:09.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:09.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:09.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:09.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:09.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:09.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:09.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:09.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:09.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:09.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:09.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:09.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:09.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:09.664 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:09.664 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:09.665 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:09.666 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:09.662+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:09.766 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:09.761+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:09.825 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:09.825 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:09.826 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:09.826 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:09.839 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:09.891 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:09.890+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:09.953 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:09.954 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:09.963 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:10.007 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:10.006+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:10.070 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:10.065+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:10.122 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:10.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.99724094800001, 2020-06-12T02:38:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:10.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.125 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:10.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:10.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:10.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:10.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:10.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:10.140 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.99701750599999, 2020-06-12T02:38:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.141 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:10.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:10.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:10.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:10.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:10.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:10.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:10.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:10.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.95453839699999, 2020-06-12T02:38:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:10.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.158 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:10.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:10.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:10.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:10.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:10.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:10.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:10.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:10.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:10.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:10.175 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.954203503, 2020-06-12T02:38:10.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.177 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:10.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:10.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:10.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:10.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:10.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:10.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:10.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.75332761999999, 2020-06-12T02:38:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:10.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:10.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:10.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:10.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:10.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:10.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:10.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.210 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.753167807, 2020-06-12T02:38:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:10.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:10.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:10.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:10.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:10.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:10.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:10.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.75308709399999, 2020-06-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:10.239 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.752840541, 2020-06-12T02:38:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.240 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:10.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:10.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:10.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:10.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:10.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:10.255 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.739490218, 2020-06-12T02:38:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:10.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:10.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:10.267 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.268 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.739303964, 2020-06-12T02:38:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.269 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.282 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:10.283 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.739103253, 2020-06-12T02:38:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.284 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.285 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:10.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:10.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:10.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:10.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:10.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.299 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.14661529200001, 2020-06-12T02:38:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.300 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:10.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:10.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:10.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:10.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:10.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:10.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.14619154499999, 2020-06-12T02:38:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:10.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.316 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:10.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:10.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:10.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:10.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:10.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:10.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:10.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:10.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:10.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.329 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:10.330 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.146037687, 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:10.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:10.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:10.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:10.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.342 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.143306899, 2020-06-12T02:38:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:10.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:10.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:10.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.353 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:10.354 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.14288657199999, 2020-06-12T02:38:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:10.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.356 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:10.366 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.142791739, 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.367 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.113012385, 2020-06-12T02:38:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:10.380 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:10.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:10.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:10.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:10.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:10.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:10.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:10.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.396 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.112546772, 2020-06-12T02:38:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.398 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:10.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:10.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:10.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:10.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:10.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:10.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:10.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:10.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:10.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:10.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:10.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:10.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:10.412 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.412 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.413 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:10.413 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:10.414 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.112372837, 2020-06-12T02:38:10.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:10.414 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:10.414 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:10.414 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:10.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:10.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:10.415 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:10.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.415 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:10.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:10.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:10.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:10.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:10.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:10.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:10.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:10.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:10.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:10.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:10.429 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:10.429 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:10.429 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:38:10.430 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:10.432 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:10.430+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:10.433 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:10.532 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:10.529+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:10.550 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:10.551 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:10.560 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:10.580 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:10.574+0000 7fed267d1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:10.583 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:10.582+0000 7fed267d1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:10.594 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:10.582+0000 7fa2639cd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:10.597 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:10.594+0000 7fa26276b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:10.614 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:10.642 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:10.648 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:10.645+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:10.662 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:10.685 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:10.711 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:10.716 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:10.717 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:10.732 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:10.762 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:10.762 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.762 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.762 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.763 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.764 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:10.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:10.765 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:10.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:10.773+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:10.835 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:10.829+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:10.901 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:10.901 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:10.911 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:10.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:10.949+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:11.037 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:11.034+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:11.062 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.062 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.071 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:11.138 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:11.133+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:11.175 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.176 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.185 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:38:11.187 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:11.258 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:11.253+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:11.350 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.351 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.358 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:11.353+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:11.359 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:11.459 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:11.458+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:11.514 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.514 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.523 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:11.560 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:11.558+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:11.628 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.628 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.638 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:11.661 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:11.658+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:11.745 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.746 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.755 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:11.804 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:11.801+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:11.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:11.863 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:11.863 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:11.858+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:11.872 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:11.963 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:11.957+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:12.028 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.030 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.057 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:12.102 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:12.097+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:12.172 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:12.169+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:12.211 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.212 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.221 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:12.274 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:12.270+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:12.341 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.342 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.350 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:12.395 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:12.394+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:12.476 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:12.473+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:12.508 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.508 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.517 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:12.577 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:12.574+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:12.629 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.629 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.638 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:12.678 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:12.673+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:12.766 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:12.779 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:12.777+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:12.788 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:12.788 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:12.798 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:12.867 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:12.862+0000 7f2516ba6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:12.871 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:12.870+0000 7f2516ba6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:12.879 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:12.873+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:12.903 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:12.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:12.943 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:12.944 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:12.953 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:12.955 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:12.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:12.977+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:12.986 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:13.017 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:13.048 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:13.058 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:13.058 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 164.33645450200001, 2020-06-12T02:38:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.061 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.061 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.061 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:13.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:13.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.90647525, 2020-06-12T02:38:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.79051208499999, 2020-06-12T02:38:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.79013508400001, 2020-06-12T02:38:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.789725549, 2020-06-12T02:38:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:13.162 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.789333218, 2020-06-12T02:38:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.163 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.164 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:13.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:13.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:13.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:13.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:13.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:13.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.77239879000001, 2020-06-12T02:38:13.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:13.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:13.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:13.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:13.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:13.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:13.208 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.76640419099999, 2020-06-12T02:38:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.209 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:13.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:13.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:13.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:13.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:13.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.76526761700001, 2020-06-12T02:38:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:13.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.225 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:13.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:13.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:13.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:13.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:13.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:13.238 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.76508552000001, 2020-06-12T02:38:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.239 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:13.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:13.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:13.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:13.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:13.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:13.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:13.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.117900198, 2020-06-12T02:38:13.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.254 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:13.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:13.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:13.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.267 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:13.268 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.11758780900001, 2020-06-12T02:38:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.10601921700001, 2020-06-12T02:38:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.105679759, 2020-06-12T02:38:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:13.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:13.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 139.10538331399999, 2020-06-12T02:38:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.068349538000007, 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.060743090000003, 2020-06-12T02:38:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.057364551999996, 2020-06-12T02:38:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:13.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:13.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:13.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:13.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:13.389 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:13.390 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.057094297999996, 2020-06-12T02:38:13.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:13.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.390 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:13.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.391 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.391 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:13.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.392 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:13.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:13.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:13.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:13.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:13.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:13.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:13.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:13.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:13.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:13.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:13.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:13.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:13.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:13.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:13.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:13.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:13.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:13.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:13.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:13.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.405 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:13.405 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:13.405 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.056913175999995, 2020-06-12T02:38:13.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:13.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.406 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:13.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.406 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.407 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:13.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:13.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:13.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:13.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:13.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:13.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:13.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:13.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:13.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:13.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:13.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:13.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:13.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:13.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.418 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.418 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.419 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:13.419 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:38:13.421 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:13.422 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.422 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.422 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:13.422 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:13.422 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.423 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.423 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.423 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.423 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:13.423 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:13.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:13.424 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:13.418+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:13.425 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:13.521 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:13.517+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:13.576 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:13.577 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:13.579 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:13.566+0000 7f080192a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:13.584 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:13.582+0000 7f07fbfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:13.586 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:13.622 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:13.617+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:13.707 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:13.708 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:13.708 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:13.708 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:13.708 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:13.717 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:13.722 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:13.721+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:13.823 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:13.821+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:13.826 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:13.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.70075195000001, 2020-06-12T02:38:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:13.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:13.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:13.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:13.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:13.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:13.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:13.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:13.841 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.70052850799999, 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.65804939899999, 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.857 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:13.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.657714505, 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.45683862200001, 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.456678809, 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.45659809599999, 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.456351543, 2020-06-12T02:38:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.44300122, 2020-06-12T02:38:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.442814966, 2020-06-12T02:38:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.442614255, 2020-06-12T02:38:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:13.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:13.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.005 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:14.006 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.85012629400001, 2020-06-12T02:38:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:14.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:14.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:14.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:14.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:14.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:14.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:14.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:14.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:14.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.025 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.84970254700001, 2020-06-12T02:38:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.027 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:14.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:14.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:14.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:14.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:14.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:14.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:14.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:14.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:14.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.045 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:14.047 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.849548689, 2020-06-12T02:38:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.048 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.049 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:14.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:14.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:14.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:14.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:14.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.84681790099999, 2020-06-12T02:38:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:14.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.067 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:14.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:14.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:14.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:14.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.84639757399999, 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:14.091 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 113.846302741, 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.093 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:14.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:14.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:14.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:14.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:14.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:14.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:14.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:14.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.816523387, 2020-06-12T02:38:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.108 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:14.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:14.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:14.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:14.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:14.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:14.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:14.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:14.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.816057774, 2020-06-12T02:38:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:14.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:14.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.142 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:14.142 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 109.81588383899999, 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:14.143 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:14.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.144 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:14.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:14.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:14.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:14.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:14.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:14.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:14.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:14.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:14.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:14.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:14.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:14.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:14.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:14.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:14.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:14.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:14.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:14.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:14.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:14.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:14.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:14.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:14.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:14.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:14.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:14.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:14.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:14.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:14.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:14.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:14.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:14.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:14.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:14.164 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:14.164 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:14.165 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:14.166 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:14.161+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:38:14.267 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:14.266+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:14.295 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:14.296 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:14.316 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:14.316 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:14.317 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:14.368 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:14.366+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:14.449 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:14.450 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:14.450 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:14.463 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:14.508 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:14.505+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:14.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:14.565+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:14.575 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:14.576 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:14.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:14.576 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:14.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.577 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:14.577 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:14.577 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.436926599, 2020-06-12T02:38:14.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:38:14.577 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:38:14.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.579 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:14.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:14.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:38:14.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:38:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:38:14.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:38:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:38:14.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:38:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:38:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:38:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:38:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:38:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:38:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:38:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:38:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:38:14.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:38:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:38:14.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:38:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:38:14.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:38:14.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:38:14.594 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:14.594 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.42603521800001, 2020-06-12T02:38:14.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:38:14.594 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.594 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.595 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:14.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:14.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:38:14.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:38:14.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:38:14.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:38:14.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:38:14.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:38:14.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:38:14.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:38:14.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:38:14.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:38:14.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:38:14.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:38:14.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:38:14.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:38:14.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:38:14.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:38:14.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:38:14.607 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.608 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.608 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.609 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:14.609 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:14.609 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.42490317400001, 2020-06-12T02:38:14.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:38:14.609 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.610 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.610 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.610 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:14.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:14.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:38:14.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:38:14.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:38:14.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:38:14.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:38:14.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:38:14.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:38:14.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:38:14.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:38:14.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:38:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:38:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:38:14.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:38:14.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:38:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:38:14.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:38:14.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:38:14.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:38:14.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:38:14.624 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.624 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.625 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.625 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:14.625 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:14.626 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.42464798899999, 2020-06-12T02:38:14.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:38:14.626 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.627 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.627 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.627 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.627 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.627 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:38:14.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.628 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:14.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:14.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:38:14.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:38:14.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:38:14.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:38:14.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:38:14.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:38:14.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:38:14.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:38:14.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:38:14.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:38:14.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:38:14.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:38:14.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:38:14.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:38:14.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:38:14.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:38:14.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:38:14.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:38:14.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:38:14.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:38:14.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:38:14.647 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.647 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.648 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.42448880200001, 2020-06-12T02:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:38:14.650 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.650 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.650 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.651 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.651 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.651 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:38:14.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.652 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:14.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:14.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:38:14.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:38:14.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:38:14.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:38:14.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:38:14.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:38:14.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:38:14.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:38:14.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:38:14.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:38:14.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:38:14.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:38:14.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:38:14.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:38:14.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:38:14.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:38:14.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:38:14.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:38:14.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:38:14.672 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.672 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.673 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.674 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:38:14.674 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:14.675 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.280166224, 2020-06-12T02:38:14.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:38:14.675 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.676 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.676 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.676 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.677 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.677 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:38:14.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.677 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:14.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:14.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:38:14.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:38:14.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:38:14.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:38:14.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:38:14.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:38:14.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:38:14.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:38:14.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:38:14.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:38:14.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:38:14.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:38:14.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:38:14.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.688 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.689 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:14.689 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:14.690 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.53909672699999, 2020-06-12T02:38:14.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:38:14.690 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.691 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.692 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:38:14.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.693 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:14.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:14.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:38:14.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:38:14.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:38:14.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:38:14.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:38:14.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:38:14.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:38:14.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:38:14.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:38:14.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:38:14.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:38:14.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:38:14.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:38:14.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:38:14.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:38:14.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:38:14.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:38:14.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:38:14.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:38:14.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:38:14.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:38:14.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:38:14.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:38:14.712 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.712 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.712 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.60139432599999, 2020-06-12T02:38:14.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:38:14.714 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.714 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.714 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.714 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.714 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:14.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:14.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:38:14.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:38:14.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:38:14.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:38:14.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:38:14.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:38:14.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:38:14.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:38:14.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:38:14.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:38:14.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:38:14.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:14.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:38:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:38:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:38:14.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:38:14.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:38:14.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:38:14.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:38:14.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:38:14.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:38:14.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:38:14.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:38:14.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:38:14.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:38:14.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:38:14.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:14.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:14.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.61951824600001, 2020-06-12T02:38:14.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:38:14.732 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.733 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:38:14.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.734 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:14.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:14.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:38:14.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:38:14.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:38:14.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:38:14.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:38:14.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:38:14.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:38:14.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:38:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:38:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:38:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:38:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:38:14.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:38:14.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:38:14.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:38:14.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:38:14.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:38:14.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:38:14.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:38:14.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.746 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.747 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:14.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:14.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.61932493, 2020-06-12T02:38:14.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:38:14.748 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.748 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.749 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.749 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.749 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:38:14.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:14.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:38:14.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:38:14.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:38:14.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:38:14.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:38:14.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:38:14.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:38:14.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:38:14.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:38:14.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:14.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:38:14.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:38:14.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:38:14.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:38:14.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:38:14.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:38:14.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:38:14.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:38:14.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.761 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.762 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.762 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:14.762 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.61917647499999, 2020-06-12T02:38:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:38:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.764 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:38:14.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.765 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:14.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:14.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:38:14.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:38:14.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:38:14.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:38:14.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:38:14.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:38:14.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:38:14.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:38:14.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:38:14.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:38:14.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:38:14.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:14.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:38:14.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:38:14.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:38:14.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:38:14.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:38:14.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:38:14.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:38:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.61174352500001, 2020-06-12T02:38:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:38:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:38:14.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:38:14.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:38:14.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:38:14.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:38:14.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:38:14.792 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.793 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.793 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.793 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.60933502500001, 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.794 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:14.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:14.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:38:14.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:38:14.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:38:14.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:38:14.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:38:14.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:38:14.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:38:14.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:38:14.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:38:14.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:38:14.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:38:14.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:38:14.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:38:14.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:38:14.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.805 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:14.806 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:14.806 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.60730788000001, 2020-06-12T02:38:14.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:14.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:14.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:38:14.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:38:14.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:38:14.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:38:14.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:38:14.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:38:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:38:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:38:14.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:38:14.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:38:14.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:38:14.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:38:14.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:38:14.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:38:14.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:38:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:38:14.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:38:14.818 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.818 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.818 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.819 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:38:14.819 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:14.819 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.59625804699999, 2020-06-12T02:38:14.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:38:14.819 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:14.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:38:14.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:38:14.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:38:14.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:38:14.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:38:14.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:38:14.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:38:14.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:38:14.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:38:14.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:38:14.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:38:14.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:38:14.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:38:14.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:38:14.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:38:14.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.831 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.831 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.831 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:14.832 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:14.832 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.59204502999999, 2020-06-12T02:38:14.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:38:14.832 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.833 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:14.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:38:14.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:38:14.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:38:14.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:38:14.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:38:14.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:38:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:38:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:38:14.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:38:14.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:38:14.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:38:14.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:38:14.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:38:14.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:38:14.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:38:14.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:38:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:38:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.848 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:14.848 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:14.848 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.591861831, 2020-06-12T02:38:14.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:38:14.848 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.849 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.849 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.849 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.850 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:38:14.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.850 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:14.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:14.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:38:14.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:38:14.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:38:14.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:38:14.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:38:14.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:38:14.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:38:14.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:38:14.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:38:14.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:38:14.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:38:14.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:14.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:38:14.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:38:14.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:38:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:38:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:38:14.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:38:14.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:38:14.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:38:14.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:38:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:38:14.864 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.865 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.865 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.134943787, 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:14.866 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:14.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:14.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:38:14.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:38:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:38:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:38:14.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:38:14.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:38:14.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:38:14.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:38:14.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:38:14.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:38:14.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:38:14.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:38:14.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:38:14.877 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.877 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.877 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.878 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:38:14.878 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:14.878 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.60448219, 2020-06-12T02:38:14.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.879 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:38:14.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.880 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:38:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:38:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:38:14.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:38:14.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:38:14.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:38:14.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:38:14.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:38:14.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:38:14.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:38:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:38:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:38:14.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:38:14.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:14.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:38:14.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:38:14.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:14.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:38:14.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:38:14.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.893 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:38:14.893 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:14.893 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 104.60422307100001, 2020-06-12T02:38:14.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:38:14.893 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:14.894 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:14.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:14.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:14.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:14.895 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:38:14.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.895 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:14.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:14.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:14.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:14.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:38:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:14.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:38:14.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:38:14.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:14.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:38:14.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:38:14.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:14.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:38:14.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:38:14.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:38:14.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:38:14.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:14.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:38:14.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:38:14.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:38:14.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:38:14.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:14.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:38:14.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:38:14.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:14.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:38:14.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:38:14.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:14.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:14.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:38:14.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:38:14.908 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.908 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.908 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.909 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:14.909 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:14.909 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:14.910 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:14.906+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:14.911 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:15.011 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:15.010+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:15.066 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:15.067 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:15.067 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:15.067 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:15.076 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:15.120 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:15.117+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:15.185 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:15.185 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:15.186 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:15.194 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:15.240 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:15.237+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:15.322 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:15.322+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:15.351 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:15.351 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:15.352 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 164.20158212600001, 2020-06-12T02:38:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:38:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:15.353 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:38:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:38:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:38:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:38:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:38:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:38:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:38:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:38:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:38:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:38:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:38:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:38:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:38:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:38:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:38:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.364 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:38:15.365 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 159.05506861500001, 2020-06-12T02:38:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:38:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.366 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:38:15.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:38:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:38:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:38:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:38:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:38:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:38:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:38:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:38:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:38:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:38:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:38:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:38:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:15.380 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.377519941, 2020-06-12T02:38:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:38:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.381 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.382 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:38:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:38:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:38:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:38:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:38:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:38:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:38:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:38:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:38:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:38:15.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:38:15.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:38:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:38:15.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:38:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:38:15.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:38:15.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:38:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:38:15.396 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.397 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.376756013, 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.398 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:38:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.399 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:38:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:38:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:38:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:38:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:38:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:38:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:38:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:38:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:38:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:38:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:38:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:38:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:38:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:38:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:38:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:38:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:38:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:38:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:38:15.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:38:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:38:15.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:38:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:38:15.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:38:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:38:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.416 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:15.417 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.153950958, 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.418 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:38:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:38:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:38:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:38:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:38:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:38:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:38:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:38:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:38:15.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:38:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:38:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:38:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:38:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:38:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:38:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:38:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.14566467099999, 2020-06-12T02:38:15.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:38:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.433 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:38:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:38:15.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:38:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:38:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:38:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:38:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:38:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:38:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:38:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:38:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:38:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:38:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:38:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:38:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:38:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:38:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:38:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:38:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:38:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:15.448 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.138635427, 2020-06-12T02:38:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:38:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.450 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:38:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:15.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:38:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:38:15.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:38:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:38:15.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:38:15.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:38:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:38:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:38:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:38:15.458 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:38:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:38:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.460 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:38:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:38:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:38:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:38:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:38:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:38:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.463 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:15.464 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 131.138497976, 2020-06-12T02:38:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:38:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.465 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:38:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:38:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:38:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:38:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:38:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:38:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:38:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:38:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:38:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:15.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:38:15.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:38:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:38:15.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:38:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:38:15.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.477 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.337710237, 2020-06-12T02:38:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:38:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.478 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:38:15.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:15.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:38:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:38:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:38:15.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:38:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:38:15.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:38:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:38:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:38:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:38:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:38:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:38:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:38:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:38:15.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:38:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:38:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:38:15.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:38:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:38:15.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:38:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:38:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:38:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.33756362299999, 2020-06-12T02:38:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:38:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.498 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:38:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:38:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:38:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:38:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:38:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:38:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:38:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:38:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:38:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:38:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:38:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:38:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:38:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:38:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:38:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:38:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:38:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:38:15.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:38:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:38:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:38:15.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:38:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:38:15.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:38:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:38:15.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:38:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.381550749, 2020-06-12T02:38:15.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.518 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:38:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:38:15.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:38:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:38:15.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:38:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:38:15.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:38:15.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:38:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:38:15.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:38:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:38:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:38:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:38:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:38:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:38:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:38:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:38:15.530 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.375819236, 2020-06-12T02:38:15.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.533 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:38:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:38:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:38:15.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:38:15.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:38:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:38:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:38:15.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:38:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:38:15.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:38:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:38:15.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:38:15.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:38:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:38:15.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:38:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:38:15.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:15.546 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.37532572000001, 2020-06-12T02:38:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:38:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:15.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:38:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:38:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:38:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:38:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:38:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:38:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:38:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:38:15.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:38:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:38:15.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:38:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:38:15.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:38:15.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.560 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.37523171300001, 2020-06-12T02:38:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:38:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.561 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.562 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:38:15.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:38:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:38:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:38:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:38:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:38:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:38:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:38:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:38:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:38:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:38:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:38:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:38:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.337070684, 2020-06-12T02:38:15.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:38:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:38:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:38:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:38:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:38:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:38:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:38:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:38:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:38:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:38:15.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:38:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:38:15.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:38:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:38:15.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:38:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:38:15.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:38:15.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:38:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.296273691, 2020-06-12T02:38:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:38:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.594 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:38:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:38:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:38:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:38:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:38:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:38:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:38:15.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:38:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:38:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:38:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:38:15.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:38:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.296031625, 2020-06-12T02:38:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:38:15.605 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:38:15.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:15.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:15.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:38:15.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:38:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:38:15.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:38:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:38:15.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:38:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:38:15.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:38:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:38:15.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:38:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:38:15.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:38:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:38:15.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.616 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.295821934, 2020-06-12T02:38:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:38:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.618 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:38:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:38:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:38:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:38:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:38:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:38:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:38:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:38:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:38:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:38:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:38:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:38:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:38:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:38:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:38:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:38:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:15.629 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 114.280287773, 2020-06-12T02:38:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:38:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.630 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:38:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:38:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:38:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:38:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:38:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:38:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:38:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:38:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:38:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:38:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:38:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 105.382227739, 2020-06-12T02:38:15.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:38:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:15.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:38:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:38:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:38:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:38:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:38:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:38:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:38:15.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:38:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:38:15.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:38:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:38:15.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:38:15.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:38:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:38:15.652 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:15.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:15.653 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:15.654 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:15.656 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:15.649+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:15.657 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:15.756 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:15.753+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:15.774 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:15.762+0000 7f78cb3d9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:15.770+0000 7f78ca177700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:15.803 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:15.814 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:15.815 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:15.815 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:15.824 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:15.825 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:15.849 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:15.869 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:15.865+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:15.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:15.899 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:15.924 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:15.952 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:15.952 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.952 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.953 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:15.953 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:15.953 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.953 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.954 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.954 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.954 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:15.956 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:15.957 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:15.967 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:15.961+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:15.981 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:15.981 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:15.998 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:16.084 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:16.081+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:16.151 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.151 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.160 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:16.168 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:16.166+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:16.220 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:38:16.269 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:16.265+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:16.319 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.319 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.328 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:16.336 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:16.326+0000 7fdcf0652700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:16.341 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:16.338+0000 7fdcef3f0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:16.372 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:16.369+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:16.472 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:16.466+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:16.483 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.483 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.492 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:16.572 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:16.570+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:16.602 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.603 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.613 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:16.673 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:16.670+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:16.740 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.740 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.749 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:16.798 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:16.790+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:16.879 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:16.878+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:16.911 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:16.912 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:16.921 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:16.980 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:16.973+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:17.071 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.072 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.082 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:17.077+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:17.082 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:17.183 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:17.177+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:17.192 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.192 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.201 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:17.220 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:38:17.284 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:17.277+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:17.303 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.303 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.312 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:17.385 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:17.382+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.435 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:17.515 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:17.514+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:17.580 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.581 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.586 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:17.582+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:17.589 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:17.688 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:17.681+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:17.739 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.740 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.749 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:17.788 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:17.785+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:17.863 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.864 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.871 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:17.890 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:17.886+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:17.959 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:17.989 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:17.990 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:17.990 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:17.985+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:17.999 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:18.065 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:18.062+0000 7f623f702700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:18.071 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:18.070+0000 7f623e4a0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:18.090 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:18.085+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:18.104 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:18.128 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:18.154 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:18.155 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:18.164 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:18.191 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:18.190+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:18.204 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:18.230 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:18.256 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:18.256 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.256 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.257 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:18.257 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:18.257 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.257 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.258 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.258 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.258 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:18.259 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:18.259 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:18.303 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:18.302+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:18.324 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:18.325 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:18.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:18.325 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:18.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.326 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:18.326 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:18.326 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.18769348999999, 2020-06-12T02:38:18.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:38:18.327 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.327 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.327 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.328 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.328 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:38:18.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.328 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:18.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:18.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:38:18.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:38:18.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:38:18.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:38:18.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:18.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:38:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:38:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:38:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:38:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:38:18.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:38:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:38:18.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:38:18.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:38:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:38:18.345 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.346 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:38:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.17680210899999, 2020-06-12T02:38:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:38:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.347 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:38:18.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.349 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:18.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:38:18.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:38:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:38:18.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:38:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:38:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:38:18.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:38:18.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:38:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:38:18.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:38:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:38:18.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:38:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:38:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.360 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:18.361 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.17567006499999, 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:38:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.363 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:18.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:38:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:38:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:38:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:38:18.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:38:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:38:18.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:38:18.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:38:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:38:18.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:38:18.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:38:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:38:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:38:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:38:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:38:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.377 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:18.378 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.17541488000001, 2020-06-12T02:38:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:38:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.379 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:38:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.380 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:38:18.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:38:18.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:38:18.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:38:18.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:38:18.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:38:18.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:38:18.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:38:18.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:38:18.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:38:18.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:38:18.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:38:18.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:38:18.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:38:18.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:38:18.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:38:18.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:38:18.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:38:18.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:38:18.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:38:18.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:38:18.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.395 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.395 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:18.396 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:18.396 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.175255693, 2020-06-12T02:38:18.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:38:18.396 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.396 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.397 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:38:18.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.398 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:18.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:18.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:38:18.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:38:18.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:38:18.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:38:18.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:38:18.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:38:18.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:38:18.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:38:18.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:38:18.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:18.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:38:18.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:38:18.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:38:18.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:38:18.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:38:18.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:38:18.408 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.408 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.409 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:38:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.03093311500001, 2020-06-12T02:38:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:38:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.410 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.411 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:38:18.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.412 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:18.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:18.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:38:18.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:38:18.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:38:18.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:38:18.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:38:18.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.417 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:38:18.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:38:18.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:38:18.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:38:18.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:38:18.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:38:18.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:38:18.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:38:18.422 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.422 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.422 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.423 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:18.423 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:18.424 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.289863618, 2020-06-12T02:38:18.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:38:18.424 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.424 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.424 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:18.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.426 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.427 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.427 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:18.427 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:38:18.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.428 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.428 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.429 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:38:18.429 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:38:18.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:38:18.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:38:18.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:38:18.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:38:18.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:38:18.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:38:18.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:18.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:38:18.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:38:18.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:38:18.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:38:18.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:38:18.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:38:18.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:38:18.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:38:18.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:38:18.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:38:18.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.440 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.440 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.440 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:18.441 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:18.441 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.352161217, 2020-06-12T02:38:18.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:38:18.441 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.441 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.442 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.443 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:18.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.443 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:38:18.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:38:18.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:38:18.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:38:18.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:38:18.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:38:18.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:38:18.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:18.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:38:18.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:38:18.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:38:18.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:38:18.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:38:18.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:38:18.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:38:18.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:38:18.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:38:18.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:38:18.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.460 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.461 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:18.461 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:18.461 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.370285137, 2020-06-12T02:38:18.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:38:18.462 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.462 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.462 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.462 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:18.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:38:18.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:38:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:38:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:38:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:38:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:38:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:38:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:38:18.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:38:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:38:18.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:38:18.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:38:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:38:18.473 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.474 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.37009182099999, 2020-06-12T02:38:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:38:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:38:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:38:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:38:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:38:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:38:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:38:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:38:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:38:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:38:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:38:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:38:18.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:38:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.369943366, 2020-06-12T02:38:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:38:18.488 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.489 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:18.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:18.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:38:18.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:38:18.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:38:18.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:38:18.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:38:18.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.495 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:38:18.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:38:18.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:18.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:38:18.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:38:18.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:38:18.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:38:18.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:38:18.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:38:18.500 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.500 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:18.501 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.36251041599999, 2020-06-12T02:38:18.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:38:18.502 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.502 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:18.502 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:18.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:18.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:18.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:38:18.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:38:18.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:18.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:38:18.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:38:18.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:38:18.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:38:18.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.511 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:18.511 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:18.511 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.36010191599999, 2020-06-12T02:38:18.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:38:18.512 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.512 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:18.512 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:18.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:38:18.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:38:18.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:38:18.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:38:18.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:38:18.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:38:18.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:38:18.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:38:18.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:38:18.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:38:18.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:38:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.522 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.522 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.522 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:18.523 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:18.523 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.35807477099999, 2020-06-12T02:38:18.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:38:18.523 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.523 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:18.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:38:18.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:38:18.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:38:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:38:18.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:38:18.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:38:18.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:38:18.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:38:18.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:38:18.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:38:18.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:38:18.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:38:18.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:38:18.533 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.533 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.534 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:38:18.534 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.347024938, 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:18.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:18.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:38:18.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:38:18.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:38:18.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:38:18.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:38:18.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:38:18.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:38:18.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:38:18.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:38:18.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:38:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:38:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.34281192100001, 2020-06-12T02:38:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:38:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:38:18.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:38:18.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:38:18.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:38:18.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:38:18.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:38:18.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:38:18.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:38:18.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:38:18.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:38:18.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:38:18.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:38:18.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:38:18.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:38:18.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:38:18.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.559 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.559 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.342628722, 2020-06-12T02:38:18.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:38:18.561 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.561 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.561 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.561 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.561 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.562 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:38:18.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.562 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:18.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:38:18.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:38:18.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:38:18.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:38:18.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:38:18.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:38:18.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:38:18.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:38:18.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:38:18.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:38:18.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:38:18.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:18.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:38:18.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:38:18.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.573 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:38:18.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:38:18.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:38:18.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:38:18.574 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.574 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:18.575 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 122.885710678, 2020-06-12T02:38:18.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:38:18.576 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.576 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:18.576 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:18.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:38:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:38:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:38:18.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:38:18.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:38:18.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:38:18.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:38:18.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:38:18.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:38:18.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.586 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:38:18.587 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:18.587 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.355249081, 2020-06-12T02:38:18.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:38:18.587 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.587 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.588 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:18.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:18.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:38:18.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:38:18.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:38:18.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:38:18.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:38:18.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:38:18.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:38:18.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:18.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:38:18.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:38:18.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:18.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:38:18.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:38:18.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:18.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:38:18.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:38:18.600 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.600 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.600 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.601 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:38:18.601 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:18.601 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 108.354989962, 2020-06-12T02:38:18.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:38:18.601 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:38:18.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:18.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:18.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:18.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:38:18.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:18.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:38:18.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:38:18.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:18.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:38:18.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:38:18.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:18.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:38:18.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:38:18.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:38:18.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:38:18.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:38:18.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:38:18.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:18.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:38:18.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:38:18.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:38:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:38:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.616 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:18.616 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:18.616 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:18.618 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:18.618 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:18.613+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:18.730 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:18.717+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:18.778 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:18.778 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:18.787 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:18.824 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:18.822+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:18.925 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:18.921+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:18.937 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:18.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:18.938 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:18.938 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:18.939 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:18.953 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:19.026 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:19.022+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:19.108 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:19.108 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:19.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:19.109 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:19.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.109 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:19.109 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.95757024299999, 2020-06-12T02:38:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:38:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.111 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:19.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:19.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:38:19.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:38:19.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:38:19.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:38:19.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:38:19.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:38:19.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:38:19.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:38:19.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:38:19.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:38:19.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:38:19.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:38:19.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:38:19.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:38:19.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:38:19.125 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.126 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.126 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.126 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:38:19.127 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:19.127 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.811056732, 2020-06-12T02:38:19.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:38:19.127 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.127 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.128 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:19.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:38:19.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:38:19.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:38:19.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:38:19.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:38:19.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:38:19.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:38:19.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:38:19.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:38:19.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:38:19.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:38:19.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:38:19.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:38:19.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.137 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.138 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.138 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:19.138 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:19.139 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.13350805799999, 2020-06-12T02:38:19.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:38:19.139 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.139 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.140 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.140 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.140 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:38:19.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:19.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:19.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:38:19.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:38:19.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:38:19.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:38:19.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:38:19.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:38:19.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:38:19.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:38:19.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:38:19.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:38:19.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:38:19.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:38:19.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:38:19.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:38:19.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:38:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:38:19.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:38:19.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:38:19.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:38:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:38:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:38:19.155 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.156 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.156 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.157 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:19.158 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:19.158 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 135.13274412999999, 2020-06-12T02:38:19.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:38:19.158 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.159 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.159 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.159 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.159 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.159 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:19.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:38:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:38:19.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:38:19.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:38:19.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:38:19.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:38:19.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:38:19.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:38:19.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:38:19.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:38:19.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:38:19.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:19.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:38:19.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:38:19.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:38:19.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:38:19.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:19.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:38:19.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:38:19.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:38:19.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:38:19.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:38:19.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:38:19.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:38:19.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:38:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.90993907500001, 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.179 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.180 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.180 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:38:19.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.181 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:19.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:19.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:38:19.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:38:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:38:19.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:38:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:38:19.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:38:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:38:19.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:38:19.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:38:19.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:38:19.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:38:19.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:38:19.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:38:19.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:38:19.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:38:19.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:38:19.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:38:19.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:38:19.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:38:19.195 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.195 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.195 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.196 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:19.197 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:19.197 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.90165278800001, 2020-06-12T02:38:19.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:38:19.197 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.197 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.198 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.199 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:38:19.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.199 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:19.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:19.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:38:19.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:38:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:38:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:38:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:38:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:38:19.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:38:19.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:38:19.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:38:19.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:38:19.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:38:19.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:38:19.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:38:19.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:38:19.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:38:19.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:38:19.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:38:19.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:38:19.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:38:19.213 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.214 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.214 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.214 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:19.215 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:19.215 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.89462354400001, 2020-06-12T02:38:19.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:38:19.215 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.215 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.216 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:19.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:19.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:38:19.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:38:19.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:38:19.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:38:19.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:38:19.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:38:19.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:38:19.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:38:19.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:38:19.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:38:19.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:38:19.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:38:19.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:38:19.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:38:19.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:38:19.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:38:19.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:38:19.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.228 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.229 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.229 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:19.230 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:19.230 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.89448609300001, 2020-06-12T02:38:19.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:38:19.230 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.230 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:38:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.232 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:19.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:19.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:38:19.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:38:19.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:38:19.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:38:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:38:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:38:19.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:38:19.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:38:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:38:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:38:19.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:38:19.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:19.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:38:19.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:38:19.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:38:19.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:38:19.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:38:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:38:19.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:38:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:38:19.244 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.245 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.093698354, 2020-06-12T02:38:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:38:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:38:19.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:19.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:38:19.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:38:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:38:19.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:38:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:38:19.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:38:19.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:38:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:38:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:38:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:38:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:38:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:38:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:38:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:38:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:38:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:38:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:38:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:38:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.263 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:19.263 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:19.263 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 130.09355174000001, 2020-06-12T02:38:19.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:38:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.264 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:38:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:38:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:38:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:38:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:38:19.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:38:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:38:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:38:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:38:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:38:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:19.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:38:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:38:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:38:19.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:38:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:38:19.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:38:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:38:19.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:38:19.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:38:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:38:19.284 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.285 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.137538866, 2020-06-12T02:38:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:38:19.286 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.287 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:38:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:19.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:38:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:38:19.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:38:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:38:19.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:38:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:38:19.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:38:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:38:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:38:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:38:19.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:38:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:38:19.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:38:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:38:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:38:19.299 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.300 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.131807353, 2020-06-12T02:38:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:38:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.301 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:38:19.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:19.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:38:19.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:38:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:38:19.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:38:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:38:19.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:38:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:38:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:38:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:38:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:38:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:38:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:38:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:38:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:38:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:38:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:38:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:38:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.314 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.13131383699999, 2020-06-12T02:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:38:19.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:38:19.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:38:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:38:19.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:38:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:38:19.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:38:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:38:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:38:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:38:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:38:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:38:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:38:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:38:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:38:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:38:19.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:38:19.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:38:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:38:19.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:38:19.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.332 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.13121983000001, 2020-06-12T02:38:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:38:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.333 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:38:19.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:38:19.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:38:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:38:19.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:38:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:38:19.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:38:19.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:38:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:38:19.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:38:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:38:19.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:38:19.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:38:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:38:19.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:38:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:38:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.093058801, 2020-06-12T02:38:19.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:38:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:38:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:38:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:38:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:38:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:38:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:38:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:38:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:38:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:38:19.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:38:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:38:19.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:38:19.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:38:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.052261808, 2020-06-12T02:38:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:38:19.359 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:38:19.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:19.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:19.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:38:19.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:38:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:38:19.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:38:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:38:19.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:38:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:38:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:38:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:38:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:19.370 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.052019742, 2020-06-12T02:38:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:38:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.371 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:38:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:38:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:38:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:38:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:38:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:38:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:38:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:38:19.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:38:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:38:19.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:38:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.051810051, 2020-06-12T02:38:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:38:19.382 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.383 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:38:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:38:19.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:38:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:38:19.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:38:19.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:38:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:38:19.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:38:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:38:19.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.392 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:38:19.393 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 118.03627589, 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.394 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:38:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:38:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:38:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:38:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:38:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:38:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:38:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:38:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:38:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:38:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:38:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:38:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:38:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:38:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.404 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:38:19.405 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 109.138215856, 2020-06-12T02:38:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:38:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.406 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:38:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.407 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:38:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:38:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:38:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.411 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:38:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:38:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:38:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:38:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:38:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:38:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:38:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:38:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.416 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.417 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.417 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:19.418 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:38:19.419 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:19.417+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:19.420 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:19.519 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:19.518+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:19.538 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:19.526+0000 7f8f0c6b9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:19.542 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:19.538+0000 7f8f0b457700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:19.576 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:19.577 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:19.577 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:19.577 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:19.586 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:19.620 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:19.618+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:19.689 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:19.690 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:19.690 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:19.690 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:19.690 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:19.696 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:19.745 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:19.741+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:19.810 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:19.810 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:19.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:19.811 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:19.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.811 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:19.811 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:19.811 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.68407426799999, 2020-06-12T02:38:19.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:19.812 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.813 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.813 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.813 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.814 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:19.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.814 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:19.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:19.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:19.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:19.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:19.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:19.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:19.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:19.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:19.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:19.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:19.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:19.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:19.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:19.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:19.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:19.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:19.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:19.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:19.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:19.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:19.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:19.838 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.838 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.838 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.839 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:19.839 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:19.839 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.683935332, 2020-06-12T02:38:19.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:19.840 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.840 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.840 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.841 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.841 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:19.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:19.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:19.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:19.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:19.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:19.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:19.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:19.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:19.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:19.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:19.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:19.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:19.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:19.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:19.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:19.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:19.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:19.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:19.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:19.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:19.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.856 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:19.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:19.856 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.683799494, 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.857 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.858 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:19.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:19.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:19.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:19.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:19.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:19.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:19.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:19.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:19.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:19.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:19.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:19.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:19.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:19.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:19.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:19.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:19.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:19.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:19.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.878 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.879 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:19.879 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:19.879 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 168.66013464599999, 2020-06-12T02:38:19.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:19.879 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:19.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:19.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:19.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:19.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:19.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:19.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:19.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:19.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:19.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:19.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:19.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.895 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:19.895 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:19.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 160.61269073599999, 2020-06-12T02:38:19.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:19.896 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.896 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:19.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:19.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:19.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:19.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:19.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:19.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:19.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:19.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:19.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:19.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:19.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:19.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:19.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:19.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:19.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:19.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:19.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:19.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:19.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.912 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:19.912 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:19.912 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 154.86895369300001, 2020-06-12T02:38:19.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:19.913 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.913 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.913 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:19.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:19.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:19.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:19.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:19.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.922 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 154.86798032300001, 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:19.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:19.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:19.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:19.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:19.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:19.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:19.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:19.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:19.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:19.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:19.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:19.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.934 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.935 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.935 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:19.935 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 154.86677120300001, 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:19.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:19.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:19.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:19.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:19.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:19.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:19.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:19.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:19.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:19.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:19.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 154.865508218, 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.947 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:19.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:19.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:19.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:19.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:19.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:19.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:19.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 133.854050091, 2020-06-12T02:38:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.960 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:19.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:19.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:19.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:19.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:19.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:19.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:19.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:19.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:19.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:19.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:19.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:19.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:19.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:19.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:19.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:19.972 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.973 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.973 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.974 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:19.974 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:19.975 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 133.85104905099999, 2020-06-12T02:38:19.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:19.975 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.975 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:19.976 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:19.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:19.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:19.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:19.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:19.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:19.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:19.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:19.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:19.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:19.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:19.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:19.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:19.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:19.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:19.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:19.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.989 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:19.989 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:19.989 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.828223052, 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:19.990 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:19.991 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:19.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.991 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:19.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:19.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:19.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:19.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:19.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:19.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:19.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:19.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:19.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:19.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:19.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:19.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:19.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:19.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:20.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:20.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.001 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.002 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.002 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:20.002 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.82807766000001, 2020-06-12T02:38:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:20.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:20.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:20.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:20.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:20.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:20.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:20.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:20.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:20.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:20.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:20.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:20.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.795936381, 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.018 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.019 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:20.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:20.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:20.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:20.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:20.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:20.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.79080974599999, 2020-06-12T02:38:20.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.033 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:20.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:20.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:20.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:20.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:20.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:20.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:20.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:20.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:20.045 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.045 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.046 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.046 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:20.046 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.790430736, 2020-06-12T02:38:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.047 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:20.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:20.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:20.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:20.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:20.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:20.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:20.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:20.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.061 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.79021328100001, 2020-06-12T02:38:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.062 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:20.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:20.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:20.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:20.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.074 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.426271036, 2020-06-12T02:38:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.076 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:20.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:20.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:20.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.837218249, 2020-06-12T02:38:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:20.087 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:20.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:20.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:20.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.102 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.83418467600001, 2020-06-12T02:38:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.103 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:20.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:20.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:20.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.117 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.118 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.118 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:20.120 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:20.121 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:20.117+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:20.236 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:20.234+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:20.256 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:38:20.260 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:20.278 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:20.278 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:20.279 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:20.288 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:20.338 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:20.334+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:20.358+0000 7ff66247c700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:20.374 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:20.366+0000 7ff66121a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:20.389 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:20.389 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:20.390 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:20.390 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:20.401 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:20.402 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:20.422 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:20.438 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:20.434+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:20.448 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:20.473 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:20.509 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:20.521 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:20.521 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:20.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:20.521 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:20.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.522 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:38:20.522 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:20.522 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.26811734099999, 2020-06-12T02:38:20.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:38:20.523 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.523 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.523 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.523 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.523 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.524 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:38:20.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.524 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:20.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:20.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:38:20.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:38:20.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:38:20.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:38:20.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:38:20.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:38:20.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:38:20.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:38:20.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:38:20.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:38:20.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:38:20.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:38:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:38:20.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:38:20.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:38:20.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:38:20.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:38:20.541 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.541 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.541 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.542 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:38:20.542 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:20.542 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.266700289, 2020-06-12T02:38:20.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:38:20.542 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.543 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.543 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:38:20.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.544 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:20.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:38:20.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:38:20.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:38:20.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:38:20.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:38:20.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:38:20.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:38:20.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:38:20.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:38:20.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:38:20.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:38:20.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:38:20.553 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.553 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.554 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.55613630100001, 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.555 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.556 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.556 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:38:20.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.556 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:20.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:20.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:38:20.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:38:20.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:38:20.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:38:20.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:38:20.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:38:20.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:38:20.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:38:20.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:38:20.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.565 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:38:20.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:38:20.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.566 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:38:20.566 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:38:20.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:38:20.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:38:20.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:38:20.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:38:20.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:38:20.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:38:20.570 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.570 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.571 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:20.572 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.548454999, 2020-06-12T02:38:20.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:38:20.573 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.574 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.574 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.574 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:20.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:38:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:38:20.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:38:20.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.578 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.578 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:38:20.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:38:20.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:38:20.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:38:20.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:38:20.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:38:20.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:38:20.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:38:20.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:38:20.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:38:20.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:38:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:38:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:38:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:38:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:38:20.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:38:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.539399702, 2020-06-12T02:38:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:38:20.590 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:38:20.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:20.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:20.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:38:20.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:38:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:38:20.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:38:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:38:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:38:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:38:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:38:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:38:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:38:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:38:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:38:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:38:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:38:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:38:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:38:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:38:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:20.606 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.538460163, 2020-06-12T02:38:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:38:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:38:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:38:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:38:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:38:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:38:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:38:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:38:20.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:38:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:38:20.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:38:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:38:20.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:38:20.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:38:20.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:38:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:38:20.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:38:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:38:20.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:38:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.538328216, 2020-06-12T02:38:20.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:38:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.624 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:38:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.625 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:38:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:38:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:38:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:38:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:38:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:38:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:38:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:38:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:38:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:38:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:38:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:38:20.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:38:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:38:20.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:38:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.530655919, 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.639 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:38:20.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:20.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:38:20.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:38:20.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:38:20.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:38:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:38:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:38:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:38:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:38:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:38:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:38:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:38:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:38:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:38:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.52468095399999, 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:38:20.653 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.654 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:38:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:20.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:38:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:38:20.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:20.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:38:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:38:20.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:38:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:38:20.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:38:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:38:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:38:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:38:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:38:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:38:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:38:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:38:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.51784939199999, 2020-06-12T02:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:38:20.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:38:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:38:20.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:38:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:38:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:38:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:38:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:38:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:38:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:38:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:38:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:38:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:38:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:38:20.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:38:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.51716644300001, 2020-06-12T02:38:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:38:20.685 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:38:20.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:20.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:38:20.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:38:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:38:20.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:38:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:38:20.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:38:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:38:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:38:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:38:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:38:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:38:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:38:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:38:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:38:20.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:38:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:38:20.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.700 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 134.51707968100001, 2020-06-12T02:38:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:38:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.701 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:38:20.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:38:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:38:20.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:38:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:38:20.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:38:20.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:38:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:38:20.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:38:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:38:20.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:38:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:38:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:38:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:38:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:38:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:38:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.719 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.138686075, 2020-06-12T02:38:20.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:38:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:38:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:38:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:38:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:38:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:38:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:38:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:38:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:38:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:38:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:38:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:38:20.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:38:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:38:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 125.11626413800001, 2020-06-12T02:38:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:38:20.732 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:38:20.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:20.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:38:20.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:38:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:38:20.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:38:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:38:20.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:38:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:38:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:38:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:38:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:38:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:38:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:38:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:38:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 121.27028944200001, 2020-06-12T02:38:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:38:20.746 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:38:20.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:20.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:38:20.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:38:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:38:20.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:38:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:38:20.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:38:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:38:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:38:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:38:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:38:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:38:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:38:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:38:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:38:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:38:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:38:20.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:38:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 121.26947227799999, 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.762 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:38:20.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:38:20.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:38:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:38:20.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:38:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:38:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:38:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:38:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:38:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:38:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:38:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:38:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:38:20.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.777 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 121.269235638, 2020-06-12T02:38:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:38:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.778 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.779 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:38:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:38:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:38:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:38:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:38:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:38:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:38:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:38:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:38:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:38:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:38:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:38:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:38:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:38:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:38:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:38:20.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:38:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:38:20.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.54374270700001, 2020-06-12T02:38:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:38:20.796 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.797 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:38:20.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.799 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:38:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:38:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:38:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:38:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:38:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:38:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:38:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:38:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:38:20.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:38:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:38:20.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:38:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:38:20.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:38:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:38:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:38:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.811 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.812 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 120.543461894, 2020-06-12T02:38:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:38:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.813 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:38:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:38:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:38:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:38:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:38:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:38:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:38:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:38:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:38:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:38:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:38:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:38:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:38:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:38:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:38:20.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:38:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:38:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:38:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:38:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:38:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.827 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:38:20.828 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 119.464690659, 2020-06-12T02:38:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:38:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:20.829 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:38:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.830 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:20.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:38:20.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:38:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:38:20.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:20.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:38:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:38:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:20.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:38:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:38:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:20.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:38:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:38:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:38:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:38:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:20.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:38:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:38:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:20.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:38:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:38:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:20.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:38:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:38:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:20.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:38:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:38:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:20.843 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:20.843 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:20.845 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:20.845 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:20.846 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.846 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.846 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:20.846 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:20.846 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.847 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.847 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.847 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.847 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:20.848 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:20.848 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:20.848 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:20.842+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:20.849 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:20.946 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:20.945+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:21.012 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.013 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.022 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:21.048 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:21.045+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:21.137 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.138 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.147 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:21.149 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:21.145+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:21.251 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:21.245+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:21.259 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.259 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.268 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:21.351 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:21.350+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:21.376 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.376 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.384 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:21.472 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:21.470+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:21.539 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.539 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.548 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:21.555 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:21.549+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:21.656 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:21.654+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.710 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:21.758 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:21.753+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:21.859 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:21.853+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:21.866 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.867 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.875 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:21.962 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:21.958+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:21.984 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:21.985 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:21.994 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:22.087 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:22.086+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:22.149 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.149 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.158 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:22.204 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:22.201+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:22.271 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:38:22.276 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.276 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.277 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:22.273+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:22.285 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:22.377 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:22.374+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:22.386 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:22.374+0000 7f4f4e8d3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:22.390 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:22.386+0000 7f4f4d671700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:22.442 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.443 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.452 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:22.504 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:22.501+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:22.567 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.567 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.568 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:22.608 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:22.605+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:22.681 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:22.677+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:22.715 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.716 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.725 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:22.812 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:22.809+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:22.849 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:22.875 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:22.875 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:22.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:22.881+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:22.887 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:22.969 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:22.958+0000 7fcbfa107700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:22.970 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:22.966+0000 7fcbf8ea5700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:22.987 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:22.981+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:23.000 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:23.020 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:23.043 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:23.044 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:23.044 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:23.054 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:23.069 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:23.101 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:23.108 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:23.093+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:23.123 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:23.146 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:23.147 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.147 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.147 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:23.147 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:23.148 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.148 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.148 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.148 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.148 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:23.154 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:23.155 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:23.188 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:23.185+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:23.211 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:23.211 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:23.211 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:23.212 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:23.220 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:23.256 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:38:23.289 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:23.286+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:23.371 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:23.371 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:23.371 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:23.371 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:23.372 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:23.381 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:23.396 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:23.386+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:23.498 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:23.507 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:23.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:23.508 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:23.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.508 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:23.508 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:23.509 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.36654788499999, 2020-06-12T02:38:23.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:23.509 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.510 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.510 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:23.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:23.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:23.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:23.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:23.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:23.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:23.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:23.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:23.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:23.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:23.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:23.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:23.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:23.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:23.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:23.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:23.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:23.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:23.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:23.530 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.530 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.531 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.532 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:23.532 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:23.532 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.366408949, 2020-06-12T02:38:23.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:23.533 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.533 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.534 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.535 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:23.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.535 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:23.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:23.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:23.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:23.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:23.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:23.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:23.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:23.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:23.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:23.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:23.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:23.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:23.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:23.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:23.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:23.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:23.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:23.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.553 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:23.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:23.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:23.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:23.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.557 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.557 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:23.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:23.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.558 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.558 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.558 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:23.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:23.560 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.560 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.560 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.561 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:23.561 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:23.561 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.366273111, 2020-06-12T02:38:23.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:23.562 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.562 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.563 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.563 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:23.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.566 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:23.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:23.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:23.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:23.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:23.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:23.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:23.571 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:23.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:23.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:23.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:23.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:23.575 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:23.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:23.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.575 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:23.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:23.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:23.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:23.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:23.580 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:23.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.581 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:23.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:23.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.582 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:23.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:23.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:23.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.584 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:23.585 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:23.585 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.34260826299999, 2020-06-12T02:38:23.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:23.585 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.585 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.586 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:23.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:23.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:23.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:23.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:23.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:23.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:23.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:23.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:23.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:23.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:23.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:23.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:23.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:23.595 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.595 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.595 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 164.29516435299999, 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.598 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:23.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.598 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:23.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:23.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:23.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:23.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:23.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:23.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:23.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:23.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:23.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:23.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:23.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:23.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:23.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:23.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:23.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:23.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:23.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:23.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:23.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.612 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.612 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.55142731000001, 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:23.613 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.614 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.614 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:23.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:23.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:23.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:23.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:23.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:23.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:23.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:23.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:23.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:23.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:23.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.623 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.624 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:23.624 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:23.624 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.55045394000001, 2020-06-12T02:38:23.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:23.625 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.625 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.625 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:23.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:23.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:23.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:23.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:23.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:23.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:23.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:23.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:23.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:23.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:23.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:23.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:23.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:23.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:23.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:23.637 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.637 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.638 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.638 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:23.638 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.54924482000001, 2020-06-12T02:38:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.640 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:23.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:23.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:23.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:23.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:23.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:23.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:23.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:23.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:23.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:23.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:23.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:23.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:23.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:23.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:23.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:23.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:23.650 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.651 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.651 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.653 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:23.654 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:23.654 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.547981835, 2020-06-12T02:38:23.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:23.654 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.654 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.655 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:23.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:23.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:23.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:23.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:23.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:23.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:23.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:23.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:23.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:23.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:23.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.667 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.668 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:23.668 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:23.668 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 137.536523708, 2020-06-12T02:38:23.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:23.669 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.669 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.669 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:23.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:23.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:23.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:23.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:23.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:23.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:23.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:23.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:23.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:23.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:23.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:23.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:23.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:23.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:23.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.679 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.680 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:23.680 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:23.680 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 137.53352266799999, 2020-06-12T02:38:23.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:23.681 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.681 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.681 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:23.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:23.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:23.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:23.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:23.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:23.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:23.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:23.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:23.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:23.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:23.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:23.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:23.690 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.691 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:23.692 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:23.692 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.510696669, 2020-06-12T02:38:23.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:23.692 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.692 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:23.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.693 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.693 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:23.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.694 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:23.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:23.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:23.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:23.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:23.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:23.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:23.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:23.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:23.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:23.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:23.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:23.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:23.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:23.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:23.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.705 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.706 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.706 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:23.706 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.51055127699999, 2020-06-12T02:38:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.708 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:23.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.708 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:23.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:23.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:23.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:23.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:23.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:23.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:23.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:23.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:23.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:23.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:23.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:23.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:23.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:23.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:23.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:23.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:23.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:23.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:23.720 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.720 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.720 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.721 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:23.721 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:23.721 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.47840999799999, 2020-06-12T02:38:23.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.722 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:23.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.723 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:23.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:23.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:23.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:23.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:23.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:23.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:23.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:23.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:23.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:23.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:23.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:23.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:23.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:23.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:23.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:23.734 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:23.736 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.47328336300001, 2020-06-12T02:38:23.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:23.736 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.736 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.736 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.737 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:23.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.737 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:23.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:23.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:23.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:23.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:23.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:23.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:23.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:23.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:23.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:23.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:23.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:23.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:23.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:23.749 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.749 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.749 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.750 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:23.750 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:23.750 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.47290435299999, 2020-06-12T02:38:23.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:23.751 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.751 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:23.751 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.751 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.751 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.752 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:23.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.752 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:23.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:23.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:23.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:23.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:23.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:23.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:23.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:23.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:23.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:23.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:23.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:23.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:23.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:23.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:23.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:23.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:23.763 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:23.765 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:23.765 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.47268689800001, 2020-06-12T02:38:23.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:23.765 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.765 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:23.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:23.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:23.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:23.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:23.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:23.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:23.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:23.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:23.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:23.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:23.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:23.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:23.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:23.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:23.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:23.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:23.778 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.778 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.778 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.779 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:23.779 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:23.780 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.108744653, 2020-06-12T02:38:23.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:23.780 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.781 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:23.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:23.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:23.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:23.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:23.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:23.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:23.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:23.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:23.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:23.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:23.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:23.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:23.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:23.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.796 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.797 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:23.797 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:23.797 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.519691866, 2020-06-12T02:38:23.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:23.798 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.798 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:23.798 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:23.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:23.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:23.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:23.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:23.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:23.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:23.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:23.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:23.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:23.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:23.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:23.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:23.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:23.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:23.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:23.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.809 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.809 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.810 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:23.810 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:23.810 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.51665829300001, 2020-06-12T02:38:23.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:23.810 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:23.811 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:23.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:23.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:23.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:23.811 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:23.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:23.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:23.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:23.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:23.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:23.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:23.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:23.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:23.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:23.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:23.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:23.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:23.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:23.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:23.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:23.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:23.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:23.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:23.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:23.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:23.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:23.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:23.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:23.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:23.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:23.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:23.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:23.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:23.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.825 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.826 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:23.826 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:23.826 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:23.827 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:23.494+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:23.828 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:23.829 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:23.825+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:23.929 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:23.926+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:23.944 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:23.944 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:23.945 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:23.945 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:23.954 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:24.030 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:24.026+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:24.064 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:24.064 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:24.065 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:24.065 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:24.065 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:24.081 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:24.131 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:24.130+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:24.193 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:24.193 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:24.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:24.194 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:24.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.194 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:38:24.194 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:24.194 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 159.94043909199999, 2020-06-12T02:38:24.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:38:24.195 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.195 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.196 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.196 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.196 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.197 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:38:24.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.197 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:24.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:38:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:38:24.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:38:24.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:38:24.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:38:24.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:38:24.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:38:24.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:38:24.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:38:24.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:38:24.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:38:24.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:38:24.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:38:24.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:38:24.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:38:24.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:38:24.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:38:24.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.215 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.216 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.217 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:38:24.217 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:24.217 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 159.93902204, 2020-06-12T02:38:24.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:38:24.217 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.218 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.218 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.218 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.218 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.218 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:38:24.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.219 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:24.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:38:24.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:38:24.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:38:24.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:38:24.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:38:24.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:38:24.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:38:24.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:38:24.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:38:24.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:38:24.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:38:24.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:38:24.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:38:24.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:38:24.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:38:24.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.229 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.229 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.229 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.230 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:24.230 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.22845805200001, 2020-06-12T02:38:24.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:38:24.230 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.230 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.231 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.232 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:38:24.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.233 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:24.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:24.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:38:24.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:38:24.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:38:24.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:38:24.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:38:24.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:38:24.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:38:24.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:38:24.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:38:24.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:38:24.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:38:24.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:38:24.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:38:24.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:38:24.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:38:24.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:38:24.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:38:24.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:38:24.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:38:24.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:38:24.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:38:24.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.257 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.258 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.258 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:24.258 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.22077675, 2020-06-12T02:38:24.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:38:24.258 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.259 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.259 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:38:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:24.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:24.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:38:24.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:38:24.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:38:24.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:38:24.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:38:24.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:38:24.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:38:24.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:38:24.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:38:24.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:38:24.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:38:24.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:38:24.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:38:24.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:38:24.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:38:24.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:38:24.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:38:24.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:38:24.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:38:24.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:38:24.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:38:24.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:38:24.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:38:24.276 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.277 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.277 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.278 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.278 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:24.278 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.211721453, 2020-06-12T02:38:24.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:38:24.279 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.279 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.279 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:24.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:24.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:38:24.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:38:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:38:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:38:24.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:38:24.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:38:24.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:38:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:38:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:38:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:38:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:38:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:38:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:38:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:38:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:38:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:38:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:38:24.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:38:24.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:38:24.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:38:24.295 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.295 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.295 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.296 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.297 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:24.297 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.21078191399999, 2020-06-12T02:38:24.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:38:24.297 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.297 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.298 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.298 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:38:24.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:24.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:38:24.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:38:24.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:38:24.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:38:24.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:38:24.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:38:24.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:38:24.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:38:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:38:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:38:24.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:38:24.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:38:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:38:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:38:24.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:38:24.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:38:24.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:38:24.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:38:24.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:38:24.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:38:24.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:38:24.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:38:24.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:38:24.314 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.314 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.314 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.315 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:24.315 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:24.315 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.21064996699999, 2020-06-12T02:38:24.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:38:24.316 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.316 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.316 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.316 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:24.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:24.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:38:24.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:38:24.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:38:24.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:38:24.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:38:24.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:38:24.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:38:24.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:38:24.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:38:24.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:38:24.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:38:24.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:38:24.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:38:24.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:38:24.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:38:24.329 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.330 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.330 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.330 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.20297767, 2020-06-12T02:38:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:38:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.332 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:24.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:24.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:38:24.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:38:24.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:38:24.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:38:24.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:38:24.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:38:24.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:38:24.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:38:24.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:38:24.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:38:24.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:38:24.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:38:24.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:38:24.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:38:24.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:38:24.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:38:24.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:38:24.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.347 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.347 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:24.347 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.19700270499999, 2020-06-12T02:38:24.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:38:24.348 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.348 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.348 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.349 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:38:24.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.349 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:24.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:38:24.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:38:24.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:24.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:38:24.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:38:24.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:38:24.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:38:24.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.355 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:38:24.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:38:24.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:38:24.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:38:24.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:38:24.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:38:24.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:38:24.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:38:24.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:38:24.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:38:24.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:38:24.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:38:24.362 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:24.364 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.19017114299999, 2020-06-12T02:38:24.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:38:24.364 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.364 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.364 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.365 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.365 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:38:24.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.365 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:24.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:38:24.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:38:24.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:38:24.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:38:24.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:38:24.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:38:24.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:38:24.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:38:24.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:38:24.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:38:24.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:38:24.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:38:24.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:38:24.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:38:24.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:38:24.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:38:24.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:38:24.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.379 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.379 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.379 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.18948819400001, 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.380 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.381 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.381 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:38:24.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.381 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.383 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:24.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:38:24.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:38:24.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:38:24.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:38:24.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:38:24.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.386 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:38:24.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:38:24.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:38:24.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:38:24.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:38:24.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:38:24.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:38:24.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:38:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.393 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:38:24.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:38:24.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.394 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.395 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.395 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 138.18940143200001, 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.396 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.397 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.397 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:38:24.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.397 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:24.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:38:24.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:38:24.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:38:24.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:38:24.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.402 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:38:24.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:38:24.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:38:24.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:38:24.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:38:24.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:38:24.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:38:24.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:38:24.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:38:24.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:38:24.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:38:24.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:38:24.415 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.415 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.415 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.416 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:24.416 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:24.416 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.81100782600001, 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.417 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.418 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:38:24.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.418 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:24.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:38:24.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:38:24.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:38:24.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:38:24.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:38:24.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:38:24.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:38:24.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:38:24.424 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:38:24.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.426 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:38:24.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:38:24.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:38:24.427 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:24.428 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.78858588899999, 2020-06-12T02:38:24.428 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:38:24.428 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.428 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.428 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.429 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.429 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.429 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:38:24.429 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.429 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.430 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:24.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:38:24.431 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.433 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:38:24.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:38:24.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.433 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.433 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.434 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:24.434 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:38:24.434 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.434 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:38:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:38:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:38:24.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:38:24.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:38:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:38:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:38:24.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:38:24.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:38:24.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:38:24.441 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.441 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.441 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.442 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:24.442 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:24.442 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.942611193, 2020-06-12T02:38:24.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.443 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:38:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.444 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:24.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.445 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.445 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.445 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:38:24.446 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:38:24.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:38:24.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:38:24.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:38:24.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:38:24.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:38:24.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:38:24.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:38:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:38:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:38:24.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:38:24.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:38:24.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:38:24.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:38:24.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:38:24.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:38:24.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:38:24.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:38:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:38:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.94179402899999, 2020-06-12T02:38:24.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:38:24.460 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.460 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.461 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:38:24.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.461 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:24.463 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:38:24.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:38:24.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:38:24.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:38:24.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:38:24.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:38:24.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:38:24.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:38:24.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:38:24.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:38:24.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:38:24.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.471 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:38:24.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:38:24.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:24.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:38:24.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:38:24.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.475 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:24.475 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:24.476 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.941557389, 2020-06-12T02:38:24.477 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:38:24.477 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.477 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.478 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.478 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:38:24.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:24.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:38:24.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:38:24.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:38:24.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:38:24.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:38:24.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:38:24.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:38:24.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:38:24.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:38:24.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:38:24.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:38:24.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:38:24.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:38:24.487 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.487 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.487 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:38:24.487 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:38:24.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:38:24.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:38:24.489 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.489 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.489 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:38:24.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:38:24.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:38:24.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:38:24.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.494 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:38:24.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:38:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.496 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:24.496 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:24.496 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.21606445800001, 2020-06-12T02:38:24.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:38:24.496 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.497 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.497 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.497 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:38:24.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.498 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:24.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:24.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:38:24.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:38:24.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:38:24.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:38:24.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:38:24.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:38:24.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:38:24.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:38:24.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:38:24.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:24.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:38:24.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:38:24.506 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:38:24.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:38:24.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:38:24.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:38:24.509 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.510 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.511 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.512 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:24.512 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:24.513 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 124.215783645, 2020-06-12T02:38:24.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:38:24.513 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.513 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.513 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.514 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.514 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.514 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:38:24.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.514 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:24.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:38:24.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:38:24.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:38:24.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:38:24.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:38:24.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:38:24.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:38:24.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:38:24.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:38:24.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:38:24.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:38:24.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:38:24.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:38:24.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:38:24.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:38:24.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:38:24.529 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.529 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.529 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.530 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:38:24.530 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:24.530 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 123.13701241, 2020-06-12T02:38:24.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:38:24.531 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:24.531 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:24.531 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:24.531 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:24.531 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.532 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:38:24.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.532 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:24.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:24.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:24.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:24.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:24.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:24.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:38:24.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:24.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:38:24.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:38:24.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:24.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:38:24.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:38:24.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:38:24.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:38:24.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:38:24.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:38:24.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:38:24.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:38:24.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:24.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:38:24.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:38:24.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.542 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:24.542 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:38:24.542 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:38:24.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:24.542 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:24.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:24.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:38:24.543 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:38:24.543 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.543 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:24.544 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:24.546 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:24.547 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:24.541+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:24.646 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:24.645+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:24.664 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:24.665 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:24.665 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:24.674 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:24.747 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:24.741+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:24.776 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:24.777 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:24.778 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:24.786 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:24.848 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:24.846+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:24.900 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:24.900 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:24.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:24.901 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:24.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.901 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:24.902 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:24.902 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.7998671, 2020-06-12T02:38:24.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:24.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.902 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.903 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:24.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:24.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:24.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:24.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:24.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:24.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:24.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:24.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:24.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:24.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:24.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:24.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:24.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:24.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:24.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:24.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:24.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:24.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.917 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:24.917 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:24.917 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.79969673299999, 2020-06-12T02:38:24.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:24.918 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.918 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:24.918 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.919 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:24.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:24.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:24.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:24.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:24.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:24.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:24.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:24.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:24.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:24.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:24.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:24.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:24.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:24.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:24.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:24.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:24.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:24.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:24.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:24.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:24.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:24.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:24.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:24.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.932 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:24.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.933 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:24.933 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:24.934 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.781558706, 2020-06-12T02:38:24.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:24.934 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.935 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.935 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.935 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:24.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:24.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:24.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:24.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:24.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:24.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:24.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:24.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:24.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:24.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:24.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:24.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:24.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:24.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:24.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:24.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:24.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:24.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:24.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:24.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:24.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:24.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.77562182299999, 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.956 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.957 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:24.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.958 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:24.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:24.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:24.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:24.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:24.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:24.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:24.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:24.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:24.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:24.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:24.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:24.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:24.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:24.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:24.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:24.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:24.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:24.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.970 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:24.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:24.971 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.77511275200001, 2020-06-12T02:38:24.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:24.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.972 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:24.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:24.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:24.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:24.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:24.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:24.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:24.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:24.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:24.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:24.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:24.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:24.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:24.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:24.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:24.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:24.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.985 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:24.985 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:24.985 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 174.77495448600001, 2020-06-12T02:38:24.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:24.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:24.986 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:24.987 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:24.987 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:24.987 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:24.988 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:24.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.988 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:24.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:24.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:24.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:24.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:24.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:24.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:24.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:24.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:24.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:24.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:24.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:24.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:25.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:25.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:25.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:25.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:25.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:25.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:25.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:25.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:25.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:25.009 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.009 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.009 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 159.70055768399999, 2020-06-12T02:38:25.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:25.011 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.011 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.011 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.011 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.011 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.012 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:25.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.012 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:25.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:25.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:25.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:25.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:25.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:25.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:25.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:25.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:25.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:25.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:25.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:25.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:25.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:25.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:25.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:25.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.030 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.030 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.030 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 159.69354686200001, 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:25.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.032 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:25.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:25.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:25.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:25.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:25.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 144.93376031899999, 2020-06-12T02:38:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:25.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.045 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:25.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:25.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:25.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:25.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:25.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:25.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:25.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:25.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:25.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:25.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:25.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:25.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:25.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:25.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:25.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:25.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:25.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:25.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:25.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:25.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:25.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:25.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:25.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:25.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:25.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.066 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:25.066 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:25.066 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 144.93363272299999, 2020-06-12T02:38:25.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.067 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:25.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.068 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:25.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:25.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:25.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:25.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:25.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:25.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:25.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:25.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:25.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:25.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:25.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:25.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:25.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:25.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:25.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:25.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:25.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:25.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:25.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:25.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:25.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:25.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:25.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.51865208199999, 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.086 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:25.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:25.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:25.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:25.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:25.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:25.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:25.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:25.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:25.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:25.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:25.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:25.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:25.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:25.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.097 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:25.097 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:25.097 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.518507325, 2020-06-12T02:38:25.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:25.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:25.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:25.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:25.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:25.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:25.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:25.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:25.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:25.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:25.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:25.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:25.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:25.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:25.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.109 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:25.109 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:25.109 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.518376475, 2020-06-12T02:38:25.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:25.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:25.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.111 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:25.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:25.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:25.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:25.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:25.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:25.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:25.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:25.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:25.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:25.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:25.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:25.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.120 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:25.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:25.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.51823215300001, 2020-06-12T02:38:25.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:25.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:25.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:25.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:25.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:25.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:25.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:25.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:25.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:25.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:25.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:25.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:25.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:25.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:25.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:25.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:25.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:25.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:25.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.143 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:25.143 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:25.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.51812017200001, 2020-06-12T02:38:25.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:25.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:25.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.145 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:25.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:25.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:25.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:25.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:25.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:25.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:25.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:25.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:25.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:25.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:25.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:25.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:25.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.157 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:25.157 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:25.157 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.51796768700001, 2020-06-12T02:38:25.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.158 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:25.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:25.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:25.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:25.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:25.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:25.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:25.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:25.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:25.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:25.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:25.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:25.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:25.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:25.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:25.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:25.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:25.171 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.49722254900001, 2020-06-12T02:38:25.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:25.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.172 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.172 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.172 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.173 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.173 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:25.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.173 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:25.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:25.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:25.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:25.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:25.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:25.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:25.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:25.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:25.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:25.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:25.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:25.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:25.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:25.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.185 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:25.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.49689745500001, 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.187 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:25.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.187 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:25.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:25.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:25.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:25.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:25.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:25.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:25.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:25.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:25.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:25.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:25.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:25.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:25.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:25.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:25.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:25.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.201 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:25.201 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:25.201 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 125.381250972, 2020-06-12T02:38:25.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:25.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:25.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.203 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:25.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:25.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:25.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:25.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:25.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:25.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:25.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:25.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:25.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:25.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:25.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:25.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:25.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:25.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:25.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:25.214 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.214 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.214 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 125.380910714, 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:25.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:25.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:25.216 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:25.216 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:25.216 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:25.216 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:25.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.217 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:25.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:25.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:25.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:25.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:25.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:25.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:25.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:25.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:25.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:25.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:25.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:25.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:25.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:25.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:25.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:25.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:25.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:25.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:25.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:25.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:25.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:25.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:25.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:25.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:25.230 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:25.230 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:25.231 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:25.232 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:25.233 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:25.229+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:25.269 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:38:25.350 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:25.333+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:25.375 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:25.370+0000 7fb863cc1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:25.378 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:25.374+0000 7fb863cc1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:25.385 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:25.378+0000 7fe482767700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:25.388 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:25.386+0000 7fe481505700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:25.389 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:25.390 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:25.390 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:25.390 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:25.407 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:25.408 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:25.437 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:25.438 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:25.434+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:25.463 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:25.486 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:25.506 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:25.506 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:25.510 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:25.514 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:25.536 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:25.538 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:25.534+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:25.560 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:25.560 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.561 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:25.561 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:25.561 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.561 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.562 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.562 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.562 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:25.563 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:25.564 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:25.642 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:25.642 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:25.643 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:25.638+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:25.646 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:25.748 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:25.746+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:25.809 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:25.811 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:25.819 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:25.863 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:25.862+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:25.953 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:25.950+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:25.973 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:25.974 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:25.983 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:26.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:26.057+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:26.136 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.136 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.146 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:26.199 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:26.193+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:26.261 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.262 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.263 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:26.257+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:26.275 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:26.286 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:38:26.363 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:26.362+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:26.431 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.431 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.440 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:26.488 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:26.485+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:26.545 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.546 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.556 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:26.583 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:26.582+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:26.684 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:26.681+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:26.707 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.707 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.716 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:26.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:26.801+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:26.866 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:26.872 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:26.877 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:26.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:26.913+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:26.991 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:26.990+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:27.023 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.023 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.032 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:27.093 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:27.089+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:27.141 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.141 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.150 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:27.194 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:27.189+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:27.295 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:27.289+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:27.299 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.299 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.308 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:27.395 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:27.394+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:27.459 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.459 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.468 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:27.496 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:27.494+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:27.565 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:27.579 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.579 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.591 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:27.636 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:27.633+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:27.679 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:27.674+0000 7f4e3c4e3700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:27.682 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:27.682+0000 7f4e3b281700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:27.699 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:27.693+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:27.700 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:27.701 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:27.712 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:27.715 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:27.739 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:27.763 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:27.787 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:27.812 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:27.813 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:27.809+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:27.833 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:27.862 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:27.863 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:27.871 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:27.871 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:27.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:27.872 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:27.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.873 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:38:27.873 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:27.873 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.61921728900001, 2020-06-12T02:38:27.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:38:27.874 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.874 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:27.874 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.874 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.874 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.875 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:38:27.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.875 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:27.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:27.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:38:27.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:38:27.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:38:27.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:38:27.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:38:27.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:38:27.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:38:27.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:38:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:38:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:27.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:38:27.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:38:27.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:38:27.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:38:27.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:38:27.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:38:27.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:38:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:38:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.890 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.890 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.890 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:38:27.891 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:27.891 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.61780023700001, 2020-06-12T02:38:27.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:38:27.891 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.891 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:27.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.892 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:38:27.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.893 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:27.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:27.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:38:27.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:38:27.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:38:27.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:38:27.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:38:27.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:38:27.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:38:27.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:38:27.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:38:27.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:38:27.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:38:27.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:38:27.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:38:27.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:38:27.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:38:27.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.913 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.913 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.914 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:27.915 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:27.915 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.90723624899999, 2020-06-12T02:38:27.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:38:27.916 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.916 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:27.916 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.917 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:38:27.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.918 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:27.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:27.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:38:27.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:38:27.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:38:27.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:38:27.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:38:27.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:38:27.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:38:27.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:38:27.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:38:27.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:38:27.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:38:27.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:27.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:38:27.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:38:27.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:38:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:38:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:38:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:38:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:38:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:38:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:27.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:38:27.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:38:27.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:27.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:38:27.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:38:27.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:38:27.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:38:27.941 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.941 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.941 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.942 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:27.943 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:27.943 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.89955494700001, 2020-06-12T02:38:27.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:38:27.944 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.944 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:27.944 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.945 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:38:27.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.946 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:27.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:27.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:38:27.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:38:27.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:38:27.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:38:27.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:38:27.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:38:27.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:38:27.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:27.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:38:27.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:38:27.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:38:27.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:38:27.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:27.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:38:27.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:38:27.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:27.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:38:27.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:38:27.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:38:27.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:38:27.961 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.961 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.961 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.89049965000001, 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.962 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:27.963 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.963 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.963 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.963 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:38:27.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:27.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:38:27.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:38:27.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:38:27.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:38:27.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:38:27.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:38:27.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:38:27.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:38:27.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:38:27.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:27.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:38:27.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:38:27.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:38:27.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:38:27.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:38:27.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:38:27.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:27.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:38:27.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:38:27.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:27.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:38:27.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:38:27.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:27.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:38:27.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:38:27.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:38:27.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:38:27.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.978 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.978 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.978 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.88956011100001, 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:27.979 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:38:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.980 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:27.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:38:27.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:38:27.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:38:27.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:27.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:38:27.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:38:27.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:27.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:38:27.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:38:27.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:27.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:38:27.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:38:27.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:27.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:38:27.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:38:27.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:27.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:38:27.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:38:27.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:27.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:38:27.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:27.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:38:27.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:38:27.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:27.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:38:27.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:38:27.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.994 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:27.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:27.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.88942816400001, 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:38:27.995 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:27.996 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:27.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:27.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:27.996 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:27.996 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:38:27.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.997 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:27.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:27.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:27.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:38:27.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:27.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:27.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:27.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:38:27.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:38:28.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:38:28.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:38:28.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:38:28.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:38:28.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:38:28.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:38:28.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:38:28.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:38:28.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:38:28.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:38:28.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:38:28.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:38:28.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:38:28.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:38:28.009 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.010 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.010 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.010 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:28.011 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:28.011 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.88175586700001, 2020-06-12T02:38:28.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:38:28.012 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.012 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.012 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.012 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.013 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.013 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:38:28.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.013 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:28.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:28.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:38:28.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:38:28.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:38:28.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:38:28.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:38:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:38:28.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:38:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:38:28.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:38:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:38:28.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:38:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:38:28.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:38:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:38:28.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:38:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:38:28.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:38:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:38:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:38:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.027 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.028 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:28.029 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:28.029 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.875780902, 2020-06-12T02:38:28.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:38:28.029 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.029 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.031 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.031 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:38:28.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.032 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:28.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:28.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:38:28.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:38:28.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:28.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:38:28.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:28.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:38:28.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:38:28.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:38:28.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:38:28.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:38:28.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:38:28.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:38:28.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:38:28.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:38:28.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:38:28.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:38:28.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:38:28.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:38:28.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:38:28.047 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.047 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.047 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.048 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:28.048 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:28.048 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.86894934, 2020-06-12T02:38:28.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:38:28.048 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.049 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.049 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.049 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.049 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.049 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:38:28.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.050 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:28.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:38:28.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:38:28.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:38:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:38:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:38:28.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:38:28.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:38:28.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:38:28.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:38:28.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:38:28.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:38:28.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:38:28.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:38:28.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:38:28.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:38:28.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:38:28.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:38:28.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:38:28.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:38:28.063 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.063 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.063 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.064 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:28.064 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:28.064 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.86826639099999, 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.066 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:38:28.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:28.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:38:28.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:38:28.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:38:28.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:38:28.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:38:28.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:38:28.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:38:28.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:38:28.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:38:28.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:38:28.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:38:28.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:38:28.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:38:28.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:38:28.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:38:28.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:38:28.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.081 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:28.081 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:28.081 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.868179629, 2020-06-12T02:38:28.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:38:28.082 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:28.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:28.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:38:28.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:38:28.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:38:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:38:28.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:38:28.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:38:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:38:28.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:38:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:38:28.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:38:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:38:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:38:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:38:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:38:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:38:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.48978602299999, 2020-06-12T02:38:28.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:38:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.098 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:38:28.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.104 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:38:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:38:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:38:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:38:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:38:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:38:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:38:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:38:28.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:38:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:38:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.467364086, 2020-06-12T02:38:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:38:28.114 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:38:28.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:38:28.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:38:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:38:28.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:38:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:38:28.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:38:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:38:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:38:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:38:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:38:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:38:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:38:28.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:38:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.62138938999999, 2020-06-12T02:38:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:38:28.128 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:38:28.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:38:28.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:38:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:38:28.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:38:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:38:28.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:38:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:38:28.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:38:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:38:28.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:38:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:38:28.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:38:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:38:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:38:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:38:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:38:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:38:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.62057222600001, 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:38:28.144 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.145 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:38:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:28.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:38:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:38:28.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:38:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:38:28.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:38:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:38:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:38:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:38:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:38:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:38:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:38:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:38:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:38:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:28.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:38:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:38:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:38:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:38:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.62033558600001, 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:38:28.160 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.161 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:38:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:28.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:38:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:38:28.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:38:28.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:38:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:38:28.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:38:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:38:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:38:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:38:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:38:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:38:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:38:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:38:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:38:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:38:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:38:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:38:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.174 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.89484265500001, 2020-06-12T02:38:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:38:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.176 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:38:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:38:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:38:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:38:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:38:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:38:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:38:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:38:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:38:28.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:38:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:38:28.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:38:28.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:38:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:38:28.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.188 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 127.894561842, 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:38:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.190 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:38:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:38:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:38:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:38:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:38:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:38:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:38:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:38:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:38:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:38:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:38:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:38:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:38:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 126.815790607, 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:38:28.202 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.203 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:38:28.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.204 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:28.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:28.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:38:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:28.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:38:28.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:38:28.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:28.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:38:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:38:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:38:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:38:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:38:28.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:38:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:38:28.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:38:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:28.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:38:28.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:38:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:38:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:38:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.220 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:28.221 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:28.221 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:28.222 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:28.222+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:28.223 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:28.300 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:38:28.323 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:28.321+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:28.343 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:28.343 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:28.344 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:28.344 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:28.354 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:28.415 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:28.394+0000 7fa1119fb700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:28.416 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:28.410+0000 7fa10bfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:28.424 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:28.422+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:28.503 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:28.503 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:28.503 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:28.504 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:28.518 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:28.559 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:28.558+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:28.627 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:28.626+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:28.662 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:28.662 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:28.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:28.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:28.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.663 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:28.664 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:28.664 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.56073685000001, 2020-06-12T02:38:28.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:28.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.665 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.665 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:28.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:28.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:28.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:28.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:28.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:28.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:28.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:28.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:28.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:28.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:28.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:28.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:28.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:28.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:28.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.680 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.560566483, 2020-06-12T02:38:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.681 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:28.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.683 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:28.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:28.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:28.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:28.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:28.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:28.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:28.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:28.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:28.704 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.54242845600001, 2020-06-12T02:38:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.705 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.706 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:28.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:28.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:28.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:28.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:28.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:28.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:28.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:28.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:28.728 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.53649157300001, 2020-06-12T02:38:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.730 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:28.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:28.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.535982502, 2020-06-12T02:38:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:28.745 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.746 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:28.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:28.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:28.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:28.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:28.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:28.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.758 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:28.759 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.535824236, 2020-06-12T02:38:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 163.461427434, 2020-06-12T02:38:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:28.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.774 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:28.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:28.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:28.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:28.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:28.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 163.45441661199999, 2020-06-12T02:38:28.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.788 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:28.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:28.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:28.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:28.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:28.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:28.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:28.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:28.800 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.694630069, 2020-06-12T02:38:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.801 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.802 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:28.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:28.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.694502473, 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.820 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:28.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:28.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:28.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:28.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:28.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.279521832, 2020-06-12T02:38:28.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.839 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.27937707500001, 2020-06-12T02:38:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:28.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.851 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:28.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:28.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:28.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:28.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:28.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:28.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.27924622500001, 2020-06-12T02:38:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.279101903, 2020-06-12T02:38:28.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:28.874 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.875 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:28.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:28.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:28.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:28.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:28.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:28.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:28.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:28.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.887 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:28.888 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.27898992199999, 2020-06-12T02:38:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.889 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.27883743699999, 2020-06-12T02:38:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:28.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:28.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:28.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:28.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:28.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:28.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:28.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:28.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:28.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:28.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:28.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.916 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:28.917 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.258092299, 2020-06-12T02:38:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.918 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.919 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:28.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:28.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:28.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:28.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.25776720499999, 2020-06-12T02:38:28.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:28.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:28.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:28.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:28.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:28.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:28.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.14212072199999, 2020-06-12T02:38:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.957 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:28.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:28.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:28.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.14178046399999, 2020-06-12T02:38:28.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:28.972 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:28.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:28.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:28.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:28.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:28.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:28.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:28.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:28.986 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:28.986 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:28.987 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:28.988 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:28.986+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:29.088 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:29.085+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:29.149 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:29.150 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:29.159 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:29.189 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:29.189+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:29.263 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:29.264 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:29.272 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:38:29.306 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:29.302+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:29.387 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:29.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:29.388 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.66484764, 2020-06-12T02:38:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.389 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:29.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:29.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:29.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:29.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:29.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:29.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:29.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 175.234868388, 2020-06-12T02:38:29.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.407 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:29.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:29.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:29.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:29.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.11890522300001, 2020-06-12T02:38:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.421 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:29.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:29.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:29.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:29.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:29.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:29.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:29.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:29.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.434 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:29.435 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.11852822200001, 2020-06-12T02:38:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.436 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.437 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:29.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:29.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:29.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.11811868699999, 2020-06-12T02:38:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:29.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.454 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:29.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:29.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:29.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:29.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:29.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:29.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:29.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:29.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.466 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:29.467 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.11772635599999, 2020-06-12T02:38:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.468 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.469 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:29.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:29.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:29.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:29.484 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.10079192800001, 2020-06-12T02:38:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.485 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.486 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.09479732899999, 2020-06-12T02:38:29.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.500 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:29.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:29.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:29.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:29.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:29.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:29.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:29.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.515 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.517 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.093660755, 2020-06-12T02:38:29.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.519 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.520 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.521 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:29.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:29.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:29.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:29.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:29.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:29.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:29.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:29.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:29.547 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.09347865800001, 2020-06-12T02:38:29.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.550 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:29.563 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 168.446293336, 2020-06-12T02:38:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.564 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:29.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 168.44598094700001, 2020-06-12T02:38:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:29.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:29.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:29.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:29.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:29.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:29.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:29.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:29.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:29.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:29.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:29.590 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.591 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.43441235500001, 2020-06-12T02:38:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.592 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:29.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:29.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:29.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:29.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:29.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:29.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:29.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:29.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:29.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:29.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:29.609 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.43407289699999, 2020-06-12T02:38:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 155.43377645199999, 2020-06-12T02:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.396742676, 2020-06-12T02:38:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.389136228, 2020-06-12T02:38:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.38575769000001, 2020-06-12T02:38:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.38548743600001, 2020-06-12T02:38:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 115.385306314, 2020-06-12T02:38:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:29.711 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:29.712 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:29.713 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:29.709+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:29.813 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:29.809+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:29.830 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:29.830 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:29.830 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:29.831 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:29.846 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:29.864 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:29.915 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:29.913+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:29.975 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:29.975 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:29.975 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:29.976 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:29.976 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:29.991 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:30.010 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:30.006+0000 7fa44c500700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:30.015 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:30.014+0000 7fa44b29e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:30.015 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:30.014+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:30.049 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:30.068 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:30.088 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:30.092 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.093 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.102 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:30.114 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:30.141 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:30.148 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:30.145+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:30.167 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:30.191 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:30.195 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:30.195 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:30.221 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.222 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.231 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:30.238 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:30.238+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:30.318 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:30.313+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:30.386 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.387 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.396 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:30.442 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:30.437+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:30.519 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:30.518+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:30.558 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.559 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.568 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:30.621 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:30.617+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:30.674 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.674 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.684 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:30.728 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:30.725+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:30.827 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:30.821+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:30.841 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:30.841 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:30.853 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:30.940 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:30.937+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:31.004 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.004 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.013 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:31.056 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:31.053+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:31.131 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:31.125+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:31.161 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.161 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.172 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:31.262 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:31.257+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:31.316 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:38:31.325 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.325 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.335 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:31.336 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:31.329+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:31.433 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:31.422+0000 7f5398143700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:31.436 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:31.433+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:31.437 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:31.434+0000 7f5398143700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:31.486 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.486 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.496 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:31.536 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:31.534+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:31.638 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:31.634+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:31.650 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.650 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.659 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:31.739 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:31.738+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:31.769 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.769 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.778 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:31.840 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:31.838+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:31.893 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:31.893 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:31.904 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:31.951 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:31.950+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:32.019 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:32.020 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:32.029 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:32.043 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:32.037+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:32.144 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:32.141+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:32.193 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:32.194 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:32.201 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:32.204 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:32.246 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:32.241+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:32.330 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:38:32.347 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:32.345+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:32.353 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:32.350+0000 7f0927ca2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:32.357 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:32.354+0000 7f0926a40700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:32.358 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:32.358 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:32.369 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:32.388 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:32.410 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:32.432 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:32.448 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:32.446+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:32.456 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:32.478 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:32.497 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:32.497 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:32.498 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:32.498 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:32.508 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:32.509 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:32.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:32.525 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.526 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.527 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.527 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:32.530 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:32.530 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:32.548 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:32.545+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:32.632 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:32.632 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:32.632 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:32.632 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:32.633 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:32.641 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:32.686 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:32.686+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:32.750 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:32.749+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:32.752 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:32.752 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:32.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:32.753 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:32.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.753 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:32.753 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:32.754 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 184.031253311, 2020-06-12T02:38:32.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:32.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.754 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.754 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.755 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.755 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.755 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:32.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.756 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:32.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:32.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:32.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:32.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:32.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:32.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:32.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:32.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:32.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:32.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:32.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:32.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:32.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:32.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:32.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:32.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:32.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:32.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.776 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:32.777 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:32.777 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.60127405899999, 2020-06-12T02:38:32.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:32.778 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.778 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.778 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.779 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.779 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.779 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:32.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.780 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:32.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:32.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:32.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:32.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:32.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:32.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:32.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:32.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:32.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:32.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:32.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:32.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:32.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:32.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:32.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:32.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:32.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:32.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:32.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.804 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:32.804 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:32.804 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.48531089400001, 2020-06-12T02:38:32.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:32.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.805 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.805 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.805 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.805 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:32.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.806 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:32.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:32.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:32.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:32.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:32.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:32.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:32.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:32.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:32.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:32.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:32.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:32.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:32.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:32.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:32.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:32.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:32.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.822 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:32.822 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:32.822 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.484933893, 2020-06-12T02:38:32.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:32.822 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.823 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:32.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:32.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:32.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:32.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:32.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:32.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:32.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:32.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:32.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:32.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:32.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:32.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:32.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:32.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:32.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:32.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:32.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:32.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:32.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:32.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:32.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:32.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:32.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:32.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.48452435799999, 2020-06-12T02:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:32.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.840 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:32.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:32.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:32.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:32.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:32.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:32.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:32.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:32.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:32.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:32.857 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.857 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.857 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.858 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:32.858 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:32.858 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.48413202699999, 2020-06-12T02:38:32.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.859 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:32.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:32.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:32.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:32.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:32.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:32.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:32.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:32.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:32.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:32.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:32.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:32.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:32.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:32.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:32.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:32.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:32.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:32.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:32.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.872 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:32.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.467197599, 2020-06-12T02:38:32.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:32.874 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.874 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.874 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.875 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.875 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:32.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.875 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:32.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:32.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:32.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:32.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:32.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:32.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:32.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:32.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:32.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:32.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:32.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:32.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:32.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:32.888 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:32.889 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:32.890 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.46120300000001, 2020-06-12T02:38:32.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:32.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.892 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:32.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.892 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:32.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:32.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:32.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:32.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:32.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:32.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:32.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:32.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:32.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:32.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:32.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:32.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:32.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:32.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:32.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:32.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:32.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:32.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:32.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:32.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:32.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:32.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:32.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.906 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.907 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:32.907 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:32.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.460066426, 2020-06-12T02:38:32.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:32.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:32.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:32.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:32.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:32.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:32.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:32.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:32.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:32.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:32.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:32.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:32.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:32.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:32.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:32.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:32.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:32.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.459884329, 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.923 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.923 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:32.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:32.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:32.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:32.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:32.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:32.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:32.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:32.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:32.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:32.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:32.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:32.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:32.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:32.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:32.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:32.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:32.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 171.81269900699999, 2020-06-12T02:38:32.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:32.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.938 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.939 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:32.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.939 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:32.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:32.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:32.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:32.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:32.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:32.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:32.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:32.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:32.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:32.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:32.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:32.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:32.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:32.949 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.950 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 171.81238661800001, 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:32.951 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.952 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.952 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.952 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:32.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.952 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:32.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:32.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:32.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:32.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:32.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:32.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:32.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:32.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:32.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:32.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:32.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:32.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:32.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:32.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.800818026, 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.964 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.965 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:32.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:32.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:32.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:32.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:32.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:32.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:32.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:32.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:32.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:32.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:32.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:32.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:32.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:32.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:32.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.979 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.80047856799999, 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.980 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.981 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.981 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:32.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.982 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:32.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:32.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:32.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:32.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:32.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:32.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:32.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:32.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:32.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:32.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:32.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:32.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:32.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:32.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:32.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:32.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:32.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:32.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:32.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:32.994 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.995 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:32.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:32.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.995 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:32.996 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:32.996 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.80018212300001, 2020-06-12T02:38:32.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:32.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:32.996 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.997 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:32.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:32.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:32.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:32.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:32.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:33.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:33.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:33.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:33.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:33.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:33.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:33.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:33.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:33.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:33.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:33.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:33.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:33.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:33.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:33.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:33.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:33.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:33.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:33.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.016 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.016 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.017 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:33.017 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:33.017 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.763148347, 2020-06-12T02:38:33.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:33.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.75554189899999, 2020-06-12T02:38:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.752163361, 2020-06-12T02:38:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.751893107, 2020-06-12T02:38:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 118.751711985, 2020-06-12T02:38:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.105 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:33.106 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:33.107 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:33.101+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:33.208 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:33.205+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:33.269 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:33.269 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:33.270 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:33.270 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:33.279 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:33.308 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:33.305+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:33.385 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:33.385 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:33.385 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:33.386 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:33.386 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:33.395 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:33.411 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:33.405+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:33.504 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:33.504 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:33.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:33.504 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.37912346499999, 2020-06-12T02:38:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:33.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.507 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.507 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:33.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:33.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:33.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:33.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:33.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:33.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:33.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:33.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:33.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:33.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:33.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:33.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:33.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:33.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:33.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:33.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:33.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:33.529 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.378900023, 2020-06-12T02:38:33.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:33.530 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.530 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.531 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.531 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:33.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.531 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:33.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:33.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:33.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:33.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:33.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:33.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:33.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:33.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:33.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:33.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:33.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:33.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:33.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:33.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:33.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:33.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:33.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.546 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:33.546 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:33.547 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.336420914, 2020-06-12T02:38:33.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:33.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.547 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.547 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.548 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.548 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.548 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:33.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:33.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:33.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:33.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:33.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:33.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:33.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:33.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:33.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:33.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:33.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:33.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:33.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:33.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:33.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:33.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:33.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:33.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.564 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:33.565 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:33.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.33608602000001, 2020-06-12T02:38:33.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.567 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:33.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.567 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.135210137, 2020-06-12T02:38:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.13505032399999, 2020-06-12T02:38:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.134969611, 2020-06-12T02:38:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.13472305799999, 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.12137273499999, 2020-06-12T02:38:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.661 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:33.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:33.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:33.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:33.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:33.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:33.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:33.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:33.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:33.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:33.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:33.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:33.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:33.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:33.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:33.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:33.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.673 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.121186481, 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.674 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.675 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.675 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.675 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:33.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.675 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:33.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:33.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:33.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:33.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:33.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:33.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:33.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:33.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:33.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:33.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:33.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:33.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:33.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:33.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.688 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.689 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:33.689 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:33.689 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.12098577, 2020-06-12T02:38:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.690 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:33.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.692 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:33.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:33.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:33.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:33.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:33.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:33.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:33.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:33.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:33.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:33.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:33.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:33.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:33.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:33.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:33.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:33.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:33.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:33.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.708 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:33.709 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:33.709 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.52849780899999, 2020-06-12T02:38:33.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:33.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.710 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.710 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:33.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.711 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:33.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:33.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:33.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:33.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:33.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:33.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:33.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:33.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:33.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:33.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:33.724 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.725 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:33.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:33.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.725 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.528074062, 2020-06-12T02:38:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:33.726 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:33.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:33.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:33.727 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:33.727 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:33.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.728 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:33.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:33.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:33.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:33.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:33.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:33.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:33.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:33.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:33.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:33.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:33.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:33.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:33.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:34.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:34.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:34.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:34.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:34.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:34.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:34.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.470 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.471 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.527920204, 2020-06-12T02:38:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.472 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:34.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.52518941599999, 2020-06-12T02:38:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:34.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:34.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:34.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:34.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:34.500 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.52476908899999, 2020-06-12T02:38:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.501 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.502 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:34.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:34.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 133.524674256, 2020-06-12T02:38:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:34.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:34.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:34.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:34.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:34.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:34.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:34.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:34.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:34.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:34.530 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.494894902, 2020-06-12T02:38:34.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.533 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:34.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:34.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:34.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:34.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:34.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:34.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:34.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:34.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:34.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:34.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:34.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:34.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:34.557 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.49442928900001, 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.558 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:34.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:34.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:34.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:34.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:34.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 129.49425535399999, 2020-06-12T02:38:34.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:34.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:34.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:34.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:34.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:34.596 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:38:34.597 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:34.599 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:34.597+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:34.601 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:34.698 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:34.693+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:34.726 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:34.727 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:34.727 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:34.736 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:34.755 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:34.750+0000 7f8bc9ef7700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:34.758 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:34.750+0000 7fe4b6680700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:34.759 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:34.758+0000 7f8bc8c95700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:34.761 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:34.758+0000 7fe4b541e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:34.800 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:34.820 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:34.828 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:34.825+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:34.843 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:34.868 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:34.899 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:34.900 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:34.901 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:34.897+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:34.908 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:34.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:34.955 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:34.956 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.956 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.956 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:34.956 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:34.957 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.957 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.957 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.957 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.957 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:34.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:34.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:35.002 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:34.998+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:35.062 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.062 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.072 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:35.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:35.117+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:35.177 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.177 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.186 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:35.228 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:35.225+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:35.305 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:35.301+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:35.341 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:38:35.341 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.342 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.351 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:35.440 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:35.437+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:35.501 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.502 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:35.501+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:35.511 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:35.607 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:35.601+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:35.662 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.662 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.671 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:35.708 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:35.706+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:35.809 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:35.805+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:35.822 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.823 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.831 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:35.920 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:35.917+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:35.985 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:35.986 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:35.997 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:36.040 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:36.037+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:36.112 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:36.109+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:36.149 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.149 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.159 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:36.213 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:36.210+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:36.308 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.308 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.314 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:36.309+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:36.318 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:36.414 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:36.409+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:36.473 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.474 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.483 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:36.531 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:36.530+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:36.601 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.601 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.611 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:36.629 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:36.621+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:36.721 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:36.717+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:36.771 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.772 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.782 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:36.823 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:36.817+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:36.911 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:36.911 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:36.919 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:36.925 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:36.921+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:36.959 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:37.025 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:37.021+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:37.046 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:37.070 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:37.066+0000 7f2bd9251700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:37.074 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:37.070+0000 7f2bd9251700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:37.124 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:37.126 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:37.126+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:37.149 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:37.149 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:37.149 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:37.158 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:37.228 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:37.226+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:37.254 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.255 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:37.256 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:37.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:37.290 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:37.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:37.291 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:37.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.291 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:37.291 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:37.292 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 188.558339069, 2020-06-12T02:38:37.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:37.292 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.292 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.293 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:37.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.293 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:37.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:37.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:37.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:37.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:37.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:37.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:37.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:37.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:37.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:37.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:37.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:37.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:37.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:37.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:37.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.308 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 183.12835981699999, 2020-06-12T02:38:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:37.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.310 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.310 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:37.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:37.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:37.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:37.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:37.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:37.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:37.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:37.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:37.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:37.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:37.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:37.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:37.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:37.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:37.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.331 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.332 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.332 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:37.332 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:37.333 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.01239665200001, 2020-06-12T02:38:37.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:37.333 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.333 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.333 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.334 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.334 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:37.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.334 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:37.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:37.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:37.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:37.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:37.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:37.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:37.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:37.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:37.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:37.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:37.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:37.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:37.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:37.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.012019651, 2020-06-12T02:38:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:37.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:37.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:37.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:37.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:37.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:37.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:37.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:37.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:37.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:37.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:37.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:37.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:37.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:37.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:37.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:37.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:37.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:37.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:37.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:37.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:37.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.363 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.364 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:37.364 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:37.365 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.01161011600001, 2020-06-12T02:38:37.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:37.365 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.365 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.365 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.366 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.366 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.366 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:37.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:37.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:37.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:37.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:37.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:37.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:37.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:37.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:37.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:37.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:37.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:37.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:37.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.379 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.380 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:37.380 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:37.380 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.01121778500001, 2020-06-12T02:38:37.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:37.381 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.382 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.382 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.382 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:37.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:37.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:37.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:37.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:37.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:37.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:37.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:37.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:37.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:37.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:37.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:37.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:37.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:37.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:37.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:37.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:37.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:37.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:37.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:37.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:37.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:37.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.398 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.399 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:37.399 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:37.399 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.994283357, 2020-06-12T02:38:37.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:37.399 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.400 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.400 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.400 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.400 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.400 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:37.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.401 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:37.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:37.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:37.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:37.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:37.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:37.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:37.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:37.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:37.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:37.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:37.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:37.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:37.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:37.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:37.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:37.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:37.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:37.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:37.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:37.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:37.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:37.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:37.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.414 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:37.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.98828875800001, 2020-06-12T02:38:37.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:37.416 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.417 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.417 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:37.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:37.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:37.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:37.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:37.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:37.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:37.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:37.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:37.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:37.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:37.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:37.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:37.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:37.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:37.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:37.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:37.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:37.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:37.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:37.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:37.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:37.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.431 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:37.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:37.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.987152184, 2020-06-12T02:38:37.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:37.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.432 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:37.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.433 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:37.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:37.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:37.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:37.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:37.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:37.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:37.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:37.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:37.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:37.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:37.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:37.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:37.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:37.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:37.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:37.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:37.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:37.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:37.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.446 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.447 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:37.447 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:37.447 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.986970087, 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:37.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.449 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:37.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:37.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:37.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:37.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:37.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:37.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:37.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:37.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:37.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:37.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:37.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:37.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:37.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.33978476499999, 2020-06-12T02:38:37.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.462 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:37.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:37.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:37.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:37.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:37.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:37.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:37.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:37.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:37.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:37.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:37.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:37.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:37.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.474 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.475 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:37.475 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:37.475 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.339472376, 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.477 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:37.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.477 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:37.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:37.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:37.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:37.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:37.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:37.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:37.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:37.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:37.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:37.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:37.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.489 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:37.489 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:37.489 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 163.327903784, 2020-06-12T02:38:37.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.491 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:37.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.491 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:37.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:37.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:37.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:37.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:37.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:37.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:37.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:37.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:37.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:37.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:37.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:37.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:37.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:37.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:37.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:37.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:37.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:37.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:37.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:37.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.507 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:37.507 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:37.507 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 163.32756432599999, 2020-06-12T02:38:37.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:37.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.508 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:37.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.509 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:37.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:37.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:37.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:37.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:37.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:37.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:37.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:37.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:37.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:37.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:37.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:37.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:37.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:37.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:37.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:37.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:37.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:37.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:37.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:37.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:37.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:37.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.528 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:37.529 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:37.529 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 163.32726788100001, 2020-06-12T02:38:37.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:37.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:37.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.530 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.530 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:37.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:37.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:37.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:37.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:37.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:37.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:37.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:37.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:37.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:37.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:37.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:37.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:37.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:37.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:37.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:37.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:37.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:37.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:37.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:37.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:37.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:37.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:37.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.548 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:37.549 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:37.549 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.290234105, 2020-06-12T02:38:37.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:37.549 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:37.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.551 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:37.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:37.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:37.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:37.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:37.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:37.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:37.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:37.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:37.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:37.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:37.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:37.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:37.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:37.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:37.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:37.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:37.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:37.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:37.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:37.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.567 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:37.567 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:37.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.28262765700001, 2020-06-12T02:38:37.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:37.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:37.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.570 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.570 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:37.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.571 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:37.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:37.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:37.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:37.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:37.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:37.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:37.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:37.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:37.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:37.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:37.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.584 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.279249119, 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:37.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:37.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:37.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:37.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:37.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:37.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:37.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:37.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:37.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:37.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:37.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:37.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:37.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:37.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:37.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:37.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:37.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:37.598 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.278978865, 2020-06-12T02:38:37.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:37.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:37.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.600 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:37.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.601 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:37.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:37.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:37.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:37.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:37.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:37.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:37.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:37.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:37.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:37.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:37.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:37.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:37.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:37.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:37.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:37.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:37.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:37.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:37.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:37.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.614 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.615 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:37.615 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:37.616 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 123.278797743, 2020-06-12T02:38:37.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:37.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:37.616 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:37.617 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:37.617 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:37.617 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:37.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:37.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.618 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:37.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:37.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:37.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:37.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:37.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:37.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:37.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:37.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:37.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:37.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:37.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:37.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:37.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:37.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:37.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:37.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:37.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:37.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:37.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:37.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:37.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:37.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:37.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:37.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:37.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:37.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:37.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:37.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:37.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:37.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:37.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:37.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:37.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:37.632 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:37.632 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:38:37.634 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:37.635 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:37.634+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:37.734 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:37.733+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:37.792 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:37.793 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:37.800 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:37.786+0000 7f7250c44700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:37.803 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:37.804 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:37.802+0000 7f7250c44700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:37.850 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:37.850+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:37.912 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:37.912 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:37.913 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:37.913 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:37.913 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:37.921 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:37.962 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:37.962+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:38.043 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:38.042+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:38.075 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:38.076 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:38.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:38.076 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:38.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.077 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:38.077 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:38.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 186.950935418, 2020-06-12T02:38:38.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:38.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.078 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.078 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.079 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:38.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:38.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:38.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:38.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:38.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:38.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:38.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:38.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:38.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:38.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:38.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:38.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:38.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:38.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:38.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:38.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:38.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:38.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.095 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:38.095 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:38.095 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 186.95071197600001, 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.096 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.097 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:38.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.097 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:38.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:38.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:38.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:38.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:38.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:38.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:38.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:38.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:38.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:38.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:38.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:38.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:38.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:38.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:38.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:38.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:38.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:38.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:38.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.121 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:38.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:38.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.90823286700001, 2020-06-12T02:38:38.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:38.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:38.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.123 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:38.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:38.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:38.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:38.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:38.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:38.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:38.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:38.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:38.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:38.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:38.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:38.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:38.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:38.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:38.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:38.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:38.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:38.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:38.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:38.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:38.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:38.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:38.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:38.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:38.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.146 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 181.90789797299999, 2020-06-12T02:38:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.147 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.148 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:38.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:38.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:38.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:38.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:38.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:38.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:38.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:38.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:38.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:38.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:38.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:38.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:38.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:38.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:38.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:38.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:38.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:38.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:38.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.167 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:38.167 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:38.167 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.70702209000001, 2020-06-12T02:38:38.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:38.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.168 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.168 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.169 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.169 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:38.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.169 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:38.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:38.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:38.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:38.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:38.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:38.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:38.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:38.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:38.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:38.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:38.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:38.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:38.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:38.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:38.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:38.180 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.181 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:38.182 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:38.182 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.706862277, 2020-06-12T02:38:38.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:38.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.183 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.183 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:38.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:38.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:38.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:38.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:38.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:38.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:38.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:38.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:38.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:38.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:38.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:38.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:38.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:38.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:38.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.196 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:38.196 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:38.196 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.70678156400001, 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.197 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.198 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:38.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.198 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:38.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:38.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:38.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:38.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:38.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:38.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:38.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:38.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:38.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:38.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:38.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:38.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:38.208 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.208 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:38.209 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.706535011, 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.210 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.211 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:38.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.211 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:38.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:38.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:38.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:38.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:38.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:38.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:38.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:38.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.693184688, 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:38.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.222 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:38.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.223 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:38.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:38.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:38.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:38.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:38.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:38.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:38.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:38.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:38.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:38.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:38.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:38.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:38.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:38.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.234 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:38.234 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:38.234 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.692998434, 2020-06-12T02:38:38.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:38.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.235 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:38.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:38.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:38.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:38.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:38.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:38.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:38.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:38.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:38.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:38.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:38.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:38.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:38.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:38.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:38.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:38.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:38.248 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.248 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.248 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.249 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:38.249 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:38.250 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.69279772300001, 2020-06-12T02:38:38.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:38.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.251 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.251 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.252 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.252 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.252 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:38.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.253 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:38.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:38.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:38.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:38.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:38.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:38.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:38.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:38.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:38.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:38.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:38.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:38.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:38.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:38.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:38.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:38.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:38.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:38.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:38.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:38.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:38.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:38.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:38.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:38.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:38.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:38.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:38.275 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:38.276 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.10030976199999, 2020-06-12T02:38:38.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:38.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.277 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:38.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.279 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:38.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:38.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:38.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:38.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:38.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:38.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:38.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:38.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:38.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:38.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:38.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:38.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:38.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:38.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:38.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:38.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:38.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:38.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:38.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:38.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:38.296 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:38.296 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.09988601500001, 2020-06-12T02:38:38.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:38.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:38.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.298 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:38.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:38.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:38.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:38.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:38.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:38.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:38.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:38.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:38.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:38.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:38.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:38.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:38.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:38.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:38.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:38.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:38.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:38.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:38.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.314 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:38.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:38.315 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.09973215700001, 2020-06-12T02:38:38.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:38.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:38.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.316 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:38.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.317 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:38.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:38.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:38.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:38.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:38.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:38.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:38.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:38.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:38.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:38.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:38.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:38.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:38.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.328 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:38.328 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:38.328 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.097001369, 2020-06-12T02:38:38.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:38.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.329 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:38.329 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.329 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.330 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.330 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:38.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.330 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:38.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:38.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:38.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:38.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:38.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:38.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:38.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:38.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:38.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:38.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:38.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:38.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:38.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:38.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:38.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:38.347 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.096581042, 2020-06-12T02:38:38.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:38.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:38.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.350 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:38.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:38.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:38.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:38.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:38.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:38.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:38.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:38.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:38.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:38.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:38.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:38.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:38.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:38.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:38.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:38.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.360 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:38.361 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:38.362 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.09648620900001, 2020-06-12T02:38:38.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:38.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.363 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.363 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:38.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.364 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:38.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:38.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:38.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:38.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:38.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:38.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:38.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:38.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:38.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:38.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:38.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:38.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:38.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:38.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:38.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:38.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:38.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:38.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:38.377 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.378 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.379 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:38.379 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:38.379 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 134.06670685500001, 2020-06-12T02:38:38.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:38.380 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.380 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.380 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.380 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:38.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.381 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:38.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:38.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:38.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:38.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:38.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:38.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:38.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:38.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:38.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:38.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:38.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:38.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:38.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:38.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:38.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:38.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:38.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:38.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:38.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:38.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:38.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:38.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:38.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.396 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.397 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:38.397 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:38.397 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 134.06624124199999, 2020-06-12T02:38:38.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:38.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.398 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.399 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:38.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.399 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:38.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:38.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:38.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:38.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:38.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:38.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:38.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:38.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:38.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:38.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:38.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:38.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:38.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:38.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:38.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:38.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:38.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:38.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:38.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:38.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.413 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.414 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:38.414 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 134.066067307, 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:38.415 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:38.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.416 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:38.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:38.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:38.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:38.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:38.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:38.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:38.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:38.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:38.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:38.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:38.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:38.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:38.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:38.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:38.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:38.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:38.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:38.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:38.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:38.431 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:38.433 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:38.433 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:38:38.434 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:38.430+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:38.533 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:38.529+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:38.550 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:38.551 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:38.551 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:38.551 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:38.560 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:38.652 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:38.649+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:38.722 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:38.722 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:38.723 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:38.723 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:38.723 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:38.729 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:38.776 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:38.773+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:38.838 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:38.833+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:38.889 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:38.889 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:38.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.752301542, 2020-06-12T02:38:38.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:38:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.892 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:38.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:38.893 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.893 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:38:38.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.899 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:38.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:38.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:38.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:38.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:38.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:38.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:38:38.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:38.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:38:38.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:38:38.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:38.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:38:38.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:38:38.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:38.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:38:38.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:38:38.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:38:38.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:38:38.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:38.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:38:38.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:38:38.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:38.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:38:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:38:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:38:38.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:38:38.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:38.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:38:38.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:38:38.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:38:38.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:38:38.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:38:38.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:38.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:38:38.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:38:38.927 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.927 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:38.928 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.929 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:38:38.929 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:38.929 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.741410161, 2020-06-12T02:38:38.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:38:38.930 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:38.930 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:38.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:38.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.932 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:38:38.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.933 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:38.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:38.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:38.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:38.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:38.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:38.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:38:38.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:38.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:38:38.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:38:38.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:38.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:38:38.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:38:38.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:38.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:38:38.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:38:38.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:38:38.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:38:38.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:38.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:38:38.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:38:38.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:38.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:38:38.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:38:38.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:38:38.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:38:38.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:38:38.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:38:38.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:38.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:38:38.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:38:38.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:38.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:38:38.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:38:38.959 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.959 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:38.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.960 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:38.960 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:38.961 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.740278117, 2020-06-12T02:38:38.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:38:38.961 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:38.962 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:38.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:38.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.962 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:38.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:38.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:38.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:38.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:38:38.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:38.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:38:38.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:38:38.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:38.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:38:38.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:38:38.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:38.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:38:38.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:38:38.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:38:38.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:38:38.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:38.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:38:38.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:38:38.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:38:38.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:38:38.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:38:38.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:38:38.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:38.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:38:38.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:38:38.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.975 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:38.975 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.976 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:38.976 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:38.976 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.74002293199999, 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:38.977 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.978 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:38:38.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.978 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:38.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:38.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:38.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:38.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:38.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:38.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:38:38.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:38.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:38:38.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:38:38.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:38.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:38:38.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:38:38.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:38.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:38:38.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:38:38.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:38.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:38:38.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:38:38.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:38.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:38:38.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:38:38.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:38.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:38:38.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:38:38.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:38.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:38:38.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:38:38.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:38.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:38:38.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:38:38.991 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.991 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:38.991 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:38.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.73986374500001, 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:38:38.992 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:38.993 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:38:38.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.994 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:38.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:38.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:38.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:38.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:38.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:38.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:38:38.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:38.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:38:38.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:38:38.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:38.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:38:38.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:38:38.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:38.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:38.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:38.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:38:38.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:38:38.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:38:39.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:38:39.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:39.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:38:39.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:38:39.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:38:39.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:38:39.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:38:39.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:38:39.005 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.006 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.59554116699999, 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.007 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.008 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.008 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:38:39.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.009 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:39.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:39.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:38:39.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:38:39.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:38:39.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:38:39.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:38:39.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:38:39.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:38:39.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:38:39.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:38:39.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:38:39.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:38:39.018 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.018 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.019 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:39.019 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.85447167000001, 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.020 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.021 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.021 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:38:39.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.022 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:39.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:39.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:38:39.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:38:39.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:38:39.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:38:39.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:38:39.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:38:39.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:38:39.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:38:39.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:38:39.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:39.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:38:39.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:38:39.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:38:39.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:38:39.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:38:39.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:38:39.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:38:39.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:38:39.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:39.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:38:39.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:38:39.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:38:39.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:38:39.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.039 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.040 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:39.040 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:39.040 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 154.91676926900001, 2020-06-12T02:38:39.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:38:39.041 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.042 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:39.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.042 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.042 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:39.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:39.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:38:39.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:38:39.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:38:39.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:38:39.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:38:39.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:38:39.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:38:39.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:38:39.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:38:39.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:39.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:38:39.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:38:39.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:38:39.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:38:39.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:38:39.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:38:39.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:38:39.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:38:39.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:38:39.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:38:39.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:39.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:38:39.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:38:39.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:38:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:38:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.062 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.063 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:39.063 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:39.063 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.93489318900001, 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.065 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:38:39.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.065 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:39.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:39.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:38:39.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:38:39.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:38:39.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:38:39.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:38:39.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:38:39.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:38:39.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:38:39.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:38:39.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:38:39.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:38:39.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:38:39.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:38:39.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.077 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:39.077 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:39.077 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.934699873, 2020-06-12T02:38:39.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:38:39.077 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.078 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.078 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.078 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.078 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.078 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:38:39.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.079 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:39.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:38:39.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:38:39.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:38:39.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:38:39.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:38:39.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:38:39.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:38:39.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:38:39.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:39.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:38:39.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:38:39.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:38:39.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:38:39.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:38:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:38:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.089 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.090 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.090 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:39.090 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:39.091 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.93455141800001, 2020-06-12T02:38:39.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:38:39.091 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.091 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.091 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:39.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:38:39.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:38:39.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:38:39.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:38:39.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:38:39.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:38:39.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:38:39.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:38:39.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:38:39.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:38:39.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:38:39.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:39.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:38:39.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:38:39.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:38:39.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:38:39.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:38:39.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:38:39.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.105 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.105 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:38:39.105 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:39.106 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.927118468, 2020-06-12T02:38:39.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:38:39.106 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.106 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:39.107 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:39.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:39.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:39.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:39.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:38:39.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:38:39.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:38:39.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:38:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:38:39.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:38:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:38:39.114 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.115 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:39.116 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.924709968, 2020-06-12T02:38:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:38:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:39.119 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:38:39.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:38:39.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:38:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:38:39.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:38:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:38:39.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:38:39.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:38:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:38:39.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:38:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:38:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:38:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:38:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.129 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:39.130 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.922682823, 2020-06-12T02:38:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:38:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:39.131 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:39.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:39.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:38:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:38:39.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:38:39.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:38:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:38:39.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:38:39.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:38:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:38:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:38:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:38:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:38:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:38:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:38:39.143 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.144 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:38:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.91163298999999, 2020-06-12T02:38:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:38:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.145 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:38:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:38:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:38:39.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:38:39.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:38:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:38:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:38:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:38:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:38:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:38:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:38:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:38:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:38:39.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:38:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:38:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:38:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:38:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.164 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:39.165 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:39.166 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.907419973, 2020-06-12T02:38:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:38:39.167 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.168 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:38:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:38:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:38:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:38:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:38:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:38:39.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:38:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:38:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:38:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:38:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:38:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:38:39.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:38:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:38:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:38:39.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:38:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:38:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:38:39.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:38:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:38:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.90723677400001, 2020-06-12T02:38:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:38:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.187 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:38:39.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:39.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:38:39.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:38:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:38:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:38:39.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:38:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:38:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:38:39.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:38:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:38:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:38:39.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:38:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:38:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:38:39.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:38:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:38:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:38:39.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:38:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:38:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:38:39.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:38:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:38:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:38:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:38:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.210 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.211 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:38:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.45031872999999, 2020-06-12T02:38:39.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:38:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:39.213 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:39.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:38:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:38:39.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:38:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:38:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:38:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:38:39.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:38:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:38:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:38:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:38:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:38:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:38:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:38:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:38:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:38:39.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:38:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:38:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.91985713299999, 2020-06-12T02:38:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:38:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:39.234 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.235 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:38:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:38:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:38:39.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:38:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:38:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:38:39.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:38:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:38:39.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:38:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:38:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:38:39.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:38:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:38:39.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:38:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:38:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:38:39.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:39.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:38:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:38:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:38:39.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:38:39.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:38:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:38:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.257 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:38:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:39.259 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 128.919598014, 2020-06-12T02:38:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:38:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:39.260 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:39.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:38:39.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:39.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:38:39.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:39.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:38:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:38:39.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:38:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:38:39.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:38:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:38:39.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:39.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:38:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:38:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:38:39.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:38:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:38:39.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:38:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:38:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:38:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:38:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:38:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:38:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:38:39.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:39.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:38:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:38:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:39.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:38:39.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:38:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:39.287 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:39.288 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:39.288 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:39.290 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:39.285+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:39.291 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:39.391 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:39.390+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:39.405 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:39.402+0000 7f70de374700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:39.411 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:39.410+0000 7f70dd112700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:39.445 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:39.451 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:39.451 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:39.452 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:39.452 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:39.461 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:39.470 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:39.496 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:39.512 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:39.509+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:39.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:39.552 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:39.574 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:39.582 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:39.583 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:39.592 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:39.596 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:39.596 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.597 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.599 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.601 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.601 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.601 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:39.603 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:39.603 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:39.658 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:39.633+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:39.696 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:39.694+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:39.746 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:39.747 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:39.756 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:39.804 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:39.801+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:39.870 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:39.871 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:39.877 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:39.922 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:39.917+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:39.999 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:39.998+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:40.034 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.035 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.045 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:40.100 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:40.098+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:40.156 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.156 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.165 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:40.201 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:40.198+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:40.277 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.277 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.290 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:40.301 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:40.298+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:40.399 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.399 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.402 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:40.398+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:40.406 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:40.435 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:38:40.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:40.497+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:40.511 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.512 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.521 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:40.557 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:40.546+0000 7fbf2734e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:40.562 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:40.562+0000 7fbf260ec700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:40.604 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:40.602+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:40.656 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.657 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.666 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:40.714 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:40.710+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:40.806 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:40.805+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:40.824 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.824 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.834 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:40.909 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:40.909+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:40.941 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:40.941 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:40.950 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:41.011 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:41.010+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:41.059 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.060 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.069 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:41.114 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:41.110+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:41.214 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:41.213+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:41.222 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.222 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.232 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:41.315 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:41.313+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:41.337 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.338 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.347 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:41.392 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:38:41.417 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:41.413+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:41.454 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.454 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.463 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:41.518 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:41.513+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:41.572 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.576 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.581 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:41.605 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:41.619 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:41.613+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:41.697 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.698 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.707 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:41.720 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:41.718+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:41.742 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:41.738+0000 7f3cc6e73700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:41.745 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:41.742+0000 7f3cc5c11700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:41.799 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:41.822 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:41.817+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:41.822 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:41.824 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:41.824 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:41.835 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:41.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:41.874 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:41.898 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:41.922 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:41.922+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:41.929 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:41.930 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.931 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:41.933 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:41.933 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:41.984 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:41.984 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:41.984 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:41.984 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:41.985 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:41.993 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:42.040 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:42.037+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:42.099 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:42.099 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:42.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:42.100 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:42.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.100 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:42.101 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:42.101 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.962495945, 2020-06-12T02:38:42.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:38:42.101 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.101 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.102 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.102 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.102 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.102 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:38:42.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.103 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:42.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:38:42.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:38:42.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:38:42.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:38:42.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:38:42.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:38:42.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:38:42.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:38:42.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:42.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:38:42.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:38:42.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:38:42.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:38:42.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:38:42.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:38:42.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:38:42.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:38:42.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:38:42.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:38:42.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:38:42.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:38:42.118 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.118 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.119 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:38:42.119 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:42.120 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.95160456400001, 2020-06-12T02:38:42.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:38:42.120 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.120 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.121 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.122 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:38:42.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.122 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:42.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:38:42.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:38:42.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:38:42.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:38:42.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:38:42.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:38:42.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:38:42.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:38:42.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:38:42.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:38:42.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:38:42.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:38:42.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:38:42.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:38:42.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:38:42.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:38:42.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:38:42.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:38:42.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:38:42.136 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.136 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.136 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.95047252000001, 2020-06-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:42.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:38:42.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:38:42.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:38:42.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:38:42.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:38:42.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:38:42.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:38:42.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:38:42.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:38:42.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.154 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.154 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.154 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.95021733499999, 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.156 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.156 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.156 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:38:42.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.157 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:42.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:42.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:38:42.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:38:42.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:38:42.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:38:42.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:38:42.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:38:42.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:38:42.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:38:42.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:38:42.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:38:42.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:38:42.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:38:42.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:38:42.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:38:42.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:38:42.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:38:42.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:38:42.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:38:42.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:38:42.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:38:42.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:38:42.170 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.170 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.171 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.171 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:42.171 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:42.172 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 190.95005814800001, 2020-06-12T02:38:42.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:38:42.172 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.172 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.172 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.173 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:38:42.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.173 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:42.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:38:42.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:38:42.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:38:42.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:38:42.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:38:42.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:38:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:38:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:38:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:38:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:38:42.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:38:42.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:42.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:38:42.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:38:42.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:38:42.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:38:42.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:38:42.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:38:42.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:38:42.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:38:42.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.185 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.186 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:38:42.186 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:42.186 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 185.80573557, 2020-06-12T02:38:42.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:38:42.187 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.187 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.187 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.189 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:38:42.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.189 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:42.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:38:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:38:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:38:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:38:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:38:42.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:38:42.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:38:42.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:38:42.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:38:42.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:38:42.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:38:42.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:38:42.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:38:42.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:38:42.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.201 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:42.201 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:42.201 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.06466607300001, 2020-06-12T02:38:42.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:38:42.201 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.202 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.202 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:38:42.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.203 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:42.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:42.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:38:42.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:38:42.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:38:42.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:38:42.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:38:42.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:38:42.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:38:42.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:38:42.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:38:42.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:38:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:38:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:42.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:38:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:38:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:38:42.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:38:42.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:38:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:38:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:38:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:38:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:38:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:38:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:38:42.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:38:42.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:38:42.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:38:42.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.218 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.219 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:42.219 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:42.219 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.12696367199999, 2020-06-12T02:38:42.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:38:42.220 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.220 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.221 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:38:42.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.222 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:42.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:42.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:38:42.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:38:42.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:38:42.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:38:42.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:38:42.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:38:42.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:38:42.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:38:42.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:38:42.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:38:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:38:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:42.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:38:42.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:38:42.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:38:42.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:38:42.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:38:42.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:38:42.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:38:42.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:38:42.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:38:42.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:38:42.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:38:42.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:38:42.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:38:42.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:38:42.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.243 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.243 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.244 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:42.244 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:42.244 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.14508759200001, 2020-06-12T02:38:42.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:38:42.245 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.245 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.245 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.246 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:38:42.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.246 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:42.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:38:42.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:38:42.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:38:42.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:38:42.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:38:42.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:38:42.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:38:42.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:38:42.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:38:42.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:38:42.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:42.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:38:42.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:38:42.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:38:42.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:38:42.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:38:42.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:38:42.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.258 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.258 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:42.259 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.144894276, 2020-06-12T02:38:42.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:38:42.260 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.260 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.260 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.260 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.261 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.261 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:38:42.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.262 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:42.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:42.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:38:42.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:38:42.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:38:42.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:38:42.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:38:42.266 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:38:42.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:38:42.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:38:42.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:38:42.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:38:42.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:38:42.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:38:42.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:38:42.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:38:42.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:38:42.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:38:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:38:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.273 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.274 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.274 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:42.274 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:42.275 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.14474582099999, 2020-06-12T02:38:42.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:38:42.275 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.275 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.276 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.276 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:38:42.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.277 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:42.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:42.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:38:42.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:38:42.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:38:42.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:38:42.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:38:42.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:38:42.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:38:42.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:38:42.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:38:42.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:42.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:38:42.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:38:42.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:38:42.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:38:42.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:38:42.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:38:42.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:38:42.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:38:42.289 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.290 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.290 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.290 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:38:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.13731287100001, 2020-06-12T02:38:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:38:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.291 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.292 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:42.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:42.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:42.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:42.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:38:42.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:38:42.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:38:42.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:38:42.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:38:42.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:38:42.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.301 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:42.302 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:42.302 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.134904371, 2020-06-12T02:38:42.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:38:42.304 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.304 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.304 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:42.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.306 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:42.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:38:42.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:38:42.307 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:38:42.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:38:42.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:38:42.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:38:42.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:38:42.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:38:42.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:38:42.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:38:42.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:38:42.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:38:42.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:38:42.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:38:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:38:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.13287722600001, 2020-06-12T02:38:42.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:38:42.317 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.317 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.317 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:42.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:38:42.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:38:42.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:38:42.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:38:42.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:38:42.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:38:42.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:38:42.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:38:42.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:38:42.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:38:42.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:38:42.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:38:42.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:38:42.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:38:42.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:38:42.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:38:42.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:38:42.329 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.329 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.329 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.330 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:38:42.330 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:42.331 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.12182739299999, 2020-06-12T02:38:42.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:38:42.331 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.331 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.331 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:42.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:42.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:38:42.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:38:42.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:38:42.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:38:42.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:38:42.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:38:42.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:38:42.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:38:42.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:38:42.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:38:42.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:38:42.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:38:42.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:38:42.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:38:42.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:38:42.342 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:38:42.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:38:42.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.343 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.343 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.344 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:42.344 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:42.344 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.11761437600001, 2020-06-12T02:38:42.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:38:42.345 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.345 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.346 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.346 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:38:42.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.347 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:42.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:38:42.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:38:42.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:38:42.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:38:42.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:38:42.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:38:42.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:38:42.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:38:42.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.354 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:38:42.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:38:42.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.354 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.355 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:38:42.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:38:42.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:38:42.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:38:42.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:38:42.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:38:42.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:38:42.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:38:42.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:38:42.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:38:42.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.360 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.360 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.361 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:42.361 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:42.361 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.11743117699999, 2020-06-12T02:38:42.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:38:42.362 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.362 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.362 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:38:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:42.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:42.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:38:42.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:38:42.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:38:42.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:38:42.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:38:42.369 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.370 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:38:42.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:38:42.370 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.370 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.370 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.371 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:38:42.371 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:38:42.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.371 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:42.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:38:42.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:38:42.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:38:42.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:38:42.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:42.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:38:42.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:38:42.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:38:42.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:38:42.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:38:42.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:38:42.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.378 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.378 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.379 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:38:42.379 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:42.379 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 146.66051313299999, 2020-06-12T02:38:42.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:38:42.380 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.380 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.380 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.381 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.381 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:42.381 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.382 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.382 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.382 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.382 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:42.383 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:38:42.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.383 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.383 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:38:42.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:38:42.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:38:42.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:38:42.385 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.385 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.386 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.386 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:38:42.386 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:38:42.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:38:42.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:38:42.388 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:38:42.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:38:42.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.389 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:38:42.389 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:38:42.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.390 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.390 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:38:42.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:38:42.391 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:38:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:38:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:38:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.130051536, 2020-06-12T02:38:42.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:38:42.394 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.394 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.394 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.394 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.395 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.395 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:38:42.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.395 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.395 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.396 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:42.396 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.396 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:42.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:38:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:38:42.398 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:38:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.399 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:38:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:38:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:38:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:38:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.401 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.402 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:38:42.402 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:38:42.402 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.403 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.403 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:38:42.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:38:42.403 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.403 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.404 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.404 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:38:42.404 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:38:42.404 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.404 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.405 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.405 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:38:42.405 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:38:42.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.405 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.407 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:38:42.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:38:42.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:38:42.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:38:42.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.409 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.409 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.409 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.410 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:38:42.410 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:42.410 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.129792417, 2020-06-12T02:38:42.410 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:38:42.411 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.411 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.411 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:42.413 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.413 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:42.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:38:42.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.414 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.414 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:38:42.415 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:38:42.415 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:38:42.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:38:42.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.416 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:38:42.417 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:38:42.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.417 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.418 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.418 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:38:42.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:38:42.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.419 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:38:42.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:38:42.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:42.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:38:42.420 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:38:42.420 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.421 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:38:42.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:38:42.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.422 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:42.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:38:42.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:38:42.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.423 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:38:42.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:38:42.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.424 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.424 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:38:42.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:38:42.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.425 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.426 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.426 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:38:42.426 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:38:42.426 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.427 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.427 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.427 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.428 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.428 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:42.429 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:42.430 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:42.429+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:42.531 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:42.525+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:42.589 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:42.590 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:42.590 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:42.590 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:42.600 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:42.631 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:42.630+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:42.733 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:42.730+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:42.757 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:42.757 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:42.757 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:42.758 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:42.758 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:42.765 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:42.834 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:42.830+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:42.876 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:42.876 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:42.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:42.877 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:42.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.877 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:42.877 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:42.877 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 191.72704250499999, 2020-06-12T02:38:42.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:38:42.878 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.878 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.878 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:38:42.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:38:42.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:38:42.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:38:42.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:38:42.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:38:42.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:38:42.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:38:42.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:38:42.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:38:42.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:38:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:38:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:38:42.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:38:42.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:38:42.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:38:42.889 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:38:42.890 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:42.891 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.58052899399999, 2020-06-12T02:38:42.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:38:42.891 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.891 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:42.891 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:42.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:38:42.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:38:42.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:38:42.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:38:42.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:38:42.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:38:42.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:38:42.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:38:42.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:38:42.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:38:42.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:38:42.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:38:42.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:38:42.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:38:42.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:38:42.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:38:42.905 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.906 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:42.907 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:42.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.90298032000001, 2020-06-12T02:38:42.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:38:42.907 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.907 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.908 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:42.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:38:42.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:38:42.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:38:42.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:38:42.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:38:42.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:38:42.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:38:42.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:38:42.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:38:42.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:38:42.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:42.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:38:42.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:38:42.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:38:42.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:38:42.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:38:42.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:38:42.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:38:42.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:38:42.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:38:42.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:38:42.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:38:42.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:38:42.928 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.929 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.929 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.929 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.90221639200001, 2020-06-12T02:38:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:38:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.930 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:38:42.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:38:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:38:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:38:42.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:38:42.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:38:42.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:38:42.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:38:42.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:38:42.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:38:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:38:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:38:42.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:38:42.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:42.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:38:42.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:38:42.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:38:42.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:38:42.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:42.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:38:42.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:38:42.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:38:42.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:38:42.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:38:42.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:38:42.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:38:42.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:38:42.948 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.948 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.949 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.949 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.679411337, 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.951 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:38:42.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:42.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:38:42.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:38:42.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:38:42.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:38:42.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:38:42.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:38:42.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:38:42.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:38:42.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:38:42.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:38:42.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:38:42.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:38:42.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:38:42.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:38:42.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:38:42.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:38:42.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:38:42.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:38:42.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:38:42.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:38:42.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.966 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.968 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:42.968 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:42.969 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.67112505, 2020-06-12T02:38:42.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:38:42.969 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.969 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.969 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.970 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.970 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:38:42.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.970 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:42.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:38:42.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:38:42.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:38:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:38:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:38:42.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:38:42.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:42.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:38:42.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:38:42.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:38:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:38:42.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:42.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:38:42.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:38:42.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:42.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:38:42.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:38:42.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:42.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:38:42.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:38:42.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:42.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:38:42.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:38:42.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:42.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:38:42.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:38:42.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:42.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:38:42.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:38:42.990 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.990 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:42.990 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:42.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.991 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:42.991 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:42.992 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.66409580600001, 2020-06-12T02:38:42.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:38:42.992 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:42.992 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:42.994 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:42.994 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:42.994 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:42.994 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:38:42.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.995 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:42.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:42.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:42.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:42.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:38:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:38:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:42.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:38:42.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:38:42.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:42.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:42.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:38:42.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:38:42.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:42.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:38:43.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:38:43.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:38:43.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:38:43.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:38:43.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:38:43.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:38:43.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:38:43.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:38:43.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:38:43.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:38:43.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:38:43.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:38:43.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:38:43.007 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.007 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.008 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.008 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:38:43.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:43.009 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 158.66395835500001, 2020-06-12T02:38:43.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:38:43.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.010 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.010 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.010 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:38:43.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.011 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:43.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:38:43.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:38:43.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:38:43.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:38:43.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:38:43.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:38:43.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:38:43.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:38:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:38:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:38:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:38:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:38:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:38:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:38:43.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:38:43.021 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.021 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.021 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 153.86317061599999, 2020-06-12T02:38:43.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:38:43.023 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.023 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.023 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.024 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:38:43.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.024 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:43.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:38:43.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:38:43.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:38:43.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:38:43.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:38:43.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:38:43.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:38:43.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:43.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:38:43.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:38:43.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:43.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:38:43.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:38:43.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:38:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:38:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:38:43.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:38:43.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:38:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:38:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:38:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:38:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.039 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:38:43.039 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:43.039 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 153.863024002, 2020-06-12T02:38:43.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.040 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:38:43.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.041 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:38:43.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:38:43.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:38:43.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:38:43.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:38:43.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:38:43.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:38:43.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:38:43.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:43.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:38:43.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:38:43.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:38:43.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:38:43.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:38:43.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:38:43.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:38:43.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:38:43.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:38:43.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:38:43.057 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.058 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.90701112799999, 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.059 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.060 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:43.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:38:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:38:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:38:43.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:38:43.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:38:43.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:38:43.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:38:43.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:38:43.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:38:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:38:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:38:43.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:38:43.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:38:43.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:38:43.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.073 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.073 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:43.073 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.90127961499999, 2020-06-12T02:38:43.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:38:43.073 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.074 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.074 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.074 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.074 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.074 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:43.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:38:43.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:38:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:38:43.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:38:43.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:38:43.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:38:43.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:38:43.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:38:43.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:38:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:38:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:38:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:38:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:38:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:38:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.90078609899999, 2020-06-12T02:38:43.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:38:43.088 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.088 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.088 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.089 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:38:43.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:38:43.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:38:43.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:38:43.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:38:43.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:38:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:38:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:38:43.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:38:43.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:38:43.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:38:43.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:38:43.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:38:43.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:38:43.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:38:43.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:38:43.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:38:43.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.100 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.101 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.101 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:43.101 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:43.102 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.90069209200001, 2020-06-12T02:38:43.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:38:43.102 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.102 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.102 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.103 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.103 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:38:43.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.103 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:38:43.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:38:43.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:38:43.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:38:43.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:38:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:38:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:38:43.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:38:43.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:43.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:38:43.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:38:43.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:38:43.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:38:43.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:38:43.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.114 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:38:43.115 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:43.115 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.86253106300001, 2020-06-12T02:38:43.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:38:43.115 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.115 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:38:43.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:38:43.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:38:43.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:38:43.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:38:43.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:38:43.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:38:43.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:38:43.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:38:43.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:38:43.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:38:43.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:38:43.125 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.125 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.125 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.126 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:43.126 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:43.126 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.82173406999999, 2020-06-12T02:38:43.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:38:43.127 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.127 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.128 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:38:43.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:38:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:38:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:38:43.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:38:43.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:38:43.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:38:43.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:38:43.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:38:43.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:38:43.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:38:43.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:38:43.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:38:43.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.137 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.138 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:43.138 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:43.138 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.82149200399999, 2020-06-12T02:38:43.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:38:43.139 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.139 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.139 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.141 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:43.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.142 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:38:43.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:38:43.142 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.142 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:38:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:38:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:38:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:38:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:38:43.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:38:43.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:38:43.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:38:43.148 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.149 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.149 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.149 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:38:43.150 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:43.150 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.82128231300001, 2020-06-12T02:38:43.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:38:43.150 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.150 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.151 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:43.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:38:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:38:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:38:43.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:38:43.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:38:43.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:38:43.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:38:43.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:38:43.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:38:43.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:38:43.160 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.160 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.160 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.161 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:38:43.161 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:43.161 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 141.80574815200001, 2020-06-12T02:38:43.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:38:43.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.163 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:38:43.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:38:43.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:38:43.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:38:43.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:38:43.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:38:43.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:38:43.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:38:43.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:38:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:38:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:38:43.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:38:43.171 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.171 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:43.172 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 132.90768811800001, 2020-06-12T02:38:43.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:38:43.173 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.173 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.174 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.174 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:38:43.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.174 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:38:43.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:38:43.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:38:43.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:38:43.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:38:43.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:38:43.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:38:43.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:38:43.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:38:43.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:38:43.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:38:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:38:43.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.183 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.183 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.184 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:43.185 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:43.182+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:43.185 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:43.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:43.281+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:43.304 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:43.304 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:43.305 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:43.314 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:43.400 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:43.397+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:43.404 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:38:43.468 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:43.468 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:43.468 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:43.468 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:43.469 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:43.477 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:43.516 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:43.506+0000 7f69bacd4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:43.520 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:43.517+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:43.521 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:43.518+0000 7f69b9a72700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:43.591 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:43.585+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:43.637 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:43.637 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:43.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:43.638 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:43.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.638 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:43.638 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:43.638 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 193.51146747000001, 2020-06-12T02:38:43.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:43.639 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.639 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.639 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.640 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.640 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.640 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:43.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.640 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:43.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:43.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:43.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:43.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:43.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:43.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:43.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:43.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:43.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:43.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:43.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:43.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:43.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:43.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:43.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:43.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:43.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:43.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:43.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.657 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.657 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.658 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:43.658 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:43.659 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 193.511328534, 2020-06-12T02:38:43.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:43.659 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.659 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.659 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.660 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.660 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.660 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:43.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.660 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:43.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:43.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:43.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:43.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:43.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:43.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:43.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:43.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:43.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:43.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:43.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:43.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:43.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:43.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:43.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:43.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:43.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:43.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:43.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:43.678 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:43.679 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 193.51119269599999, 2020-06-12T02:38:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.681 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.681 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:43.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.681 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:43.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:43.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:43.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:43.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:43.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:43.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:43.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:43.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:43.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:43.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:43.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:43.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:43.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:43.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:43.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:43.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:43.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:43.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:43.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:43.695 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.695 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.696 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.696 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:43.696 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:43.697 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 192.48752784800001, 2020-06-12T02:38:43.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:43.697 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.697 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:43.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:43.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:43.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:43.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:43.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:43.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:43.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:43.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:43.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:43.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:43.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:43.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:43.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:43.707 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.707 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.708 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 184.44008393799999, 2020-06-12T02:38:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.710 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:43.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.711 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:43.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:43.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:43.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:43.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:43.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:43.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:43.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:43.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:43.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:43.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:43.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:43.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:43.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:43.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:43.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:43.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:43.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:43.724 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.724 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.725 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.725 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:43.725 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.696346895, 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:43.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:43.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:43.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:43.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:43.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:43.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:43.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:43.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:43.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:43.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:43.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.736 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.737 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:43.737 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:43.737 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.69537352500001, 2020-06-12T02:38:43.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:43.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:43.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:43.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:43.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:43.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:43.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:43.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:43.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:43.747 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.747 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:43.748 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.69416440500001, 2020-06-12T02:38:43.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:43.749 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.749 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:43.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:43.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:43.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:43.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:43.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:43.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:43.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:43.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:43.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:43.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:43.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:43.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:43.760 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:43.760 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.69290142, 2020-06-12T02:38:43.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:43.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:43.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:43.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:43.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:43.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:43.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:43.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:43.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:43.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:43.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:43.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:43.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:43.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:43.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:43.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.770 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.771 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.771 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:43.771 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:43.772 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 157.681443293, 2020-06-12T02:38:43.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:43.772 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.772 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.772 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:43.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:43.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:43.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:43.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:43.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:43.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:43.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:43.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:43.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:43.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.782 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.782 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 157.67844225299999, 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.783 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.784 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:43.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:43.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:43.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:43.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:43.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:43.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:43.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:43.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:43.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:43.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:43.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:43.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:43.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.65561625399999, 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.795 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:43.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:43.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:43.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:43.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:43.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:43.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:43.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:43.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:43.807 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.808 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.808 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:43.810 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.65547086199999, 2020-06-12T02:38:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.811 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.824 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.825 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.62332958299999, 2020-06-12T02:38:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:43.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:43.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:43.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:43.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:43.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:43.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:43.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:43.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:43.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:43.841 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.618202948, 2020-06-12T02:38:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.855 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:43.856 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.61782393799999, 2020-06-12T02:38:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.857 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.858 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:43.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:43.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:43.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:43.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:43.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:43.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:43.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:43.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:43.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.875 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.617606483, 2020-06-12T02:38:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:43.876 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:43.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:43.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:43.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:43.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:43.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:43.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:43.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:43.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.893 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:43.894 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.253664238, 2020-06-12T02:38:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.895 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:43.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:43.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:43.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:43.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:43.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:43.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:43.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:43.907 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.66461145100001, 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 143.661577878, 2020-06-12T02:38:43.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:43.922 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:43.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:43.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:43.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:43.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:43.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:43.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:43.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:43.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:43.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:43.938 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:43.939 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:43.940 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:43.942 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:43.941+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:43.943 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:44.042 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:44.038+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:44.056 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:44.054+0000 7fd3b0bd2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:44.063 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:44.062+0000 7fd3b0bd2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:44.094 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:44.098 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:44.099 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:44.099 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:44.108 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:44.115 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:44.139 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:44.156 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:44.153+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:44.164 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:44.189 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:44.215 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:44.215 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:44.215 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:44.217 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:44.217 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:44.225 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:44.239 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:44.239 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.240 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.241 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:44.242 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:44.243 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:44.287 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:44.286+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:44.347 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:44.341+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:44.376 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:44.377 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:44.386 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:44.411 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:38:44.476 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:44.470+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:44.497 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:44.498 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:44.507 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:44.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:44.549+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:44.650 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:44.646+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:44.671 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:44.752 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:44.745+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:44.825 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:44.825 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:44.835 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:44.858 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:44.853+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:44.940 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:44.940 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:44.950 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:44.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:44.949+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:45.054 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:45.049+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:45.059 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.059 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.068 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:45.155 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:45.154+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:45.167 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.168 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.177 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:45.257 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:45.253+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:45.331 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.332 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.342 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:45.357 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:45.357+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:45.452 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.452 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.458 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:45.458+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:45.461 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:45.560 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:45.557+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:45.609 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.610 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.619 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:45.661 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:45.658+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:45.735 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.735 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.745 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:45.761 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:45.758+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:45.849 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.849 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.858 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:45.862 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:45.862+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:45.964 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:45.964 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:45.965 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:45.961+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:45.973 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:46.073 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:46.070+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:46.127 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:46.127 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:46.137 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:46.184 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:46.181+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:46.243 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:46.245 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:46.245 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:46.254 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:46.296 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:46.293+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:46.356 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:46.350+0000 7f0f0982a700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:46.370 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:46.362+0000 7f0f03fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:46.377 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:46.373+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:46.396 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:46.408 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:46.408 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:46.413 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:46.417 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:46.424 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:38:46.503 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:46.497+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:46.530+0000 7f108a2b2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:46.542+0000 7f1089050700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:46.569 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:46.569 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:46.583 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:46.584 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:46.582+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:46.645 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:46.670 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:46.683 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:46.682+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:46.693 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:46.718 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:46.733 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:46.733 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:46.734 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:46.734 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:46.734 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:46.748 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:46.750 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:46.751 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.751 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.751 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:46.752 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.753 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:46.754 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:46.755 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:46.794 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:46.794+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:46.865 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:46.866 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:46.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:46.867 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:46.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.867 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:46.868 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:46.868 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 196.74014708600001, 2020-06-12T02:38:46.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:38:46.869 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.869 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:46.869 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:46.870 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:46.870 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:46.870 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:38:46.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.871 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:46.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:38:46.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:38:46.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:38:46.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:38:46.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:38:46.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:38:46.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:38:46.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:38:46.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:38:46.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:38:46.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:38:46.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:38:46.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:46.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:38:46.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:38:46.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:38:46.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:38:46.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:46.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:38:46.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:38:46.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:38:46.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:38:46.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:38:46.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:38:46.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:46.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:38:46.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:38:46.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:38:46.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:38:46.895 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.896 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.896 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.897 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:46.898 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:46.898 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 196.74000814999999, 2020-06-12T02:38:46.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:38:46.899 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.899 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:46.899 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:46.900 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:46.900 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:46.900 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:38:46.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.901 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:46.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:38:46.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:38:46.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:38:46.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:38:46.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:38:46.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:38:46.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:38:46.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:38:46.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:46.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:38:46.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:38:46.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:38:46.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:38:46.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:38:46.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:38:46.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:38:46.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:38:46.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:46.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:38:46.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:38:46.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:38:46.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:38:46.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.915 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 196.73987231199999, 2020-06-12T02:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:38:46.917 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.917 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:46.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:46.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:46.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:46.918 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:38:46.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.918 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:46.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:38:46.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:38:46.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:38:46.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:38:46.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:38:46.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:38:46.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:38:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:38:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:38:46.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:38:46.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:46.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:38:46.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:38:46.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:38:46.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:38:46.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:46.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:38:46.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:38:46.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:38:46.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:38:46.936 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:38:46.937 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:46.938 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.71620746400001, 2020-06-12T02:38:46.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:38:46.938 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.938 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:46.938 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:38:46.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:38:46.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:38:46.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:38:46.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:38:46.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:38:46.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:38:46.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:38:46.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:38:46.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:38:46.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:38:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:38:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:38:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:38:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:38:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:38:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:38:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:38:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:38:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.66876355400001, 2020-06-12T02:38:46.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:38:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:46.956 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:46.957 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:38:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:38:46.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:38:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:38:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:38:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:38:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:38:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:38:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:38:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:38:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:38:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:38:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:38:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:38:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:38:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:38:46.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:38:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:38:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:38:46.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:38:46.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:38:46.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:46.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:38:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:38:46.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:38:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:38:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.979 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.981 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.925026511, 2020-06-12T02:38:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:38:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.982 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:46.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:38:46.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:38:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:38:46.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:38:46.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:38:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:38:46.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:38:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:38:46.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:38:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:38:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:38:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:38:46.992 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.993 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.924053141, 2020-06-12T02:38:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:38:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:46.994 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:46.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:38:46.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:38:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:38:46.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:38:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:46.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:38:46.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:38:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:38:47.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:38:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:38:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:38:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:38:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:38:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:38:47.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:38:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:38:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.922844021, 2020-06-12T02:38:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:38:47.006 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:47.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:38:47.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:38:47.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:38:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:38:47.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:38:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:38:47.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:38:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:38:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:38:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:38:47.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:38:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:38:47.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:38:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:38:47.016 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.017 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:38:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.92158103599999, 2020-06-12T02:38:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:38:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.018 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:38:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:38:47.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:38:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:38:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:38:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:38:47.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:38:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:38:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:38:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:38:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:38:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:38:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:38:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:38:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.028 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:38:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:47.029 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 160.91012290899999, 2020-06-12T02:38:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:38:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:38:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:38:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:38:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:38:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:38:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:38:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:38:47.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:38:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:38:47.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:38:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:38:47.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.040 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:38:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 160.90712186900001, 2020-06-12T02:38:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:38:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.041 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:38:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:38:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:38:47.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:38:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:38:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:38:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:38:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:38:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:38:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:38:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:38:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:38:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:38:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:38:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.88429586999999, 2020-06-12T02:38:47.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:38:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:38:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:38:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:38:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:38:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:38:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:38:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:38:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:38:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:38:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:38:47.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:38:47.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:38:47.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:38:47.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:38:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:38:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:38:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:38:47.068 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.071 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.88415047800001, 2020-06-12T02:38:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:38:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.073 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:38:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.074 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:38:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:38:47.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:38:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:38:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:38:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:38:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:38:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:38:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:38:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:38:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:38:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:38:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:38:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:38:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:47.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:38:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:38:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:38:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:38:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:38:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:38:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.087 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:47.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.85200919900001, 2020-06-12T02:38:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:38:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:38:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:38:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:38:47.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:38:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:38:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:38:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:38:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:38:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:38:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:38:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:38:47.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:38:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:38:47.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:38:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:38:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:38:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:38:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:38:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:38:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:38:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:38:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.103 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:47.104 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.846882564, 2020-06-12T02:38:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:38:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.105 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:38:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.106 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:38:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:38:47.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:38:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:38:47.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:38:47.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:38:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:38:47.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:38:47.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:38:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:38:47.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:38:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:38:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:38:47.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:38:47.119 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.120 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.84650355400001, 2020-06-12T02:38:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:38:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.121 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:38:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:38:47.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:38:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:38:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:38:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:38:47.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:38:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:38:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:38:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:38:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:38:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:38:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:38:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:38:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:38:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:38:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:38:47.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.141 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:38:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:38:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:38:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:38:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.145 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:47.146 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.846286099, 2020-06-12T02:38:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:38:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.147 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:38:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.148 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:38:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:38:47.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:38:47.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:38:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:38:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:38:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:38:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:38:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:38:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:38:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:38:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:38:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:38:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:38:47.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:38:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:38:47.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:38:47.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:38:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.48234385399999, 2020-06-12T02:38:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:38:47.162 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.163 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:38:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:38:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:38:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:38:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:38:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:38:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:38:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:38:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:38:47.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:38:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:38:47.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:38:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:38:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:38:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:38:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.173 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 146.89329106700001, 2020-06-12T02:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 146.890257494, 2020-06-12T02:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.190 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:38:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:47.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:38:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:38:47.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:38:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:38:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:38:47.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:38:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:38:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:38:47.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:38:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:38:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:38:47.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:38:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.203 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:38:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:38:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:38:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:38:47.206 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:38:47.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:38:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:38:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:38:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:38:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:38:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:38:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:38:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.211 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.212 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.212 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:47.214 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:47.214+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:47.214 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:47.315 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:47.314+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:47.331 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:47.332 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:47.332 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:47.332 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:47.341 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:47.416 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:47.414+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:38:47.454 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:47.455 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:47.456 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:47.471 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:47.516 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:47.514+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:47.580 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:47.581 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:47.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:47.581 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:47.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.582 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:38:47.582 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:47.582 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 183.33062314, 2020-06-12T02:38:47.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:38:47.582 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.583 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.583 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.583 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:47.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:38:47.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:38:47.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:38:47.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:38:47.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:38:47.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:38:47.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:38:47.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:38:47.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:38:47.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:38:47.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:38:47.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:38:47.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:38:47.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:38:47.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:38:47.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:38:47.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:38:47.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:38:47.604 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.605 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.605 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.605 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:38:47.606 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:47.606 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 183.32920608800001, 2020-06-12T02:38:47.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:38:47.607 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.607 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.607 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.608 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.608 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:38:47.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.608 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:47.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:38:47.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:38:47.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:38:47.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:38:47.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:38:47.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:38:47.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:38:47.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:38:47.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:38:47.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:38:47.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:38:47.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:38:47.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.618 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.619 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:47.619 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.61864209999999, 2020-06-12T02:38:47.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:38:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.621 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:38:47.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.621 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:38:47.623 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:38:47.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:38:47.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:38:47.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.624 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:38:47.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:38:47.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:38:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:38:47.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:38:47.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:38:47.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:38:47.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:38:47.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:38:47.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:38:47.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:38:47.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:38:47.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:38:47.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:38:47.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:38:47.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:38:47.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:38:47.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:38:47.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.635 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.636 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.636 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:47.636 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.61096079800001, 2020-06-12T02:38:47.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:38:47.636 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.637 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.637 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.637 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:47.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:38:47.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:38:47.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:38:47.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:38:47.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:38:47.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:38:47.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:38:47.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:38:47.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:38:47.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:38:47.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:38:47.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:38:47.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:38:47.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:38:47.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:38:47.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:38:47.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:38:47.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:38:47.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:38:47.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:38:47.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:38:47.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:38:47.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.654 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.654 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:47.654 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.601905501, 2020-06-12T02:38:47.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:38:47.655 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.655 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.655 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.656 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:38:47.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.656 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:47.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:38:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:38:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:38:47.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:38:47.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:38:47.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:38:47.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:38:47.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:38:47.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:38:47.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:38:47.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:38:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:38:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:38:47.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:38:47.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:38:47.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:38:47.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:38:47.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:38:47.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:38:47.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:38:47.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.670 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.671 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:47.671 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.600965962, 2020-06-12T02:38:47.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:38:47.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.672 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.672 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.673 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:38:47.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.673 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:47.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:38:47.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:38:47.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:38:47.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:38:47.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:38:47.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:38:47.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:38:47.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:38:47.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:38:47.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:38:47.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:38:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:38:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:38:47.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:38:47.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:38:47.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:38:47.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:38:47.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:38:47.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:38:47.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:38:47.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.687 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.688 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:47.688 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:47.688 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.600834015, 2020-06-12T02:38:47.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:38:47.689 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.689 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:47.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:38:47.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:38:47.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:38:47.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:38:47.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:38:47.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:38:47.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:38:47.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:38:47.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:38:47.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:38:47.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:38:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:38:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:38:47.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:38:47.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:38:47.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:38:47.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:38:47.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:38:47.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.704 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.704 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:47.704 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.593161718, 2020-06-12T02:38:47.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:38:47.705 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.705 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.705 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:47.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:38:47.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:38:47.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:38:47.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:38:47.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:38:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:38:47.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:38:47.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:38:47.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:38:47.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:38:47.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:38:47.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:38:47.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:38:47.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:38:47.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:38:47.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:38:47.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.719 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.719 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:47.719 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.587186753, 2020-06-12T02:38:47.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:38:47.720 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.720 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.720 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.721 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.721 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:38:47.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.721 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:38:47.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:38:47.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:38:47.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:47.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:38:47.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:47.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:38:47.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:38:47.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:38:47.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:38:47.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:38:47.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:38:47.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:38:47.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:38:47.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:38:47.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:38:47.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:38:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:38:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:47.736 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.580355191, 2020-06-12T02:38:47.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:38:47.737 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.737 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.737 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.738 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.738 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:38:47.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.738 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:47.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:38:47.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:38:47.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:38:47.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:38:47.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:38:47.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:38:47.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:38:47.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:38:47.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:38:47.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:38:47.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:38:47.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:38:47.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:38:47.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:38:47.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:38:47.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:38:47.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:38:47.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:38:47.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:38:47.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:38:47.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.759 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:38:47.759 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:47.759 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.57967224199999, 2020-06-12T02:38:47.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:38:47.760 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.760 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.761 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:38:47.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:38:47.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:38:47.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:38:47.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:38:47.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:38:47.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:38:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:38:47.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:38:47.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:38:47.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:38:47.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:38:47.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:38:47.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:38:47.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:38:47.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:38:47.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:38:47.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:38:47.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:38:47.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.775 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.775 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.776 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:38:47.776 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:47.776 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.57958547999999, 2020-06-12T02:38:47.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:38:47.776 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.777 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.777 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.777 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.777 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.777 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:38:47.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.778 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:38:47.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:38:47.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:38:47.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:38:47.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:38:47.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:38:47.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:38:47.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:38:47.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:38:47.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:38:47.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:38:47.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:38:47.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:38:47.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:38:47.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:38:47.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:38:47.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.791 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:47.791 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:47.791 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.20119187399999, 2020-06-12T02:38:47.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:38:47.792 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.792 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.792 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.793 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:38:47.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.793 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:38:47.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:38:47.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:38:47.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:38:47.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:38:47.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:38:47.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:38:47.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:38:47.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:38:47.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:38:47.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:38:47.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:38:47.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:38:47.802 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:47.803 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.178769937, 2020-06-12T02:38:47.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:38:47.803 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.803 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.803 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.804 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.804 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:38:47.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.804 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:38:47.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:38:47.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:47.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:38:47.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:38:47.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:38:47.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:38:47.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:38:47.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:38:47.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:38:47.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:38:47.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:38:47.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.815 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:38:47.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:38:47.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.816 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.33279524100001, 2020-06-12T02:38:47.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:38:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:38:47.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:38:47.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:38:47.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:38:47.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:38:47.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:38:47.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:38:47.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:38:47.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:38:47.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:38:47.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:38:47.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:38:47.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:38:47.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:38:47.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.830 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.830 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:38:47.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:38:47.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:38:47.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:38:47.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.832 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.833 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:47.833 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:47.833 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.331978077, 2020-06-12T02:38:47.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:38:47.834 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.834 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:47.834 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.834 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:47.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:38:47.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:38:47.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:38:47.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:38:47.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:38:47.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:38:47.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:38:47.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:38:47.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:38:47.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:38:47.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:38:47.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:47.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:38:47.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:38:47.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:47.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:38:47.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:38:47.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.848 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.849 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:47.849 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:47.850 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.33174143700001, 2020-06-12T02:38:47.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:38:47.850 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.850 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.850 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.851 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.851 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.851 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:38:47.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.852 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:38:47.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:38:47.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:38:47.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:38:47.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:38:47.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:38:47.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:38:47.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:38:47.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:38:47.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:38:47.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:38:47.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:38:47.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:38:47.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:38:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:38:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:38:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:38:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:38:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.864 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.865 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:47.865 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:47.866 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.60624850599999, 2020-06-12T02:38:47.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:38:47.866 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.866 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.866 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:47.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:38:47.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:38:47.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:38:47.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:38:47.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:38:47.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:38:47.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:38:47.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:38:47.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:38:47.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:38:47.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:47.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:38:47.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:38:47.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:38:47.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:38:47.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:38:47.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:38:47.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.878 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.879 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.879 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:38:47.879 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:47.880 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 147.605967693, 2020-06-12T02:38:47.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:38:47.880 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.880 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.880 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.881 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.881 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.881 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:38:47.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.881 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:38:47.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:38:47.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:38:47.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:38:47.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:38:47.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:38:47.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:38:47.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:38:47.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:47.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:38:47.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:38:47.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:38:47.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:38:47.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:38:47.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:38:47.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.892 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.892 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.893 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:38:47.893 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:47.893 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 146.52719645799999, 2020-06-12T02:38:47.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:38:47.893 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:38:47.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.895 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:47.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:47.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:47.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:38:47.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:38:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:38:47.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:47.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:38:47.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:38:47.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:47.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:38:47.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:38:47.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:38:47.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:38:47.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:47.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:38:47.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:38:47.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:47.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:38:47.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:38:47.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:47.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:47.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:38:47.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:38:47.905 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.905 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.905 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.906 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:47.906 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:47.906 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:47.908 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:47.908 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:47.905+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:48.009 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:48.006+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:48.030 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:48.031 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:48.031 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:48.031 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:48.044 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:48.134 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:48.134+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:48.207 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:48.207 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:48.207 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:48.207 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:48.208 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:48.212 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:48.209+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:48.217 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:48.313 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:48.309+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:48.374 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:48.375 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:48.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:48.375 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:48.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:48.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:48.376 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.272911239, 2020-06-12T02:38:48.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:48.376 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.377 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.377 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:48.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.378 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:48.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:48.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:48.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:48.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:48.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:48.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:48.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:48.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:48.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:48.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:48.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:48.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:48.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:48.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:48.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:48.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:48.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:48.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:48.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.413 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.414 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.27274087200001, 2020-06-12T02:38:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:48.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:48.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:48.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:48.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:48.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:48.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:48.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:48.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:48.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.435 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.25460284499999, 2020-06-12T02:38:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.436 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:48.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:48.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:48.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:48.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:48.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.452 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.453 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.24866596199999, 2020-06-12T02:38:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:48.454 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:48.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:48.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:48.476 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.24815689100001, 2020-06-12T02:38:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.477 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:48.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:48.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:48.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:48.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.493 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.24799862500001, 2020-06-12T02:38:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:48.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:48.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:48.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:48.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:48.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:48.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:48.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:48.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 183.17360182300001, 2020-06-12T02:38:48.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.508 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:48.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:48.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:48.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:48.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:48.521 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 183.166591001, 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.522 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.523 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.523 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:48.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.523 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:48.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:48.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:48.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:48.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.534 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 168.40680445800001, 2020-06-12T02:38:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:48.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:48.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:48.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:48.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:48.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:48.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:48.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:48.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 168.40667686200001, 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.555 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:48.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:48.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:48.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:48.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:48.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:48.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.571 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.99169622100001, 2020-06-12T02:38:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:48.576 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:48.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:48.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:48.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:48.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:48.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:48.587 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.991551464, 2020-06-12T02:38:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.588 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:48.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:48.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:48.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.598 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.99142061399999, 2020-06-12T02:38:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:48.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:48.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.99127629200001, 2020-06-12T02:38:48.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:48.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:48.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:48.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:48.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:48.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:48.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:48.624 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.99116431100001, 2020-06-12T02:38:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.625 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:48.638 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.639 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.991011826, 2020-06-12T02:38:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.641 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:48.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:48.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:48.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:48.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:48.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.97026668800001, 2020-06-12T02:38:48.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:48.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:48.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:48.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:48.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:48.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:48.668 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.96994159400001, 2020-06-12T02:38:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:48.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:48.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:48.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:48.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:48.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:48.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.854295111, 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:48.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:48.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:48.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:48.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:48.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:48.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.697 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:48.698 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 148.853954853, 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:48.699 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:48.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:48.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:48.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:48.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:48.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:48.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:48.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:48.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:48.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:48.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.712 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:48.713 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:48.713 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:48.715 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:48.715 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:48.713+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:48.756 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:48.816 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:48.813+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:48.830 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:48.831 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:48.841 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:48.862+0000 7f4cea78b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:48.868 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:48.866+0000 7f4ce9529700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:48.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:48.917 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:48.913+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:48.925 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:48.944 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:48.945 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:48.945 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:48.955 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:48.970 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:48.999 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:49.019 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:49.018+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:49.037 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:49.065 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:49.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:49.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:49.080 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.080 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.090 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:49.120 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:49.117+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:49.220 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:49.218+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:49.247 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.248 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.257 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:49.321 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:49.317+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:49.411 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.411 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.421 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:49.427 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:49.426+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:49.442 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:38:49.528 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:49.525+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.532 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.555 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:49.587 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:49.574+0000 7ff492b65700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:49.590 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:49.590+0000 7ff491903700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:49.630 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:49.625+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:49.671 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.672 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.681 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:49.768 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:49.765+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:49.831 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:49.830+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:49.835 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.836 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:49.845 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:49.932 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:49.929+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.012 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:50.033 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:50.030+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:50.134 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:50.129+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:50.164 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.164 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.174 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:50.264 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:50.261+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:50.332 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.332 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.336 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:50.334+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:50.342 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:50.434 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:38:50.437 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:50.434+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:50.494 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.494 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.503 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:50.539 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:50.538+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:50.611 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.612 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.621 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:50.672 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:50.669+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:50.724 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.725 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.734 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:50.742 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:50.742+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:50.842 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:50.837+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:50.885 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:50.885 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:50.894 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:50.980 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:50.977+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:51.046 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:51.047 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:51.052 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:51.045+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:51.056 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:51.073 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:51.152 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:51.149+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:51.190 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:51.182+0000 7fcc95b7b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:51.192 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:51.190+0000 7fcc94919700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:51.211 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:51.211 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:51.218 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:51.230 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:51.250 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:51.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:51.257+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:51.270 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:51.295 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:51.321 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:51.348 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:51.355 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:51.353+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:51.370 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:51.371 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:51.374 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:51.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.375 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.376 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:51.376 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:51.377 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.377 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.377 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.378 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.378 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:51.379 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:51.380 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:51.384 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:51.463 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:51.458+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:51.500 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:51.501 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:51.501 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:51.502 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:51.512 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:51.565 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:51.557+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:51.661 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:51.661 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:51.662 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:51.662 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:51.662 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:51.664 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:51.662+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:51.670 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:51.766 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:51.762+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:51.832 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:51.832 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:51.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:51.832 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:51.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.833 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:51.833 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:51.833 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.73185072199999, 2020-06-12T02:38:51.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:38:51.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.834 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:51.834 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.835 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.835 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.835 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:51.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:38:51.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:38:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:38:51.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:38:51.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:38:51.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:38:51.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:38:51.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:38:51.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:38:51.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:38:51.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:38:51.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:38:51.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:51.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:38:51.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:38:51.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:51.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:38:51.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:38:51.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:51.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:38:51.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:38:51.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.861 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:51.861 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:51.861 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.73168035500001, 2020-06-12T02:38:51.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:38:51.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.862 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:51.862 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.863 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:38:51.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.863 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:51.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:38:51.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:38:51.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:38:51.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:38:51.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:38:51.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:38:51.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:38:51.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:38:51.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:38:51.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:38:51.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:38:51.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:38:51.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:51.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:38:51.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:38:51.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:51.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:38:51.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:38:51.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:38:51.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:38:51.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:38:51.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:38:51.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:38:51.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:38:51.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.885 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.886 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:51.886 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:51.886 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.71354232799999, 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.891 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:38:51.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.893 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:38:51.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:38:51.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:38:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:38:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:38:51.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:38:51.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:38:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:38:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:38:51.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:38:51.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:38:51.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:38:51.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:38:51.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:38:51.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:51.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:38:51.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:38:51.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:51.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:38:51.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:38:51.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:38:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:38:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.70760544500001, 2020-06-12T02:38:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:38:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:38:51.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:51.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:38:51.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:38:51.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:38:51.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:38:51.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:38:51.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:38:51.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:38:51.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:38:51.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:38:51.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:38:51.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:38:51.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:38:51.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:51.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:38:51.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:38:51.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:51.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:38:51.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:38:51.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:51.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:38:51.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:38:51.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:38:51.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:38:51.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.928 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.929 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:38:51.929 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:51.929 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.707096374, 2020-06-12T02:38:51.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:38:51.930 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.930 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:51.930 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.930 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.930 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.931 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:38:51.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.931 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:51.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:38:51.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:38:51.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:38:51.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:38:51.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:38:51.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:38:51.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:38:51.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:38:51.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:38:51.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:38:51.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:38:51.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:38:51.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:51.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:38:51.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:38:51.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:51.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:38:51.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:38:51.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:38:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:38:51.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:38:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:38:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.945 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.948 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:38:51.948 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:51.948 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.706938108, 2020-06-12T02:38:51.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:38:51.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.949 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:51.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.949 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:38:51.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.950 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:51.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:38:51.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:38:51.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:38:51.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:38:51.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:38:51.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:38:51.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:38:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:38:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:38:51.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:38:51.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:51.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:38:51.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:38:51.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:38:51.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:38:51.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:38:51.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:38:51.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.964 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:38:51.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:51.965 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 186.63254130600001, 2020-06-12T02:38:51.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:38:51.965 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.965 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:51.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.966 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:38:51.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:38:51.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:38:51.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:38:51.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:38:51.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:38:51.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:38:51.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:51.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:38:51.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:38:51.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:51.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:38:51.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:38:51.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:51.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:38:51.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:38:51.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:51.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:38:51.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:38:51.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:51.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:38:51.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:38:51.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:51.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:38:51.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:38:51.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.978 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:51.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:51.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.979 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:38:51.979 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:51.987 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 186.625530484, 2020-06-12T02:38:51.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:38:51.988 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:51.988 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:51.988 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:51.988 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:51.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:51.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:51.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:51.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:38:51.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:38:51.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:51.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:38:51.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:38:51.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:51.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:51.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:51.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:38:51.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:38:51.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:38:52.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:38:52.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:38:52.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:38:52.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:38:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:38:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:38:52.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:38:52.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:38:52.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:38:52.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:38:52.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:38:52.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.016 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.016 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.016 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:52.017 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:52.017 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 171.86574394100001, 2020-06-12T02:38:52.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:38:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.018 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.019 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:38:52.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.019 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:52.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:38:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:38:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:38:52.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:38:52.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:38:52.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:38:52.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:38:52.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:38:52.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:38:52.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:38:52.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:38:52.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:38:52.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:38:52.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:38:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:38:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:38:52.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:38:52.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:38:52.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:38:52.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:38:52.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:38:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:38:52.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:38:52.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:38:52.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:38:52.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:38:52.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:38:52.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:38:52.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.056 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.057 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:52.071 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:52.072 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 171.86561634500001, 2020-06-12T02:38:52.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:38:52.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.072 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.073 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.073 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.073 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:38:52.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.073 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:52.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:38:52.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:38:52.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:38:52.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:38:52.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:38:52.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:38:52.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:38:52.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:38:52.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:38:52.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:38:52.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:38:52.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:38:52.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:38:52.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:38:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:38:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:38:52.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:38:52.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:38:52.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:38:52.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:38:52.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:38:52.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:38:52.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:38:52.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:38:52.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:38:52.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:38:52.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:38:52.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.093 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:52.093 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.45063570400001, 2020-06-12T02:38:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:38:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:52.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:38:52.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:38:52.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:38:52.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:38:52.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:38:52.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:38:52.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:38:52.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:38:52.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:38:52.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:38:52.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:38:52.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:38:52.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:38:52.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:38:52.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:52.106 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:52.106 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.45049094699999, 2020-06-12T02:38:52.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:38:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.107 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:52.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:38:52.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:38:52.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:38:52.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:38:52.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:38:52.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:38:52.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:38:52.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:38:52.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:38:52.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:38:52.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:38:52.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:38:52.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:38:52.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:38:52.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.45036009699999, 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:38:52.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.122 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:38:52.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.124 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:52.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:38:52.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:38:52.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:38:52.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:38:52.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:38:52.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:38:52.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:38:52.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:38:52.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:38:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:38:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:38:52.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:38:52.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:38:52.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:38:52.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.134 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.135 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:52.135 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:52.136 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.450215775, 2020-06-12T02:38:52.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:38:52.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.136 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.136 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.137 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.137 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.137 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:38:52.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.138 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:52.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:38:52.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:38:52.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:38:52.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:38:52.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:38:52.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:38:52.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:38:52.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:38:52.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:38:52.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:38:52.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:38:52.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:38:52.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:38:52.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:38:52.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:38:52.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:38:52.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:38:52.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:38:52.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:38:52.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:38:52.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:38:52.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:38:52.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.151 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.152 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:52.152 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:52.152 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.450103794, 2020-06-12T02:38:52.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:38:52.153 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.153 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.154 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:38:52.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.154 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:52.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:38:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:38:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:38:52.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:38:52.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:38:52.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:38:52.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:38:52.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:38:52.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:38:52.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:38:52.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:38:52.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:38:52.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:52.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:38:52.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:38:52.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:38:52.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:38:52.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:38:52.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.169 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:52.169 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:52.169 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.449951309, 2020-06-12T02:38:52.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.170 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:38:52.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.171 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:52.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:38:52.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:38:52.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:38:52.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:38:52.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:38:52.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:38:52.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:38:52.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:38:52.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:38:52.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:38:52.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:38:52.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:38:52.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:38:52.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:38:52.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:38:52.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:38:52.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:38:52.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:38:52.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:52.184 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:52.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.429206171, 2020-06-12T02:38:52.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:38:52.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.185 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.185 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:38:52.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.187 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:52.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:38:52.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:38:52.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:38:52.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:38:52.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:38:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:38:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:38:52.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:38:52.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:38:52.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:38:52.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:38:52.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:38:52.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:38:52.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:38:52.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:38:52.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:38:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:38:52.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:38:52.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:38:52.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:38:52.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.203 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:52.203 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:52.203 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 156.428881077, 2020-06-12T02:38:52.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:38:52.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.204 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.204 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:52.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:38:52.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:38:52.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:38:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:38:52.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:38:52.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:38:52.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:38:52.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:38:52.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:38:52.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:38:52.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:52.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:38:52.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:38:52.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:38:52.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:38:52.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:38:52.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:38:52.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:38:52.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:38:52.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:38:52.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:38:52.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:38:52.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:38:52.219 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:38:52.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:52.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.31323459399999, 2020-06-12T02:38:52.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:38:52.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.222 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.222 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:38:52.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.223 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:52.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:38:52.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:38:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:38:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:38:52.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:38:52.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:38:52.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:38:52.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:38:52.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:38:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:38:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:38:52.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:38:52.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:38:52.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:38:52.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:38:52.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:38:52.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:38:52.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:38:52.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.236 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.236 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:38:52.237 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:52.237 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 152.312894336, 2020-06-12T02:38:52.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:38:52.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:52.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:38:52.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:38:52.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:38:52.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:38:52.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:38:52.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:38:52.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:38:52.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:38:52.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:38:52.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:38:52.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:52.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:38:52.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:38:52.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:38:52.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:38:52.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:38:52.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:38:52.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:38:52.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:38:52.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:38:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:38:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.255 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:52.257 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:52.253+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:52.257 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:52.358 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:52.353+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:52.416 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:52.417 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:52.417 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:52.417 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:52.426 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:52.448 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:38:52.470 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:52.470+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:52.543 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:52.543 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:52.543 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:52.544 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:52.544 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:52.553 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:52.560 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:52.557+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:52.587 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:52.574+0000 7efece202700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:52.597 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:52.590+0000 7efeccfa0700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:52.663 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:52.661+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:52.664 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:52.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 203.941849832, 2020-06-12T02:38:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:52.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.667 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.667 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.667 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.667 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.667 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:52.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:52.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:52.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:52.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:52.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:52.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:52.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:52.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:52.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:52.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:52.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:52.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:52.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:52.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:52.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:52.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 198.51187057999999, 2020-06-12T02:38:52.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:52.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.696 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:52.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:52.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:52.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:52.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:52.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:52.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:52.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:52.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:52.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:52.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:52.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:52.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:52.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:52.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:52.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:52.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:52.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:52.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:52.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:52.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:52.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:52.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:52.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.711 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:52.711 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:52.711 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.39590741500001, 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.712 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.713 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:52.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.714 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:52.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:52.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:52.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:52.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:52.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:52.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:52.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:52.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:52.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:52.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:52.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:52.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:52.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:52.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:52.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:52.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:52.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:52.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:52.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:52.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.728 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.729 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:52.729 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:52.729 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.39553041400001, 2020-06-12T02:38:52.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:52.729 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.730 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:52.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.731 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:52.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:52.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:52.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:52.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:52.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:52.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:52.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:52.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:52.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:52.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:52.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:52.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:52.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:52.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:52.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:52.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:52.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:52.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:52.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.745 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.745 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.745 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.39512087899999, 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.746 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.747 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.747 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.747 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:52.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.747 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:52.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:52.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:52.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:52.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:52.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:52.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:52.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:52.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:52.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:52.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:52.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:52.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:52.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:52.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:52.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:52.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:52.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.759 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.760 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:52.760 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:52.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.39472854799999, 2020-06-12T02:38:52.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:52.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.768 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.768 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.769 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:52.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.769 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:52.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:52.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:52.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:52.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:52.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:52.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:52.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:52.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:52.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:52.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:52.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:52.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:52.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:52.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:52.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:52.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:52.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:52.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:52.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:52.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:52.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:52.786 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.37779412, 2020-06-12T02:38:52.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:52.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.787 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:52.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.788 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:52.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:52.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:52.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:52.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:52.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:52.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:52.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:52.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:52.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:52.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:52.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:52.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:52.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:52.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:52.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:52.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:52.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:52.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.800 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.801 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:52.801 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:52.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.37179952100001, 2020-06-12T02:38:52.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:52.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.803 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:52.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:52.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:52.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:52.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:52.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:52.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:52.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:52.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:52.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:52.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:52.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:52.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:52.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:52.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:52.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:52.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:52.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:52.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:52.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:52.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:52.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:52.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:52.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.817 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.818 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:52.818 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:52.818 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.370662947, 2020-06-12T02:38:52.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:52.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.819 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.819 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.819 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.819 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.819 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:52.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:52.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:52.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:52.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:52.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:52.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:52.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:52.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:52.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:52.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.835 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.835 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:52.836 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:52.836 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.37048085000001, 2020-06-12T02:38:52.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:52.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.837 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.837 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.837 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.837 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:52.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.838 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:52.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:52.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:52.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:52.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:52.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:52.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:52.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:52.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:52.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:52.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:52.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:52.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:52.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:52.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:52.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.852 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:52.853 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:52.854 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 191.72329552799999, 2020-06-12T02:38:52.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:52.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.854 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.855 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.855 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.855 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:52.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:52.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:52.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:52.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:52.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:52.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:52.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:52.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:52.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:52.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:52.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:52.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:52.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:52.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:52.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:52.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:52.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:52.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.868 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:52.868 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:52.868 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 191.72298313900001, 2020-06-12T02:38:52.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:52.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.869 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:52.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.870 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.870 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:52.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.870 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:52.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:52.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:52.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:52.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:52.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:52.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:52.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:52.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:52.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:52.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:52.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:52.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:52.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:52.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:52.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:52.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:52.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:52.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.888 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:52.889 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:52.889 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.711414547, 2020-06-12T02:38:52.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:52.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.890 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.890 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.890 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.891 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.891 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:52.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.891 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:52.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:52.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:52.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:52.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:52.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:52.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:52.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:52.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:52.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:52.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:52.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:52.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:52.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:52.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:52.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:52.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:52.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:52.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:52.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:52.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:52.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:52.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:52.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:52.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:52.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:52.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:52.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:52.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.906 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:52.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.71107508899999, 2020-06-12T02:38:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.908 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.909 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.909 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:52.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:52.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:52.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:52.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:52.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:52.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:52.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:52.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:52.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:52.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:52.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:52.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:52.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:52.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:52.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:52.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:52.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:52.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:52.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:52.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:52.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:52.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:52.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.925 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:52.925 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:52.925 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 178.71077864399999, 2020-06-12T02:38:52.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:52.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.926 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:52.926 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.926 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.926 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.927 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:52.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.927 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:52.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:52.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:52.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:52.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:52.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:52.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:52.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:52.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:52.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:52.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:52.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:52.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:52.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:52.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:52.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:52.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:52.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:52.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:52.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:52.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:52.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:52.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:52.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:52.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:52.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.942 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:52.943 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.673744868, 2020-06-12T02:38:52.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:52.944 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.944 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:52.944 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.944 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.945 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:52.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.945 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:52.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:52.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:52.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:52.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:52.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:52.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:52.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:52.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:52.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:52.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:52.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:52.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:52.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:52.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:52.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:52.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:52.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:52.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:52.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.956 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.957 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:52.957 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:52.957 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.66613842000001, 2020-06-12T02:38:52.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:52.958 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.958 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:52.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.958 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.959 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.959 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:52.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.959 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:52.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:52.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:52.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:52.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:52.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:52.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:52.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:52.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:52.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:52.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:52.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:52.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:52.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:52.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:52.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:52.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:52.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.972 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:52.972 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:52.972 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.66275988199999, 2020-06-12T02:38:52.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:52.973 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.973 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:52.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.974 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.974 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:52.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.974 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:52.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:52.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:52.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:52.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:52.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:52.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:52.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:52.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:52.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:52.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:52.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:52.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:52.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:52.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:52.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:52.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:52.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:52.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:52.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:52.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:52.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:52.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:52.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.985 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:52.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:52.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.986 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:52.986 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:52.986 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.662489628, 2020-06-12T02:38:52.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:52.987 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:52.987 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:52.988 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:52.988 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:52.988 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:52.988 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:52.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.989 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:52.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:52.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:52.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:52.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:52.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:52.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:52.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:52.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:52.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:52.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:52.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:52.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:52.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:52.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:52.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:52.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:52.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:52.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:53.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:53.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:53.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:53.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:53.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:53.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:53.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:53.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:53.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 138.66230850599999, 2020-06-12T02:38:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:53.019 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.019 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:53.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:53.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:53.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:53.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:53.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:53.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:53.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:53.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:53.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:53.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:53.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:53.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.032 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:53.034 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:53.033+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:53.035 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:53.136 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:53.134+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:53.187 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:53.188 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:53.188 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:53.188 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:53.197 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:53.238 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:53.238+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:53.337 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:53.334+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:53.349 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:53.350 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:53.350 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:53.350 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:53.351 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:53.359 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:53.381 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:53.437 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:53.433+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:53.459 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:38:53.515 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:53.510+0000 7fca66513700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:53.517 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:53.514+0000 7fca652b1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:53.520 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 202.398310909, 2020-06-12T02:38:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 202.39808746700001, 2020-06-12T02:38:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 197.35560835800001, 2020-06-12T02:38:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 197.35527346399999, 2020-06-12T02:38:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.15439758100001, 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:53.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.154237768, 2020-06-12T02:38:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:53.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:53.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:53.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:53.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:53.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.15415705500001, 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:53.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:53.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:53.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:53.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:53.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:53.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:53.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:53.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:53.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.625 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:53.626 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.153910502, 2020-06-12T02:38:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.627 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:53.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:53.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:53.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:53.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:53.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.140560179, 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:53.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:53.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:53.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:53.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:53.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:53.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:53.653 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.14037392500001, 2020-06-12T02:38:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.654 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:53.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:53.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:53.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:53.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:53.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:53.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:53.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:53.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:53.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:53.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 158.14017321399999, 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.668 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.669 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:53.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:53.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.547685253, 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.683 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:53.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:53.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:53.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:53.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:53.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.54726150600001, 2020-06-12T02:38:53.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.698 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:53.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:53.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:53.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:53.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:53.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.715 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.54710764800001, 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:53.716 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.717 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.54437686, 2020-06-12T02:38:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:53.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:53.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:53.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:53.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:53.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:53.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:53.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:53.739 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.543956533, 2020-06-12T02:38:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.740 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:53.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.54386170000001, 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:53.751 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.752 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:53.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:53.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:53.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:53.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:53.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:53.764 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 149.51408234600001, 2020-06-12T02:38:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.765 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:53.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:53.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:53.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:53.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:53.779 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.780 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 149.51361673299999, 2020-06-12T02:38:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:53.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:53.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:53.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:53.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:53.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:53.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:53.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 149.513442798, 2020-06-12T02:38:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:53.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:53.798 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:53.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:53.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:53.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:53.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:53.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:53.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:53.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:53.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:53.813 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:53.813 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:53.815 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:53.815 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:53.815 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:53.815 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:53.816 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:53.813+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:53.816 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:53.850 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:53.881 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:53.908 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:53.911 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:53.912 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:53.916 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:53.913+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:53.938 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:53.939 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:53.948 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:54.016 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:54.014+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:54.103 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.104 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.114 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:54.118 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:54.118+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:54.219 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:54.217+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:54.225 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.225 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.235 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:54.321 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:54.318+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:54.385 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.385 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.395 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:54.440 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:54.437+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:54.505 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.506 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.526 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:54.564 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:54.561+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:54.632 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:54.625+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:54.674 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.674 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.683 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:54.734 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:54.730+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:54.835 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:54.829+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:54.837 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.837 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:54.847 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:54.936 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:54.933+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:54.996 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:54.996 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.006 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:55.048 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:55.045+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:55.140 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:55.133+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:55.157 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.158 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.167 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:55.260 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:55.257+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:55.322 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.323 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.337 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:55.352 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:55.350+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:55.455 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:55.454+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:55.466 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:38:55.490 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.490 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.499 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:55.559 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:55.554+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:55.585 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:55.574+0000 7fbfc4cc2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:55.589 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:55.586+0000 7fbfbf59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:55.615 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.616 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.627 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:55.674 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:55.674+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.731 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.741 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:55.760 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:55.753+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:55.860 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:55.858+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:55.891 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:55.892 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:55.906 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:38:55.914 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:38:56.002 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:56.002+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:56.003 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:38:56.065 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:56.061+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:56.073 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:56.062+0000 7f27fac34700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:56.074 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:56.070+0000 7f27f99d2700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:56.074 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:56.075 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:56.085 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:38:56.104 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:56.122 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:56.151 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:56.165 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:56.162+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:56.180 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:56.183 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:56.184 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:56.184 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:56.184 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:56.194 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:38:56.205 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:56.246 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:56.267 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:56.261+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:56.287 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:56.288 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.288 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.288 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.289 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.290 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.290 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:38:56.291 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:56.292 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:56.330 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:56.330 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:56.331 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:56.331 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:56.331 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:56.335 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:38:56.375 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:56.369+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:56.475 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:56.473+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:56.486 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:56.486 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:56.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:56.487 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:56.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:38:56.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:56.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 207.764431229, 2020-06-12T02:38:56.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:38:56.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.489 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:38:56.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:56.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:38:56.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:38:56.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:38:56.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:38:56.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:38:56.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:38:56.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:38:56.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:38:56.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:38:56.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:38:56.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:38:56.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:38:56.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:38:56.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:38:56.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:38:56.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:38:56.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:38:56.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:38:56.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:38:56.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:38:56.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.508 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:38:56.508 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:56.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 202.33445197699999, 2020-06-12T02:38:56.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:38:56.509 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.509 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.509 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.510 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:56.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:38:56.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:38:56.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:38:56.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:38:56.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:38:56.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:56.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:38:56.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:38:56.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:38:56.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:38:56.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:56.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:38:56.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:38:56.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:38:56.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:38:56.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:38:56.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:38:56.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:56.523 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:56.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.218488812, 2020-06-12T02:38:56.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:38:56.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.525 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:38:56.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:38:56.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:38:56.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:38:56.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:38:56.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:38:56.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:38:56.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:38:56.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:38:56.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:38:56.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:38:56.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:38:56.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:38:56.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:38:56.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:38:56.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:38:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:38:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:38:56.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:38:56.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:38:56.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:38:56.539 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.539 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.539 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.540 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:56.541 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:56.541 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.218111811, 2020-06-12T02:38:56.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:38:56.541 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.541 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.542 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.542 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.542 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.542 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:38:56.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:56.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:38:56.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:38:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:38:56.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:38:56.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:38:56.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:38:56.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:38:56.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:38:56.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:38:56.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:38:56.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:56.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:38:56.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:38:56.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:38:56.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:38:56.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:38:56.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:38:56.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:38:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:38:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:38:56.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:38:56.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:38:56.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:38:56.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:56.564 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:56.564 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.21770227600001, 2020-06-12T02:38:56.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:38:56.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.564 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.565 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:38:56.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.566 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:56.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:38:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:38:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:38:56.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:38:56.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:38:56.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:38:56.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:38:56.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:38:56.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:38:56.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:38:56.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:38:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:38:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:38:56.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:38:56.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:38:56.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:38:56.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:38:56.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:38:56.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:38:56.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:38:56.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:38:56.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:38:56.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:56.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:56.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.21730994500001, 2020-06-12T02:38:56.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:38:56.589 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.589 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:38:56.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.590 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:38:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:38:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:38:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:38:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:38:56.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:38:56.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:38:56.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:38:56.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:38:56.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:38:56.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:38:56.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:38:56.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:56.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:38:56.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:38:56.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:38:56.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:38:56.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:38:56.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:38:56.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:38:56.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:38:56.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:38:56.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:38:56.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:38:56.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:38:56.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.609 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:56.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:56.610 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.200375517, 2020-06-12T02:38:56.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:38:56.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.610 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.611 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.611 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:38:56.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.611 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:38:56.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:38:56.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:38:56.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:38:56.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:38:56.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:38:56.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:38:56.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:38:56.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:38:56.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:38:56.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:38:56.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:38:56.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:38:56.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:38:56.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:38:56.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:38:56.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:38:56.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.624 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:56.625 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:56.625 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.19438091800001, 2020-06-12T02:38:56.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:38:56.625 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:38:56.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.627 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:56.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:38:56.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:38:56.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:38:56.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:38:56.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:38:56.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:38:56.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:38:56.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:38:56.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:38:56.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:38:56.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:38:56.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:38:56.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:38:56.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:38:56.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:38:56.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:38:56.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:38:56.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:38:56.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:38:56.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:38:56.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:38:56.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:38:56.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:56.643 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:56.643 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.19324434399999, 2020-06-12T02:38:56.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:38:56.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.644 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.644 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:38:56.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.645 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:56.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:38:56.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:38:56.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:38:56.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:56.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:38:56.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:38:56.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:38:56.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:38:56.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:38:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:38:56.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:38:56.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:38:56.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:38:56.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:38:56.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:38:56.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:38:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:38:56.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:38:56.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:38:56.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:38:56.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:38:56.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 200.193062247, 2020-06-12T02:38:56.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:38:56.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.661 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.661 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.661 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.662 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.662 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:38:56.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.662 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:56.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:38:56.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:38:56.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:38:56.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:38:56.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:38:56.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:38:56.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:38:56.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:38:56.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:38:56.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:38:56.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:38:56.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:38:56.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:38:56.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:38:56.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:38:56.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:38:56.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:38:56.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:38:56.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:38:56.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:38:56.675 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.676 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.676 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.677 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:56.677 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:56.677 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 195.54587692499999, 2020-06-12T02:38:56.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:38:56.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.680 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:38:56.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:56.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:38:56.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:38:56.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:38:56.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:38:56.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:38:56.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:38:56.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:38:56.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:38:56.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:38:56.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:38:56.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:38:56.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:38:56.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:38:56.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:38:56.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:38:56.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:38:56.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:38:56.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:56.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 195.545564536, 2020-06-12T02:38:56.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:38:56.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:56.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.696 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.696 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:38:56.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:56.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:38:56.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:38:56.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:38:56.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:38:56.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:38:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:38:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:38:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:38:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:38:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:38:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:38:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:38:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:38:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:38:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:38:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:38:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:38:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:38:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.533995944, 2020-06-12T02:38:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:38:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:38:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:38:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:38:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:38:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:38:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:38:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:38:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:38:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:38:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:38:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:38:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:38:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:38:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:38:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:38:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:38:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:38:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:38:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:38:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:38:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:38:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:38:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:38:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:38:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:38:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.53365648600001, 2020-06-12T02:38:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:38:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:38:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:38:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:38:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:38:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:38:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:38:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:38:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:38:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:38:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:38:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:38:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:38:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:38:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:38:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:38:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:38:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:38:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:38:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:38:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:38:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:38:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:38:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:38:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:38:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:38:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:38:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:38:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:38:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.53336004100001, 2020-06-12T02:38:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:38:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:38:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:38:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:38:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:38:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:38:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:38:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:38:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:38:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:38:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:38:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:38:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:38:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:38:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:38:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:38:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:38:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:38:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:38:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:38:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:38:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:38:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:38:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:38:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:38:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:38:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.49632626499999, 2020-06-12T02:38:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:38:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:38:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:38:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:38:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:38:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:38:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:38:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:38:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:38:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:38:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:38:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:38:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:38:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:38:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:38:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:38:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:38:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:38:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:38:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:38:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.488719817, 2020-06-12T02:38:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:38:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:38:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:38:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:38:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:38:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:38:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:38:56.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:38:56.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:38:56.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:38:56.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:38:56.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:38:56.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:38:56.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:38:56.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:56.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:38:56.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:38:56.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:38:56.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:38:56.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:38:56.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:38:56.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.804 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:56.804 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:56.804 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.48534127900001, 2020-06-12T02:38:56.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:38:56.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.805 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:56.805 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:38:56.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.807 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:56.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:38:56.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:38:56.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:38:56.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:38:56.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:38:56.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:38:56.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:38:56.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:38:56.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:38:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:38:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:38:56.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:38:56.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:56.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:38:56.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:38:56.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:38:56.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:38:56.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:38:56.822 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:56.822 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.485071025, 2020-06-12T02:38:56.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:38:56.822 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:56.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.823 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.824 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.824 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:38:56.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:56.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:38:56.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:38:56.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:38:56.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:38:56.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:38:56.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:38:56.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:38:56.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:38:56.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:38:56.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:38:56.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:56.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:38:56.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:38:56.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:38:56.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:38:56.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:38:56.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:38:56.835 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.835 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:38:56.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:56.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 142.48488990300001, 2020-06-12T02:38:56.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:38:56.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:56.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:56.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:56.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:56.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:56.838 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:38:56.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:56.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:56.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:56.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:56.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:56.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:38:56.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:38:56.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:56.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:38:56.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:38:56.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:56.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:38:56.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:38:56.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:56.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:38:56.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:38:56.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:56.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:38:56.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:38:56.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:38:56.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:38:56.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:38:56.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:38:56.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:38:56.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:56.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:38:56.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:38:56.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:56.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:56.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:56.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:38:56.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:38:56.852 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.853 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:56.853 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:56.853 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:56.855 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:56.854+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:56.856 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:38:56.957 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:56.954+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:57.017 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:57.018 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:57.018 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:38:57.018 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:57.026 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:38:57.058 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:57.053+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:57.159 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:57.153+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:57.190 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:57.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:38:57.190 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:38:57.191 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:38:57.191 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:57.192 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:38:57.261 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:57.261+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:57.309 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:38:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:38:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:38:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:38:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 206.179585554, 2020-06-12T02:38:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:38:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:38:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:38:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:38:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:38:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:38:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:38:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:38:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:38:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:38:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:38:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:38:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:38:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:38:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:38:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:38:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:38:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:38:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:38:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:38:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:38:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:38:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:38:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:38:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 206.17936211200001, 2020-06-12T02:38:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:38:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:38:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:38:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:38:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:38:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:38:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:38:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:38:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:38:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:38:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:38:57.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:38:57.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:38:57.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:38:57.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:57.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:38:57.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:38:57.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:38:57.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:38:57.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:38:57.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:38:57.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:38:57.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:38:57.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:38:57.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:38:57.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:38:57.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:38:57.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.370 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:38:57.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:57.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.13688300300001, 2020-06-12T02:38:57.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:38:57.372 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.372 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.372 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.373 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:38:57.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.373 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:57.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:38:57.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:38:57.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:38:57.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:38:57.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:38:57.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:38:57.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:38:57.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:38:57.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:38:57.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:38:57.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:38:57.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:38:57.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:38:57.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:38:57.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:38:57.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:38:57.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:38:57.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:38:57.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:38:57.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:38:57.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:38:57.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:38:57.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:38:57.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.393 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.394 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:38:57.394 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:57.394 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 201.13654810899999, 2020-06-12T02:38:57.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:38:57.395 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.395 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.395 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.396 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.396 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:38:57.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.396 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:57.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:38:57.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:38:57.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:38:57.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:38:57.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:38:57.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:38:57.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:38:57.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:38:57.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:38:57.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:38:57.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:57.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:38:57.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:38:57.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:38:57.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:38:57.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:57.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:38:57.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:38:57.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:38:57.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:38:57.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:38:57.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:38:57.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:38:57.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:38:57.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:38:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:38:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.93567222600001, 2020-06-12T02:38:57.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:38:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.413 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:38:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:38:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:38:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:38:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:38:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:38:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:38:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:38:57.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:38:57.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:38:57.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:38:57.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:38:57.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:38:57.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:38:57.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:38:57.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:38:57.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:38:57.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.426 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:57.427 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:57.427 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.935512413, 2020-06-12T02:38:57.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:38:57.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.428 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.428 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.428 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.428 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:38:57.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:38:57.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:38:57.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:38:57.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:38:57.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:38:57.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:38:57.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:38:57.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:38:57.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:38:57.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:38:57.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:38:57.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:38:57.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:38:57.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:38:57.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:38:57.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:38:57.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.441 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:57.441 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:57.441 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.93543170000001, 2020-06-12T02:38:57.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:38:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:57.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:38:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:38:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:38:57.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:38:57.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:38:57.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:38:57.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:38:57.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:38:57.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:38:57.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:38:57.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:38:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:38:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:38:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.453 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.454 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:38:57.454 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:57.455 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.935185147, 2020-06-12T02:38:57.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:38:57.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:57.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:38:57.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:38:57.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:38:57.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:38:57.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:38:57.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:38:57.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:38:57.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:38:57.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:38:57.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:38:57.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:38:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:38:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.466 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:57.466 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:57.466 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.921834824, 2020-06-12T02:38:57.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.467 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:38:57.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:38:57.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:38:57.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:38:57.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:38:57.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:38:57.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:38:57.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:38:57.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:38:57.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:38:57.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:38:57.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:38:57.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:38:57.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:38:57.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:38:57.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.478 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:57.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:57.480 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.92164857, 2020-06-12T02:38:57.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:38:57.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.480 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.480 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:57.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:38:57.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:38:57.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:38:57.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:38:57.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:38:57.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:38:57.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:38:57.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:38:57.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:38:57.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:38:57.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:38:57.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:38:57.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:38:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:38:57.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:38:57.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:38:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.494 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:57.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:57.494 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.92144785900001, 2020-06-12T02:38:57.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:38:57.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.495 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.496 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.496 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:38:57.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.496 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:57.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:38:57.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:38:57.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:38:57.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:38:57.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:38:57.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:38:57.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:38:57.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:38:57.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:38:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:38:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:38:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:38:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:38:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:38:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:38:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:38:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:38:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:38:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.32895989799999, 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:38:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:38:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:38:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:38:57.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:38:57.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:38:57.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:38:57.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:38:57.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:38:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:38:57.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:38:57.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:38:57.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:38:57.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:38:57.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:38:57.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:38:57.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.524 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:38:57.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:57.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.32853615100001, 2020-06-12T02:38:57.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:38:57.525 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.525 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.525 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:57.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:38:57.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:38:57.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:38:57.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:38:57.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:38:57.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:38:57.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:38:57.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:38:57.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:38:57.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:38:57.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:38:57.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:38:57.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:38:57.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:38:57.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:38:57.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:38:57.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:57.540 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.328382293, 2020-06-12T02:38:57.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:38:57.540 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.540 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:38:57.541 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.541 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.541 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.541 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:57.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:38:57.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:38:57.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:38:57.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:38:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:38:57.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:38:57.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:38:57.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:38:57.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:38:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:38:57.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:38:57.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:38:57.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:38:57.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:38:57.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:38:57.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:38:57.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:57.552 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:57.553 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.325651505, 2020-06-12T02:38:57.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:38:57.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.553 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:57.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:38:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.554 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:57.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:38:57.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:38:57.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:38:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:38:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:38:57.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:38:57.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:38:57.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:38:57.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:38:57.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:38:57.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.563 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.563 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.564 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:38:57.564 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:57.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.325231178, 2020-06-12T02:38:57.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:38:57.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.565 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:38:57.565 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:57.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:38:57.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:38:57.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:38:57.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:38:57.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:38:57.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:38:57.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:38:57.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:38:57.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.575 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.576 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.576 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:38:57.576 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.325136345, 2020-06-12T02:38:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:38:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.578 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:38:57.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:57.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:38:57.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:38:57.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:38:57.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:38:57.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:38:57.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:38:57.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:38:57.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:38:57.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:38:57.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:38:57.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:38:57.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:38:57.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:38:57.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:38:57.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:38:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:38:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:38:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:38:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.29535699100001, 2020-06-12T02:38:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:38:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:38:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:38:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:38:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:38:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:38:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:38:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:38:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:38:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:38:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:38:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:38:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:38:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:38:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:38:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:38:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:38:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:38:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:38:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:38:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:38:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.29489137799999, 2020-06-12T02:38:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:38:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:38:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:38:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:38:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:38:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:38:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:38:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:38:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:38:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:38:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:38:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:38:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:38:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:38:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:38:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:38:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:38:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:38:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:38:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:38:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:38:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:38:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:38:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:38:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:38:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:38:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:38:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:38:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 153.294717443, 2020-06-12T02:38:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:38:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:38:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:38:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:38:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:38:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:38:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:38:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:38:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:38:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:38:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:38:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:38:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:38:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:38:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:38:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:38:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:38:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:38:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:38:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:38:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:38:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:38:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:38:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:38:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:38:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:38:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:38:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:38:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:38:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:38:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:38:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:38:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:38:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:38:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:38:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:38:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:38:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:38:57.646 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:38:57.647 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:38:57.651 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:57.645+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:57.749 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:57.745+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:57.778 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:57.779 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:57.779 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:57.779 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:57.780 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:38:57.850 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:57.850+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:57.937 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:57.937 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:57.938 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:38:57.938 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:38:57.938 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:57.947 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:38:57.957 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:57.954+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:58.018 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:38:58.059 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:58.053+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:58.062 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:58.063 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:38:58.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:38:58.063 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:38:58.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.064 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:58.064 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:58.064 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.927293107, 2020-06-12T02:38:58.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:38:58.064 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.065 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.065 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:38:58.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:58.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:38:58.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:38:58.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:38:58.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:38:58.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:38:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:38:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:38:58.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:38:58.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:38:58.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:38:58.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:38:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:38:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:38:58.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:38:58.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:38:58.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:38:58.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:38:58.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:38:58.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:38:58.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:38:58.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.916401726, 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.081 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.082 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.082 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:38:58.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.083 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:58.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:38:58.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:38:58.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:38:58.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:38:58.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:38:58.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:38:58.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:38:58.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:38:58.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:38:58.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:38:58.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:38:58.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:38:58.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:38:58.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:38:58.092 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:38:58.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:38:58.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:38:58.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:38:58.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.095 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.096 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.096 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:58.096 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:58.097 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.915269682, 2020-06-12T02:38:58.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:38:58.097 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.097 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.097 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:58.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.101 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:38:58.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:38:58.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:38:58.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:38:58.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:38:58.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:38:58.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:38:58.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:38:58.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:38:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:38:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:38:58.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:38:58.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:38:58.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:38:58.110 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.110 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.111 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:38:58.111 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:38:58.111 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.111 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.112 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.112 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.112 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.113 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:38:58.113 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:58.113 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.91501449699999, 2020-06-12T02:38:58.113 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:38:58.113 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.114 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.114 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.114 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:58.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:38:58.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:38:58.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:38:58.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:38:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:38:58.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:38:58.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:38:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:38:58.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:38:58.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:38:58.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:38:58.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:38:58.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:38:58.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:38:58.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:38:58.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:38:58.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.126 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.127 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.127 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.91485531000001, 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.129 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.129 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:38:58.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.129 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:58.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:38:58.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:38:58.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:38:58.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:38:58.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:38:58.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:38:58.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:38:58.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:38:58.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:58.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:38:58.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:38:58.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:38:58.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:38:58.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:38:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:38:58.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:38:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:38:58.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.141 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.141 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.141 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:38:58.142 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:58.142 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 201.77053273199999, 2020-06-12T02:38:58.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:38:58.142 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.142 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:38:58.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:38:58.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:38:58.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:38:58.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:38:58.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:38:58.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:38:58.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:38:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:38:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:38:58.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:38:58.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:38:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:38:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.152 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.153 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:38:58.153 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:58.154 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.02946323500001, 2020-06-12T02:38:58.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:38:58.154 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.154 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.154 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.157 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:38:58.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:38:58.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:38:58.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:38:58.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:38:58.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:38:58.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:38:58.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:38:58.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:58.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:38:58.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:38:58.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:38:58.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:38:58.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:38:58.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:38:58.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:38:58.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:38:58.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:38:58.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:38:58.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.171 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:38:58.171 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:58.171 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 174.09176083400001, 2020-06-12T02:38:58.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:38:58.172 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.172 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.172 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.172 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.172 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:58.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:38:58.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:38:58.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:38:58.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:38:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:38:58.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:38:58.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:38:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:38:58.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:58.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:38:58.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:38:58.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:38:58.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:38:58.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:38:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:38:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:38:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:38:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:38:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:38:58.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:38:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:38:58.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.188 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.189 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.189 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:58.189 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:58.190 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.10988475400001, 2020-06-12T02:38:58.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:38:58.190 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.190 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.191 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.191 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.191 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.191 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:38:58.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.192 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:58.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:38:58.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:38:58.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:38:58.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:38:58.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:38:58.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:38:58.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:38:58.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:38:58.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.203 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:38:58.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:38:58.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:38:58.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:38:58.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:38:58.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:38:58.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:38:58.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:38:58.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:38:58.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:38:58.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:38:58.214 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.214 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.214 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.109691438, 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:38:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:58.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:38:58.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:38:58.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:38:58.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:38:58.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:38:58.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:38:58.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:38:58.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:38:58.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:58.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:38:58.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:38:58.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:38:58.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:38:58.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:38:58.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:38:58.227 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:38:58.228 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:58.229 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.10954298300001, 2020-06-12T02:38:58.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:38:58.229 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.229 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.229 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.230 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.230 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:38:58.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.230 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:38:58.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:38:58.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:38:58.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:38:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:38:58.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:38:58.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:38:58.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:38:58.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:38:58.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:38:58.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:38:58.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:38:58.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:38:58.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:38:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:38:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.241 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.242 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.242 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:38:58.243 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:58.243 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.102110033, 2020-06-12T02:38:58.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:38:58.243 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.244 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:58.244 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:58.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:58.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:38:58.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:38:58.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:38:58.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:38:58.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:38:58.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:38:58.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:38:58.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:38:58.251 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.252 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.252 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.253 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:58.253 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:58.253 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.099701533, 2020-06-12T02:38:58.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:38:58.253 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:58.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:38:58.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:38:58.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:38:58.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:38:58.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:38:58.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:38:58.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:38:58.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:38:58.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:38:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:38:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:38:58.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:38:58.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.263 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.263 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.264 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:38:58.264 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:58.264 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.097674388, 2020-06-12T02:38:58.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:38:58.266 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.266 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:58.266 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.267 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:58.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:38:58.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:38:58.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:38:58.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:38:58.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:38:58.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:38:58.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:38:58.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:38:58.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:38:58.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:38:58.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:38:58.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:38:58.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:38:58.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:38:58.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:38:58.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:38:58.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:38:58.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:38:58.277 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.277 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.278 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.278 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:38:58.278 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:58.279 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.08662455499999, 2020-06-12T02:38:58.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:38:58.279 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.279 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:58.279 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:58.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:38:58.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:38:58.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:38:58.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:38:58.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:38:58.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:38:58.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:38:58.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:38:58.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:38:58.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:38:58.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:38:58.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:38:58.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:38:58.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:38:58.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:38:58.290 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:38:58.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.290 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.290 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:38:58.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:38:58.291 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.291 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.292 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.292 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:38:58.292 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:58.293 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.082411538, 2020-06-12T02:38:58.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:38:58.293 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.293 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.294 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.294 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.294 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.294 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:38:58.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.295 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:58.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:38:58.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:38:58.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:38:58.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:38:58.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:38:58.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:38:58.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:38:58.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:38:58.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:38:58.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:38:58.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:38:58.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:38:58.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:38:58.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:38:58.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:38:58.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:38:58.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:38:58.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:38:58.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:38:58.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:38:58.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:38:58.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:38:58.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.311 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.311 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.312 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:38:58.312 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:58.312 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 163.08222833900001, 2020-06-12T02:38:58.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:38:58.313 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.313 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.313 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.314 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.314 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:38:58.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.314 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:58.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:38:58.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:38:58.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:38:58.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:38:58.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:38:58.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:38:58.319 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:38:58.321 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:38:58.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.321 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:58.321 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:38:58.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:38:58.322 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.322 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.322 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.322 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:38:58.323 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:38:58.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:58.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:38:58.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:38:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:38:58.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:38:58.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:38:58.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:38:58.328 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:58.328 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 162.62531029499999, 2020-06-12T02:38:58.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:38:58.328 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.328 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:38:58.329 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:58.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:38:58.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:38:58.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:38:58.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:38:58.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:38:58.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:38:58.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:38:58.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:38:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:38:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.336 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:38:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:38:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:38:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:38:58.338 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.339 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.339 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.339 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:38:58.340 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:58.340 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.09484869799999, 2020-06-12T02:38:58.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:38:58.340 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.340 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:38:58.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.341 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.341 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:38:58.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.342 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:58.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:38:58.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.344 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.344 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:38:58.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:38:58.344 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:38:58.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:38:58.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:38:58.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:38:58.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:38:58.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:38:58.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:38:58.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:38:58.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:38:58.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:38:58.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:38:58.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:38:58.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:38:58.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:38:58.353 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.353 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.353 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.354 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.354 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:38:58.354 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:58.354 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 148.094589579, 2020-06-12T02:38:58.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:38:58.355 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:38:58.355 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:38:58.355 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:38:58.355 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:38:58.356 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:38:58.356 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:38:58.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.356 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:38:58.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:38:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:38:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:38:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:38:58.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:38:58.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:38:58.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:38:58.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:38:58.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:38:58.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:38:58.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:38:58.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:38:58.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:38:58.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:38:58.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:38:58.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:38:58.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:38:58.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:38:58.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:38:58.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.367 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:38:58.367 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:38:58.367 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:38:58.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:38:58.368 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:38:58.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:38:58.369 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:38:58.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.369 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.369 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.370 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:38:58.370 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:38:58.370 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:58.371 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:38:58.372 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:58.126+0000 7fbc94b0d700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:58.373 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:58.142+0000 7fbc8f59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:58.373 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:58.370+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:38:58.374 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:38:58.472 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:58.470+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:58.480 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:58.474+0000 7feae971b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:38:58.482+0000 7feae3fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:38:58.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:38:58.534 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:38:58.534 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:38:58.534 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:38:58.534 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:38:58.544 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:38:58.545 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:38:58.566 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:38:58.587 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:38:58.591 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:58.589+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:58.610 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:38:58.635 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:38:58.649 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:58.649 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:58.658 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:38:58.659 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:38:58.659 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.659 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:38:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:38:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.660 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.661 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:38:58.663 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:38:58.663 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:38:58.706 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:58.706+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:58.776 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:58.773+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:58.811 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:58.812 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:58.820 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:38:58.907 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:58.905+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:58.973 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:58.974 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:58.978 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:58.973+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:58.983 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:38:59.020 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:38:59.080 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:59.077+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:59.131 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.131 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.141 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:38:59.184 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:38:59.182+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:38:59.285 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:38:59.281+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:38:59.294 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.294 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.303 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:38:59.399 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:59.393+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:59.456 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.457 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.469 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:38:59.486 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:59.486+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:59.588 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:38:59.585+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:38:59.623 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.623 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.632 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:38:59.688 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:38:59.686+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:38:59.789 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:38:59.785+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:38:59.793 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.794 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.803 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:38:59.895 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:38:59.889+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:38:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:38:59.925 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:38:59.930 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:38:59.996 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:38:59.994+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:00.053 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.053 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.055 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:00.096 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:00.093+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:00.197 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:00.194+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:00.209 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.209 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.220 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:00.306 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:00.306+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:00.374 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.375 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.384 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:00.426 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:00.426+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:00.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:00.501+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:00.534 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.534 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.544 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:00.601 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:00.601+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:00.652 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.652 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.665 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:39:00.667 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:00.702 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:00.697+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:00.803 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:00.797+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:00.818 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:00.810+0000 7fd91cf3b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:00.820 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:00.820 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:00.821 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:00.818+0000 7fd91759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:00.831 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:00.850 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:00.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:00.898 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:00.903 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:00.901+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:00.922 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:00.934 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:00.935 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:00.935 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:00.936 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:00.936 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:00.942 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:00.956 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:00.975 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:01.002 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.003 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.004 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.004 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:39:01.005 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:01.006 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:01.002+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:01.007 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:01.033 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:39:01.066 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:01.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 209.943974037, 2020-06-12T02:39:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:39:01.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:39:01.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:39:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:39:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:39:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:39:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:39:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:39:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:39:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:39:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:39:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:39:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:39:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:39:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:39:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:39:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:39:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:39:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:39:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:39:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:39:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:39:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:39:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 209.94375059500001, 2020-06-12T02:39:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:39:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:39:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:39:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:39:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:39:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:39:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:39:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:39:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:39:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:39:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:39:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:39:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:39:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:39:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:39:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:39:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:39:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:39:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:39:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:39:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:39:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:39:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:39:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:39:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:39:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 204.90127148600001, 2020-06-12T02:39:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:39:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:39:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:39:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:39:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:39:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:39:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:39:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:39:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:39:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:39:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:39:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:39:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:39:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:39:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:39:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:39:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:39:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:39:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:39:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:39:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:39:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:39:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:39:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:39:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:39:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:39:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 204.90093659199999, 2020-06-12T02:39:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:39:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:39:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:39:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:39:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:39:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:39:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:39:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:39:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:39:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:39:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:39:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:39:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:39:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:39:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:39:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:39:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:39:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:39:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:39:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:39:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:39:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:39:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:39:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:39:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.70006070900001, 2020-06-12T02:39:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:39:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:39:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:39:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:39:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:39:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:39:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:39:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:39:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:39:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:39:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:39:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:39:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:39:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:39:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:39:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:39:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:39:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:39:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:39:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.699900896, 2020-06-12T02:39:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:39:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:39:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:39:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:39:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:39:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:39:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:39:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:39:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:39:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:39:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:39:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:39:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:39:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:39:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:39:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:39:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.69982018300001, 2020-06-12T02:39:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:39:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:39:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:39:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:39:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:39:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:39:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:39:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:39:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:39:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:39:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:39:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:39:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:39:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:39:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:01.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:39:01.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:39:01.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:39:01.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:39:01.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:39:01.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.258 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.259 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:01.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:01.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.69957363, 2020-06-12T02:39:01.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:39:01.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.261 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.261 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.262 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:39:01.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.262 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:01.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:01.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:39:01.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:39:01.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:39:01.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:39:01.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:39:01.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:39:01.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:39:01.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:39:01.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:39:01.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:39:01.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:39:01.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:39:01.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:39:01.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:39:01.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:39:01.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.288 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:01.289 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:01.289 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.68622330700001, 2020-06-12T02:39:01.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:39:01.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.292 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.292 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.293 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.294 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:39:01.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.294 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:01.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:01.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:39:01.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:39:01.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:39:01.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:39:01.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:39:01.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:39:01.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:39:01.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:39:01.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:39:01.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:39:01.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:39:01.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:39:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:39:01.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:39:01.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:39:01.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:39:01.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.308 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:01.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:01.309 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.68603705300001, 2020-06-12T02:39:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:39:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:39:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:39:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:39:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:39:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:39:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:39:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:39:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:39:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:39:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:39:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:39:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:39:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:39:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:39:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:39:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:39:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:39:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:39:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:39:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:39:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:39:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:39:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 165.68583634199999, 2020-06-12T02:39:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:39:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:39:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:39:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:39:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:39:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:39:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:39:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:39:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:39:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:39:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:39:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:39:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:39:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:39:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:39:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:39:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:39:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:39:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:39:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:39:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:39:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:39:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.093348381, 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:39:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:39:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:39:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:39:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:39:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:39:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:39:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:39:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:39:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:39:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:39:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:39:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:39:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:39:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:39:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:39:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:39:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.09292463400001, 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:39:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:39:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:39:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:39:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:39:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:39:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:39:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:39:01.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:39:01.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:39:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:39:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:39:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:39:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:39:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.09277077600001, 2020-06-12T02:39:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:39:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:39:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:39:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:39:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:39:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:39:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:39:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:39:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:39:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:39:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:39:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:39:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:39:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:39:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.090039988, 2020-06-12T02:39:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:39:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:39:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:39:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:39:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:39:01.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:39:01.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:39:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:39:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:01.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:39:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:39:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.089619661, 2020-06-12T02:39:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:39:01.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:01.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:39:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:39:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:39:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:39:01.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:39:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:39:01.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:39:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:39:01.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:39:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:39:01.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:39:01.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.430 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 161.08952482800001, 2020-06-12T02:39:01.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:39:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.433 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:39:01.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:39:01.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:39:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:39:01.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:39:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:39:01.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:39:01.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:39:01.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:39:01.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:39:01.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:39:01.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:39:01.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:39:01.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:39:01.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:39:01.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:39:01.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:39:01.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:39:01.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:39:01.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.446 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.447 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:01.447 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:01.447 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.05974547400001, 2020-06-12T02:39:01.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:39:01.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.448 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.448 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:39:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:39:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:39:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:39:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:39:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:39:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:39:01.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:39:01.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:39:01.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:39:01.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:39:01.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:39:01.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:39:01.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:39:01.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:39:01.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:39:01.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:39:01.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:39:01.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:39:01.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:39:01.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:39:01.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:39:01.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.464 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.465 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:01.465 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:01.465 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.05927986099999, 2020-06-12T02:39:01.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:39:01.465 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.466 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:39:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:01.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:01.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:39:01.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:39:01.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:39:01.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:39:01.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:39:01.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:39:01.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:39:01.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:39:01.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:39:01.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:39:01.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:39:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:39:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:39:01.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:39:01.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:39:01.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:39:01.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:39:01.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:39:01.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:39:01.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:01.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:39:01.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:39:01.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:39:01.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:39:01.482 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.482 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.482 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.483 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:39:01.483 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:01.484 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 157.059105926, 2020-06-12T02:39:01.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:39:01.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:01.486 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:01.486 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:01.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:01.487 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.487 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:39:01.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.487 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:01.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:01.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:01.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:01.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:01.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:01.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:39:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:39:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:39:01.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:01.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:39:01.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:39:01.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:01.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:39:01.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:39:01.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:39:01.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:39:01.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:39:01.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:39:01.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:39:01.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:39:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:39:01.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:39:01.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:39:01.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:39:01.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:01.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:39:01.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:39:01.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:01.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:39:01.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:39:01.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:01.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:01.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:01.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:39:01.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:39:01.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:01.508 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:01.508 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:01.510 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:01.146+0000 7f25b9974700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:01.510 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:01.162+0000 7f25b3fff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:01.511 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:01.510+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:01.511 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:01.610 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:01.610+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:01.630 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:01.630 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:01.631 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:01.631 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:01.640 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:01.714 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:01.714+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:01.750 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:01.750 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:01.751 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:01.751 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:01.751 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:01.762 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:01.821 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:01.818+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:01.874 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.73855904000001, 2020-06-12T02:39:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:39:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:39:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:39:01.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:39:01.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:39:01.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:39:01.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:39:01.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:39:01.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:39:01.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:39:01.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:39:01.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:01.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:39:01.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:39:01.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:39:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:39:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:39:01.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:39:01.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:39:01.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:39:01.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:39:01.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:39:01.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:01.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:39:01.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:39:01.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:39:01.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:39:01.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.901 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.901 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.901 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:39:01.902 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:01.902 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.72766765899999, 2020-06-12T02:39:01.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:39:01.903 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.903 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.903 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.904 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.904 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.904 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:39:01.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.904 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:01.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:39:01.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:39:01.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:39:01.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:39:01.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:39:01.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:39:01.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:39:01.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:39:01.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:39:01.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:39:01.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:39:01.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:39:01.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:39:01.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:39:01.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:39:01.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:39:01.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:39:01.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:39:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:39:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:39:01.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:39:01.921 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.921 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.923 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:01.923 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:01.923 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.72653561499999, 2020-06-12T02:39:01.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:39:01.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.924 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.925 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.926 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:39:01.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.927 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:01.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:01.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:39:01.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.930 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:39:01.930 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:39:01.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:39:01.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:39:01.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.931 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:39:01.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:39:01.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:39:01.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:39:01.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:39:01.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:39:01.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:39:01.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:39:01.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:39:01.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:39:01.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:01.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:39:01.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:39:01.940 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.941 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.941 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.72628043, 2020-06-12T02:39:01.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:39:01.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.944 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:01.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:39:01.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:39:01.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:39:01.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:39:01.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:39:01.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:39:01.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:39:01.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:39:01.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:39:01.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:39:01.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:39:01.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:39:01.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:01.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:39:01.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:39:01.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.955 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.956 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.956 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:01.956 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:01.957 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.72612124299999, 2020-06-12T02:39:01.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:39:01.957 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.957 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:01.957 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:01.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:39:01.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:39:01.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:39:01.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:39:01.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:39:01.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:39:01.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:39:01.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:39:01.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:39:01.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:39:01.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:39:01.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:39:01.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.970 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.970 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.971 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:39:01.971 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:01.971 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 205.58179866500001, 2020-06-12T02:39:01.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:39:01.971 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.972 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:01.972 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.972 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.972 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.973 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:39:01.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.973 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:01.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:01.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:39:01.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:39:01.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:39:01.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:39:01.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:39:01.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.979 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:39:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:39:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:01.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:39:01.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:39:01.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.982 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:01.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:01.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.983 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:01.983 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:01.983 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.840729168, 2020-06-12T02:39:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:39:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:01.984 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:01.985 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:01.985 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:39:01.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.986 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:01.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:01.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:01.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:01.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:01.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:01.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:39:01.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:01.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:39:01.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:39:01.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:01.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:39:01.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:39:01.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:01.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:39:01.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:39:01.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:01.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:39:01.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:39:01.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:01.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:39:01.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:39:01.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:01.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:39:01.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:39:01.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:01.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:39:01.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:39:01.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:01.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:39:01.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:39:01.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:01.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:01.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:39:02.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:39:02.000 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.000 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.000 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.002 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:02.002 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:02.002 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 177.903026767, 2020-06-12T02:39:02.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:39:02.003 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.003 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.003 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:02.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.005 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:02.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:39:02.006 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.006 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:39:02.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:39:02.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.008 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:39:02.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:39:02.008 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.009 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.009 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:39:02.009 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:39:02.009 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:39:02.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:39:02.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:39:02.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:39:02.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:02.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:39:02.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:39:02.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:39:02.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:39:02.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:39:02.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:39:02.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:39:02.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:39:02.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:39:02.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:39:02.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.017 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:39:02.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:39:02.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:39:02.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:39:02.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.019 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.019 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.020 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:02.020 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:02.021 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.92115068699999, 2020-06-12T02:39:02.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:39:02.021 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.021 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.021 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.022 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.022 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.022 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:39:02.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.022 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:02.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:02.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:39:02.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.028 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:39:02.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:39:02.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.029 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:39:02.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:39:02.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.033 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.033 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:39:02.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:39:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.035 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:02.035 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:02.035 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.92095737099999, 2020-06-12T02:39:02.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:39:02.035 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.036 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.036 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.036 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:39:02.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.037 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:02.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:02.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:39:02.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:39:02.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:39:02.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:39:02.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:39:02.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:39:02.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:39:02.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:39:02.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:39:02.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:39:02.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:39:02.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:02.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:39:02.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:39:02.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:39:02.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:39:02.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:39:02.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:39:02.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:39:02.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:39:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.920808916, 2020-06-12T02:39:02.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:39:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.051 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.052 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:39:02.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.052 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:02.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:02.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:39:02.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:39:02.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:39:02.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:39:02.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:39:02.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:39:02.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:39:02.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:39:02.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:39:02.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:39:02.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:39:02.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:02.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:39:02.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:39:02.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:39:02.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:39:02.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:39:02.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:39:02.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:39:02.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:39:02.063 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.064 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:39:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.91337596599999, 2020-06-12T02:39:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:39:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:02.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:02.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:02.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:02.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:39:02.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:39:02.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:39:02.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:39:02.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:39:02.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:39:02.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:39:02.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:39:02.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:39:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.075 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:02.075 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:02.075 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.91096746599999, 2020-06-12T02:39:02.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:39:02.075 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.076 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.076 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:02.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:02.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:39:02.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:39:02.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:39:02.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:39:02.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:39:02.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:39:02.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:39:02.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:39:02.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:39:02.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:39:02.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:39:02.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:39:02.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:39:02.084 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:39:02.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:39:02.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:39:02.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:39:02.086 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.087 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.087 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.087 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:02.088 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:02.088 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.90894032099999, 2020-06-12T02:39:02.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:39:02.088 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.088 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.089 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:02.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:39:02.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.092 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:39:02.092 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:39:02.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:39:02.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:39:02.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:39:02.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:39:02.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:39:02.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:39:02.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:39:02.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:39:02.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.098 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.098 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:39:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:39:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:39:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:39:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:39:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.897890488, 2020-06-12T02:39:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:39:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:02.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:39:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:39:02.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:39:02.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:39:02.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:39:02.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:39:02.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:39:02.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:39:02.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:39:02.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:39:02.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:39:02.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:39:02.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:39:02.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:39:02.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:39:02.122 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.123 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.123 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.123 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:02.124 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:02.124 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 166.89367747099999, 2020-06-12T02:39:02.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:39:02.125 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.126 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.126 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.126 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.127 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.127 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:39:02.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.127 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:02.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:39:02.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:39:02.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:39:02.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:39:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:39:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:39:02.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:39:02.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:39:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:39:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:39:02.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:39:02.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:39:02.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:39:02.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:39:02.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:39:02.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:39:02.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:39:02.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:39:02.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:39:02.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.140 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 166.893494272, 2020-06-12T02:39:02.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:39:02.142 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.142 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.143 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:39:02.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.143 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:02.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:39:02.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:39:02.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:39:02.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:39:02.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:39:02.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:39:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:39:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:39:02.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:39:02.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:02.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:39:02.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:39:02.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:02.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:39:02.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:39:02.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:39:02.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:39:02.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:39:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:39:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:02.157 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 166.43657622800001, 2020-06-12T02:39:02.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:39:02.158 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.158 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.158 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:02.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:39:02.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:39:02.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:39:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:39:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:39:02.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:39:02.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:39:02.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:39:02.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:39:02.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:39:02.167 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.168 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.90611463100001, 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.169 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.170 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.170 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.170 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:39:02.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.170 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:02.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:39:02.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:39:02.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:39:02.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:39:02.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:39:02.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:39:02.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:39:02.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:39:02.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:39:02.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:39:02.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:39:02.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:39:02.181 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.182 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.182 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 151.90585551199999, 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.183 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.184 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.184 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:39:02.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.184 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:02.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:39:02.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:39:02.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:02.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:39:02.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:39:02.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:02.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:39:02.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:39:02.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:39:02.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:39:02.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:39:02.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:39:02.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.199 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.200 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:02.203 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:39:02.203 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:02.197+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:02.204 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:02.303 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:02.297+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:02.361 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:02.362 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:02.362 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:02.362 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:02.373 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:02.405 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:02.402+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:02.506 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:02.506+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:02.527 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:02.528 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:02.528 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:02.528 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:02.528 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:02.537 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:02.613 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:02.609+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:02.644 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:02.644 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:02.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:02.645 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:02.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.646 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:02.646 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:02.646 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 211.49530944899999, 2020-06-12T02:39:02.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:39:02.647 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.647 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.648 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:02.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:02.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:39:02.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:39:02.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:39:02.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:39:02.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:39:02.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:39:02.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:39:02.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:39:02.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:39:02.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:39:02.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:39:02.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:39:02.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:39:02.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:39:02.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:39:02.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:39:02.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:39:02.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.670 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:39:02.671 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:02.671 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.34879593799999, 2020-06-12T02:39:02.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:39:02.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.672 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.673 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:02.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:02.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:39:02.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:39:02.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:39:02.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:39:02.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:39:02.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:39:02.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:39:02.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:39:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:39:02.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:39:02.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:39:02.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:39:02.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:39:02.682 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.683 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.683 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.683 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:02.684 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:02.684 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.67124726399999, 2020-06-12T02:39:02.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:39:02.684 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.684 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.685 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.685 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:39:02.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.686 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:02.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:02.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:39:02.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:39:02.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:39:02.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:39:02.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:39:02.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:39:02.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:39:02.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:39:02.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.67048333599999, 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:39:02.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:39:02.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:39:02.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:39:02.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:02.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:39:02.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:39:02.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:39:02.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:39:02.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:02.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:39:02.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:39:02.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:39:02.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:39:02.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:02.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:39:02.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:39:02.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:39:02.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:39:02.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:39:02.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:39:02.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:39:02.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:39:02.724 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.724 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.725 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.44767828100001, 2020-06-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:39:02.727 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.727 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.727 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.727 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:39:02.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:39:02.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:39:02.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:39:02.744 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.746 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:02.746 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:02.746 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.439391994, 2020-06-12T02:39:02.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:39:02.747 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.747 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.748 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:39:02.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:02.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:02.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:39:02.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:39:02.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:39:02.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:39:02.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:39:02.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:39:02.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:39:02.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:39:02.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:39:02.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:39:02.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:39:02.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:39:02.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:39:02.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:39:02.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:39:02.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:39:02.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:39:02.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:39:02.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:39:02.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:39:02.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:39:02.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.767 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.768 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:02.769 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:02.769 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.43236275000001, 2020-06-12T02:39:02.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:39:02.770 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.770 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.770 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.771 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.771 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.771 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:39:02.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.772 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:02.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:02.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:39:02.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:39:02.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:39:02.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:39:02.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:39:02.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:39:02.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:39:02.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:39:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:39:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:39:02.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:39:02.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:39:02.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:39:02.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.783 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.784 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:02.784 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:02.784 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 178.43222529900001, 2020-06-12T02:39:02.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.785 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:39:02.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.786 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:02.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:39:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:39:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:39:02.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:39:02.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:39:02.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:39:02.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:39:02.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:02.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:39:02.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:39:02.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:39:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:39:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:39:02.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:39:02.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.796 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.797 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:02.797 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:02.797 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.63143755999999, 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.799 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:39:02.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.799 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:02.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:39:02.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:39:02.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:39:02.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:39:02.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:39:02.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:02.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:39:02.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:39:02.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:39:02.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:39:02.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:39:02.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:39:02.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:39:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:39:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:39:02.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:39:02.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:39:02.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:39:02.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.813 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.814 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:02.814 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:02.814 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 173.63129094600001, 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.816 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:39:02.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.816 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:02.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:39:02.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:39:02.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:39:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:39:02.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:39:02.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:39:02.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:39:02.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:39:02.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:39:02.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:39:02.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:39:02.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:39:02.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:39:02.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:39:02.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:39:02.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:39:02.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:39:02.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:39:02.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.830 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.675278072, 2020-06-12T02:39:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:39:02.831 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:39:02.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:02.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:02.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:39:02.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:39:02.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:39:02.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:39:02.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:39:02.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:39:02.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:39:02.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:39:02.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:39:02.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:39:02.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:39:02.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:39:02.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:39:02.844 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.844 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.844 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.844 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.669546559, 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:39:02.845 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.846 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.846 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.846 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.846 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.846 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:39:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:02.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:39:02.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:39:02.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:39:02.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:39:02.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:39:02.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.852 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:39:02.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:39:02.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:39:02.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:39:02.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:39:02.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:39:02.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:39:02.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:39:02.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:39:02.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:39:02.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:39:02.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:39:02.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.859 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.860 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:02.860 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:02.860 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.66905304299999, 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.861 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.862 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:39:02.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.862 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:02.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:39:02.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:39:02.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:39:02.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:39:02.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:39:02.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:39:02.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:39:02.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:39:02.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:39:02.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:39:02.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:39:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:39:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:39:02.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:39:02.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:39:02.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:39:02.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.874 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.66895903599999, 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.875 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.876 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.876 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:39:02.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.877 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:02.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:39:02.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:39:02.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:39:02.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:39:02.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:39:02.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:39:02.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:39:02.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:02.884 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:39:02.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:39:02.884 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:39:02.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:39:02.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:39:02.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:39:02.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.887 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.887 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.63079800700001, 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:39:02.888 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.889 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:02.889 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:02.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:39:02.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:39:02.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:39:02.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:39:02.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:39:02.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:39:02.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:39:02.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:39:02.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:39:02.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:39:02.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:39:02.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:02.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:39:02.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:39:02.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:39:02.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:39:02.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.899 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:02.900 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.59000101399999, 2020-06-12T02:39:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:39:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.901 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.902 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.902 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:39:02.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.902 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:02.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:39:02.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:39:02.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:39:02.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:39:02.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:39:02.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:39:02.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:39:02.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:39:02.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:39:02.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:39:02.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:39:02.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.911 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.911 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.589758948, 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.912 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.913 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.913 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:39:02.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:39:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:39:02.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:39:02.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.917 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:39:02.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:39:02.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:39:02.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:39:02.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:39:02.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:39:02.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:39:02.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:39:02.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.922 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.922 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.58954925699999, 2020-06-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 161.57401509600001, 2020-06-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.947 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.947 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:02.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:39:02.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.949 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:39:02.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:39:02.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:39:02.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:39:02.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.950 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:39:02.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:39:02.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.955 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:39:02.955 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:02.955 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 152.67595506200001, 2020-06-12T02:39:02.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:02.956 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:39:02.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.957 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:02.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:02.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:02.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:02.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:02.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:39:02.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:39:02.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:02.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:39:02.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:39:02.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:02.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:39:02.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:39:02.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:39:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:39:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:02.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:02.965 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:02.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:39:02.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:39:02.965 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.965 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.966 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:02.966 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:02.966 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:02.967 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:02.969 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:02.965+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:03.007 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:39:03.068 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:03.066+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:03.118+0000 7fba4e856700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:03.134 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:03.126+0000 7fba4d5f4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:03.135 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:03.135 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:03.135 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:03.135 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:03.137 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:03.162 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:03.182 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:03.185 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:03.181+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:03.207 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:03.232 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:03.260 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:03.261 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:03.261 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:03.261 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:03.262 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:03.262 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:03.262 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:03.278 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:03.270+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:03.283 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:03.311 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:39:03.313 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:03.313 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:03.374 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:03.369+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:03.428 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:03.429 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:03.438 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:03.482 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:03.474+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:03.575 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:03.573+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:03.596 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:03.596 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:03.604 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:03.691 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:03.689+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:03.757 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:03.758 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:03.767 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:03.815 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:03.809+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:03.878 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:03.873+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:03.923 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:03.923 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:03.933 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:03.978 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:03.973+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:04.053 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:04.053 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:04.067 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:04.079 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:04.073+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:04.181 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:04.178+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:04.187 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:04.188 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:04.197 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:04.204 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:39:04.285 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:04.285+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:04.347 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:04.348 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:04.348 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:04.338+0000 7fcf81c26700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:04.356 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:04.350+0000 7fcf809c4700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:04.356 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:04.402 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:04.402+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:04.458 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:04.458 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:04.467 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:04.510 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:04.510+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:04.588 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:04.586+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:04.616 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:04.616 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:04.625 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:04.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:04.685+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:04.780 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:05.006 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:05.008 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:05.013 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:05.009+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:39:05.122 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:05.118+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:05.139 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:05.145 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:05.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:05.209+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:05.308 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:05.309 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:05.315 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:39:05.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:05.313+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:05.317 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:05.416 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:05.414+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:05.465 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:05.462+0000 7f6cb16e6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:05.468 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:05.466+0000 7f6cabfff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:05.468 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:05.469 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:05.479 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:05.500 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:05.522 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:05.523 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:05.521+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:05.546 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:05.571 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:05.596 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:05.600 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:05.600 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:05.601 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:05.601 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:05.622 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:05.617+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:05.622 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:05.623 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:05.646 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:39:05.649 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:05.649 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:05.723 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:05.717+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:05.775 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:05.776 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:05.776 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:05.776 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:05.777 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:05.784 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:05.828 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:05.825+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:05.930 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:05.925+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:05.943 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:05.944 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:05.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:05.944 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:05.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.945 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:05.945 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:05.946 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.80689210700001, 2020-06-12T02:39:05.946 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:39:05.946 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:05.947 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:05.947 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:05.948 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:05.948 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:05.948 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:39:05.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.949 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:05.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.950 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:05.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:05.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:05.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:05.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:05.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:39:05.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:05.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:39:05.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:39:05.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:05.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:39:05.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:39:05.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:05.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:39:05.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:39:05.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:05.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:39:05.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:39:05.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.963 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:05.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:39:05.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:39:05.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:05.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:39:05.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:39:05.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:05.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:39:05.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:39:05.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:05.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:39:05.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:39:05.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:05.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:39:05.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:39:05.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:05.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:39:05.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:39:05.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.977 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:05.977 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:39:05.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:39:05.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:05.978 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:05.978 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:05.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.978 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.79600072599999, 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:05.979 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:05.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:05.980 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:05.980 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:39:05.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.980 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:05.981 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:05.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:05.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:05.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:05.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:05.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:39:05.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:05.990 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:39:05.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:39:05.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.991 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:05.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:39:05.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:39:05.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:05.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:39:05.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:39:05.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:05.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:39:05.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:39:05.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:05.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:39:05.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:39:05.996 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.996 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:05.997 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:39:05.997 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:39:05.997 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.997 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:05.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:39:05.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:39:05.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:05.999 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:05.999 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:05.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.000 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:06.000 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:06.000 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.79486868199999, 2020-06-12T02:39:06.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:39:06.001 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.001 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.001 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.001 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.001 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:06.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:06.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:39:06.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:39:06.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:39:06.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.006 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.007 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:39:06.007 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:39:06.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.008 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.009 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:39:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:39:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:39:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:39:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:39:06.012 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:39:06.012 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.012 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.012 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.012 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:39:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:39:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.013 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:39:06.014 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:39:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:39:06.015 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:39:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:39:06.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.017 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.794613497, 2020-06-12T02:39:06.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:39:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.019 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:39:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.020 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:39:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:39:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:39:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:39:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:39:06.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:39:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:39:06.026 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:39:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.027 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:39:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:39:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.028 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:39:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:39:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.029 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:39:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:39:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:39:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:39:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.032 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:06.033 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.79445430999999, 2020-06-12T02:39:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:39:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.034 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:39:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:39:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:39:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:39:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:39:06.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:39:06.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:39:06.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:39:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:39:06.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:39:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:39:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:39:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:39:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.046 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:06.047 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 209.65013173200001, 2020-06-12T02:39:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:39:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.048 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.049 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:39:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:39:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:39:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:39:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:39:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:39:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:39:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:39:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:39:06.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:39:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:39:06.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.059 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 185.90906223499999, 2020-06-12T02:39:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:39:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.060 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:39:06.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:39:06.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:39:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:39:06.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.065 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:39:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:39:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:39:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:39:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:39:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:39:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:39:06.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:39:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:39:06.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:39:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:39:06.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:39:06.074 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.075 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.971359834, 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.076 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:39:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.077 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:39:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:39:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:39:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.081 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:39:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:39:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.082 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.083 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:39:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:39:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:39:06.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:39:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:39:06.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:39:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:39:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:39:06.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:39:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:39:06.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:39:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:39:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:39:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:39:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.095 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.98948375399999, 2020-06-12T02:39:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:39:06.097 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.098 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:39:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.099 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.100 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:39:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:39:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:39:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:39:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:39:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:39:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:39:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.104 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:39:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:39:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:39:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:39:06.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.107 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:39:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:39:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.108 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:39:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:39:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.109 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.110 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.111 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.98929043800001, 2020-06-12T02:39:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:39:06.112 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.113 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:39:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:06.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:39:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:39:06.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:39:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:39:06.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:39:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:39:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:39:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:39:06.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:39:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:39:06.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:39:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:39:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:39:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.124 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:39:06.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:39:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.126 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.989141983, 2020-06-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:39:06.127 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.128 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:39:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:06.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:39:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:39:06.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:39:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:39:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:39:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:39:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:39:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:39:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:39:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:39:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:39:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:39:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:39:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:39:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:39:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.140 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.98170903299999, 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:39:06.141 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.142 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.142 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.142 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.143 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.143 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:06.143 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:06.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:06.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:39:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:39:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:39:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:39:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:39:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:39:06.150 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.97930053300001, 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.152 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:39:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.156 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:39:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:39:06.157 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:39:06.158 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:39:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:39:06.159 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:39:06.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:39:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:39:06.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:39:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:39:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:39:06.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:39:06.165 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.166 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.166 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.167 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.97727338799999, 2020-06-12T02:39:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:39:06.168 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:06.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:06.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:39:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:39:06.171 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:39:06.172 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:39:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:39:06.173 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:39:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:39:06.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:39:06.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:39:06.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:39:06.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:39:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:39:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:39:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:39:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:39:06.181 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:39:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:06.184 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 179.966223555, 2020-06-12T02:39:06.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:39:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:39:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:39:06.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:39:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:39:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:39:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:39:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:39:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:39:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:39:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:39:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:39:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:39:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:39:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:39:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:39:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:39:06.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:39:06.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.200 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.200 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:06.201 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 170.96201053799999, 2020-06-12T02:39:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:39:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:39:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.203 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.204 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:06.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:39:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:39:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:39:06.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:39:06.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:39:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:39:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:39:06.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:39:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:39:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:39:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:39:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:39:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:39:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:39:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:39:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:39:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:39:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:39:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:39:06.218 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:06.219 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 170.961827339, 2020-06-12T02:39:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:39:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.220 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:39:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.221 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.222 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.222 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:06.222 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:06.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:39:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:39:06.224 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:39:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:39:06.225 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:39:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:39:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:39:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:39:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:39:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:39:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:39:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:06.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:39:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:39:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:39:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:39:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:39:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:39:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:39:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:39:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:39:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:39:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:39:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:39:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.236 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.237 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 170.504909295, 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.238 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:06.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:06.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:39:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:39:06.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:39:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:39:06.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:39:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:39:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:39:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:39:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:39:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:39:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:39:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:39:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:39:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:39:06.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:39:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:39:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.97444769800001, 2020-06-12T02:39:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:39:06.250 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.251 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:39:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:39:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:39:06.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:39:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:39:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:39:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:39:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:39:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:39:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:39:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:39:06.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:39:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:39:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:39:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:39:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:39:06.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:39:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:39:06.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:39:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:39:06.266 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.267 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 155.97418857900001, 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.268 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:39:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.269 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:39:06.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:39:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:39:06.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:39:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:39:06.273 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:39:06.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:39:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:39:06.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:39:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:39:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:39:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:06.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:39:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:39:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:39:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:39:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:39:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:39:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:39:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:39:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:39:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:39:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.283 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.284 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.284 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:06.286 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:06.286 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:06.285+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:06.387 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:06.386+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:06.444 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:06.445 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:06.445 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:06.445 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:06.460 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:06.507 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:06.505+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:06.569 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:06.569 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:06.570 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:06.570 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:06.570 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:06.581 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:06.590 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:06.590+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:06.690 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:06.685+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:06.733 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:06.734 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:06.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:06.734 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 215.586544355, 2020-06-12T02:39:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:39:06.736 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.736 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.736 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:06.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:06.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:39:06.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:39:06.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:39:06.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:39:06.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:39:06.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:39:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:39:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:39:06.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:39:06.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:39:06.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:39:06.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:39:06.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:39:06.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:39:06.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:39:06.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:39:06.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:39:06.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.751 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.751 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.752 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:39:06.752 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:06.752 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 210.44003084400001, 2020-06-12T02:39:06.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:39:06.753 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.753 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.754 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:06.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:06.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:39:06.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:39:06.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:39:06.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:39:06.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:39:06.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:39:06.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:39:06.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:39:06.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:39:06.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:39:06.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:39:06.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:39:06.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:39:06.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:39:06.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:39:06.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:39:06.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:39:06.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.766 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.766 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.767 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:06.767 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:06.768 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.76248217, 2020-06-12T02:39:06.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:39:06.768 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.768 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.769 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:39:06.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.770 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:06.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:06.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:39:06.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:39:06.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:39:06.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:39:06.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:39:06.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:39:06.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:39:06.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:39:06.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:39:06.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:39:06.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:39:06.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:06.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:39:06.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:39:06.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:39:06.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:39:06.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:39:06.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:39:06.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:39:06.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:39:06.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:39:06.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:39:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:39:06.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:39:06.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:39:06.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:39:06.786 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.787 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.787 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.787 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:06.788 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:06.788 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.761718242, 2020-06-12T02:39:06.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:39:06.788 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.789 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.789 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.789 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:39:06.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.790 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:06.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:06.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:39:06.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:39:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:39:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:39:06.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:39:06.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:39:06.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:39:06.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:39:06.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:39:06.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:39:06.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:39:06.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:06.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:39:06.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:39:06.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:39:06.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:39:06.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:06.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:39:06.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:39:06.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:39:06.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:39:06.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:39:06.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:39:06.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:39:06.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:39:06.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:39:06.810 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:39:06.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:39:06.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:39:06.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.812 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.813 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:06.813 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:06.813 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.53891318699999, 2020-06-12T02:39:06.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:39:06.814 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.814 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.814 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.815 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.815 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:39:06.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.815 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.816 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:06.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:06.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:39:06.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:39:06.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:39:06.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:39:06.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:39:06.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:39:06.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:39:06.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:39:06.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:39:06.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:39:06.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:39:06.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:39:06.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:39:06.827 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.827 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:39:06.828 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:39:06.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.828 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.828 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:39:06.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:39:06.829 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.829 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.829 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.829 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:39:06.830 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:39:06.830 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.830 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.831 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.831 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.832 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:06.832 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:06.832 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.53062689999999, 2020-06-12T02:39:06.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:39:06.833 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.833 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.833 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.834 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.834 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.834 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:39:06.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.834 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:06.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:06.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:39:06.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:39:06.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:39:06.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:39:06.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:39:06.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:39:06.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:39:06.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:39:06.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:39:06.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.842 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.842 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:39:06.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:39:06.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.843 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.843 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:39:06.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:39:06.843 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.844 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.844 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.844 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:39:06.844 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:39:06.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:39:06.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:39:06.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:39:06.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:39:06.847 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.848 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.849 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.850 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:06.850 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:06.850 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.52359765599999, 2020-06-12T02:39:06.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:39:06.853 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.854 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.854 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.854 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.854 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.855 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:39:06.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.855 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:06.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.856 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:06.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:39:06.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:39:06.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:39:06.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:39:06.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:39:06.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:39:06.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:39:06.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:39:06.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:39:06.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:39:06.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:39:06.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:39:06.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:39:06.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:39:06.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:39:06.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:39:06.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:39:06.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.867 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.868 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:06.868 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:06.868 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 182.52346020499999, 2020-06-12T02:39:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:39:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:06.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:06.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:39:06.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:39:06.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:39:06.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:39:06.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:39:06.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:39:06.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:39:06.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:39:06.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:39:06.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:39:06.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:39:06.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:39:06.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:39:06.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:39:06.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:39:06.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.882 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.883 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:06.883 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:06.883 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 177.72267246600001, 2020-06-12T02:39:06.884 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:39:06.884 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.884 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.884 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.884 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:06.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:39:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:39:06.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:39:06.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.889 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:39:06.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:06.890 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:39:06.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:39:06.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:06.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:39:06.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:39:06.893 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:39:06.893 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:39:06.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.895 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.895 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:39:06.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:39:06.895 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.897 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.897 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:39:06.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:39:06.897 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.897 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:39:06.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:39:06.898 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.898 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:06.899 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 177.72252585199999, 2020-06-12T02:39:06.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:39:06.900 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.900 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.900 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.900 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:06.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:06.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:39:06.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:39:06.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:39:06.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:39:06.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:39:06.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:39:06.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:39:06.907 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.907 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.908 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:39:06.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:39:06.909 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.909 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.909 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:06.909 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:39:06.910 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:39:06.910 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.910 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.910 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.910 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:39:06.911 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:39:06.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:39:06.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:39:06.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:39:06.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:39:06.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.915 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:39:06.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:39:06.915 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.916 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.916 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.916 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.76651297800001, 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.917 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.918 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.918 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.918 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:39:06.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.918 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:06.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.919 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:39:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:39:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.922 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:39:06.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:39:06.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:39:06.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:39:06.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.925 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:39:06.925 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:39:06.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.925 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.925 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.926 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:39:06.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:39:06.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.927 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.927 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.927 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:39:06.928 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:39:06.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.928 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.928 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.928 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:39:06.929 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:39:06.930 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.930 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.930 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.930 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.931 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:06.931 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:06.931 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.76078146500001, 2020-06-12T02:39:06.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:39:06.931 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.932 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.932 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.932 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.932 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.933 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:39:06.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.934 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:06.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:06.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:39:06.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.937 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:39:06.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:39:06.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:39:06.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:39:06.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:39:06.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:39:06.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:39:06.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:39:06.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:39:06.944 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:39:06.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.945 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.945 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.945 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:39:06.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:39:06.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.946 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:39:06.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:39:06.947 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.947 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.947 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.948 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:06.948 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:06.948 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.760287949, 2020-06-12T02:39:06.948 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:39:06.949 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.949 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:06.950 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.950 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.951 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.951 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:39:06.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.951 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.953 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:06.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:39:06.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.953 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:39:06.954 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:39:06.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.955 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:39:06.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:39:06.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.956 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:39:06.957 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:39:06.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:39:06.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:39:06.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:39:06.960 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:39:06.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.960 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.960 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.960 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:39:06.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:39:06.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.961 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:06.961 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:39:06.962 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:39:06.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.963 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.963 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.963 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.964 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:06.964 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:06.964 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.760193942, 2020-06-12T02:39:06.964 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:39:06.964 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:39:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.967 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:06.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:39:06.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:39:06.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:39:06.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:39:06.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:39:06.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.971 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:39:06.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:39:06.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.973 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:06.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:39:06.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:39:06.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:39:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:39:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.975 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:39:06.976 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:39:06.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.976 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.977 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:39:06.977 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.72203291299999, 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.978 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.980 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.980 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:06.980 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.981 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.981 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:06.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:39:06.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.982 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.982 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:39:06.982 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:39:06.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.983 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:06.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:39:06.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:39:06.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:06.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:39:06.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:39:06.985 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:06.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:39:06.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:39:06.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:06.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:39:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:39:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:06.989 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.990 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:06.990 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:06.991 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 165.68123592000001, 2020-06-12T02:39:06.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:39:06.992 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:06.992 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:06.992 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:06.992 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:06.993 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:06.993 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:39:06.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.993 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:06.993 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:06.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:06.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:06.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.997 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:06.998 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:06.999 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:39:06.999 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:06.999 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:06.999 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:06.999 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:39:07.000 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:39:07.000 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.000 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.000 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.000 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:39:07.001 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:39:07.001 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.001 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.001 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.001 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:39:07.002 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:39:07.002 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.002 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.002 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.002 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:39:07.003 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:39:07.003 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.003 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.003 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.003 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:39:07.004 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:39:07.004 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.004 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.004 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.004 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:39:07.005 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:39:07.005 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.005 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.005 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:39:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:39:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.007 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.007 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.007 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:07.008 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:07.008 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 165.68099385400001, 2020-06-12T02:39:07.008 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:39:07.009 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.009 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.009 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.010 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:39:07.014 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.014 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.015 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.015 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.015 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:07.016 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.016 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.016 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.016 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.016 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:07.017 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:39:07.017 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.017 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.017 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.018 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:39:07.018 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:39:07.018 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.018 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.018 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.019 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:39:07.019 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:39:07.019 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.019 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.019 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.020 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:39:07.020 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:39:07.020 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.021 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.021 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.022 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:39:07.022 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:39:07.022 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.023 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.023 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.023 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:39:07.023 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:39:07.023 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.024 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.025 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.025 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:39:07.025 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:39:07.025 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.025 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.026 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.027 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.027 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.027 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:07.027 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:07.027 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 165.680784163, 2020-06-12T02:39:07.028 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:39:07.028 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.028 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.028 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.029 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.029 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:07.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.031 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.031 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.031 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:07.033 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:39:07.033 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.033 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.034 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.034 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:39:07.034 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:39:07.034 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.034 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:39:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:39:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.036 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.036 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:39:07.036 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:39:07.036 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.036 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.037 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.037 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:39:07.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:39:07.037 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.038 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.038 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.039 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:39:07.039 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:39:07.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:39:07.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:39:07.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:39:07.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:39:07.041 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.042 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.042 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.042 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.042 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.043 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:39:07.043 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:07.043 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 165.66525000199999, 2020-06-12T02:39:07.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:39:07.043 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.046 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.046 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.047 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:07.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.047 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:07.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:39:07.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.049 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:39:07.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:39:07.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:39:07.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:39:07.051 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.051 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.052 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.052 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:39:07.052 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:39:07.053 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.054 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.054 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.054 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:39:07.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:39:07.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:39:07.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:39:07.059 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.060 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.060 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.060 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:39:07.061 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:07.061 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 156.767189968, 2020-06-12T02:39:07.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:39:07.064 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.064 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.064 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.065 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.066 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:39:07.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.066 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.066 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:07.069 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:07.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:39:07.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:39:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:39:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:39:07.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:39:07.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:39:07.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:39:07.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:39:07.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:39:07.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:39:07.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:39:07.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:39:07.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:39:07.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:39:07.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:39:07.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.080 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.080 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.082 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.082 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.083 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:07.083 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:39:07.085 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:07.081+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:07.086 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:07.189 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:07.185+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:07.206 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:07.194+0000 7fe1b74cd700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:07.212 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:07.206+0000 7fe1b626b700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:07.246 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:07.247 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:07.247 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:07.247 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:07.256 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:07.304 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:07.297+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:07.391 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:07.385+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:07.418 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:07.419 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:07.419 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:07.419 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:07.419 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:07.428 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:07.516 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:07.513+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:07.579 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:07.579 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:07.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:07.580 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:07.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.580 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:07.580 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:07.580 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 217.45624906200001, 2020-06-12T02:39:07.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:39:07.581 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.581 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.581 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.582 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:39:07.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.582 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:07.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:07.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:39:07.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:39:07.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:39:07.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:39:07.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:39:07.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:39:07.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:39:07.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:07.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:39:07.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:39:07.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:39:07.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:39:07.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.595 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.595 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:39:07.595 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:39:07.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.597 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.597 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:39:07.597 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:39:07.597 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.597 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.598 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:39:07.598 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:39:07.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.599 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.600 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:07.602 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:07.602 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 217.456110126, 2020-06-12T02:39:07.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:39:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.603 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.604 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:39:07.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.604 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:07.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:07.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:39:07.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:39:07.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:39:07.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:39:07.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:39:07.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:39:07.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:39:07.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:39:07.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:39:07.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:07.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:39:07.612 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:39:07.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:39:07.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:39:07.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:39:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:39:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:39:07.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:39:07.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:39:07.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:39:07.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:39:07.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:39:07.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 217.45597428799999, 2020-06-12T02:39:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:39:07.619 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.620 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.620 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.620 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:39:07.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.621 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:07.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:07.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:39:07.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:39:07.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:39:07.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:39:07.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:39:07.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:39:07.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:39:07.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:39:07.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:39:07.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:07.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:39:07.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:39:07.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:39:07.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:39:07.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:39:07.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:39:07.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:39:07.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:39:07.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:39:07.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:39:07.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:39:07.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:39:07.638 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.639 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.639 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.640 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:07.640 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:07.640 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 216.43230944000001, 2020-06-12T02:39:07.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:39:07.641 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.641 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.641 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:07.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:39:07.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:39:07.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:39:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:39:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:39:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:39:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:39:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:39:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:39:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:39:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:39:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:39:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:39:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:39:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:39:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 208.38486553000001, 2020-06-12T02:39:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:39:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:39:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:39:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:39:07.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:39:07.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:39:07.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:39:07.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:39:07.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:39:07.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:07.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:39:07.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:39:07.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:39:07.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:39:07.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:39:07.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:39:07.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:39:07.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:39:07.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:39:07.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:39:07.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:39:07.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:39:07.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.669 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.669 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:39:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 202.641128487, 2020-06-12T02:39:07.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:39:07.671 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.671 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.671 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.672 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.672 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:07.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.673 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.673 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:07.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:39:07.673 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.673 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:39:07.674 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:39:07.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:39:07.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:39:07.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:39:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:39:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:39:07.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:39:07.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:39:07.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:39:07.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:39:07.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:39:07.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.681 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.682 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.682 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:39:07.682 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:07.682 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 202.64015511700001, 2020-06-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:39:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:39:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:39:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:39:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:39:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:39:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:39:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:39:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:39:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:39:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:39:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:39:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:39:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.694 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:39:07.695 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 202.63894599700001, 2020-06-12T02:39:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:39:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.696 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:39:07.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:39:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:39:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:39:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:39:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:39:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:39:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:39:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:39:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.705 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.706 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:39:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:07.707 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 202.637683012, 2020-06-12T02:39:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:39:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:39:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:39:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:39:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:39:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:39:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:39:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:39:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:39:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:39:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:39:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:39:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:39:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:39:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:39:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.718 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.626224885, 2020-06-12T02:39:07.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:39:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:39:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:39:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:39:07.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:39:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:39:07.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:39:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:39:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:39:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:39:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:39:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:39:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:39:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.730 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.62322384500001, 2020-06-12T02:39:07.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:39:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:39:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:39:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:39:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:39:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:39:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:39:07.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:39:07.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:39:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:39:07.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:39:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:39:07.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:39:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:39:07.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.743 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.60039784599999, 2020-06-12T02:39:07.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:39:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.745 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.746 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.746 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:39:07.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.746 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.747 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:07.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:07.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:39:07.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:39:07.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:39:07.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:39:07.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:39:07.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:39:07.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:39:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:39:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:39:07.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:07.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:39:07.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:39:07.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:39:07.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:39:07.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:39:07.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:39:07.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:39:07.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:39:07.760 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.761 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.762 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:07.762 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:07.762 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.60025245400001, 2020-06-12T02:39:07.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:39:07.763 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.763 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.764 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:39:07.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.764 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:07.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:07.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:39:07.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:39:07.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:39:07.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:39:07.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:39:07.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:39:07.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:39:07.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:07.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:39:07.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:39:07.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:39:07.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:39:07.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:07.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:39:07.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:39:07.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.776 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:39:07.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:39:07.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.777 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.778 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:07.778 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:07.778 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.56811117500001, 2020-06-12T02:39:07.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:39:07.778 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.779 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.779 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.779 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:07.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.781 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:07.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:39:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:39:07.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:39:07.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:39:07.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:39:07.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:39:07.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:39:07.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:39:07.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:39:07.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:39:07.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:39:07.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:39:07.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:39:07.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:39:07.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:39:07.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.792 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:07.792 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:07.792 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.56298454, 2020-06-12T02:39:07.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:39:07.793 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.793 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.793 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.793 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.794 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.794 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:39:07.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.794 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.796 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:07.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:39:07.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.796 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.796 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.797 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:39:07.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:39:07.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.797 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.798 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:39:07.799 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:39:07.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:39:07.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:39:07.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.800 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:39:07.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:39:07.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:39:07.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:39:07.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:39:07.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:39:07.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:39:07.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:39:07.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:39:07.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:39:07.807 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.808 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.808 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.808 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.56260553000001, 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:07.809 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.810 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.810 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.810 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:39:07.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.810 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:07.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.812 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.812 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.812 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:07.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:39:07.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.814 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.814 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:39:07.814 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:39:07.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.815 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.815 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:39:07.816 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:39:07.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.816 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.816 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:39:07.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:39:07.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:39:07.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:39:07.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:39:07.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:39:07.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:39:07.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:39:07.821 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.821 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:39:07.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:39:07.823 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.823 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.823 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.824 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:07.824 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:07.825 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.562388075, 2020-06-12T02:39:07.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:39:07.825 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.825 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.825 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.826 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.831 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.831 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:39:07.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.831 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:07.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:07.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:39:07.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:39:07.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:39:07.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:39:07.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:39:07.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:39:07.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:39:07.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:07.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:39:07.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:39:07.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:39:07.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:39:07.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.841 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:39:07.842 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:39:07.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.842 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.842 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.843 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.843 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:07.843 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:07.843 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.19844583, 2020-06-12T02:39:07.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:39:07.844 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.844 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.845 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:39:07.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.845 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.845 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.845 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.846 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:07.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:39:07.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.847 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.847 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:39:07.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:39:07.848 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:39:07.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:39:07.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:39:07.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:39:07.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:39:07.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:39:07.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:39:07.852 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:39:07.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:39:07.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:39:07.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.853 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.855 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.855 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:39:07.855 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:07.855 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.60939304300001, 2020-06-12T02:39:07.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:07.858 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:39:07.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.858 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:39:07.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:39:07.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.859 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:39:07.860 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:39:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:39:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:39:07.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:07.863 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:39:07.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:39:07.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.864 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:07.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:39:07.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:39:07.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.865 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.866 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.866 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:07.866 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 167.60635947, 2020-06-12T02:39:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:39:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:07.867 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:07.868 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:07.868 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:07.868 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:39:07.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.868 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:07.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:07.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:07.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:07.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.870 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:07.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:07.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:39:07.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.871 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:07.871 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:39:07.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:39:07.872 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.872 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:07.872 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:39:07.872 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:39:07.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:07.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:39:07.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:39:07.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:39:07.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:39:07.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:07.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:39:07.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:39:07.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:39:07.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:39:07.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:07.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:39:07.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:39:07.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:07.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:39:07.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:39:07.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:07.882 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:07.883 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:07.883 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:39:07.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:39:07.883 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.883 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.884 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.884 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:07.884 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:07.884 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:07.885 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:39:07.887 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:07.886+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:07.888 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:08.007 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:07.994+0000 7f74baeab700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:08.008 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:08.006+0000 7f74b9c49700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:08.008 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:08.005+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:08.041 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:08.042 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:08.043 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:08.043 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:08.043 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:08.053 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:08.074 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:08.083 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:39:08.101 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:08.114 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:08.110+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:08.116 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:08.138 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:08.163 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:08.187 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:08.188 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.188 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.188 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:08.189 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:08.189 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.189 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.189 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.189 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.190 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:39:08.191 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:08.192 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:08.216 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.216 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.226 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:08.234 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:08.234+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:08.316 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:08.313+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:08.332 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.332 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.341 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:08.418 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:08.417+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:08.456 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.456 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.468 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:08.519 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:08.513+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:08.568 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.569 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.578 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:08.626 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:08.626+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:08.682 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.682 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.695 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:08.738 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:08.738+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:08.821 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:08.817+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:08.849 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.849 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.860 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:08.922 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:08.922+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:08.973 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:08.973 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:08.982 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:09.022 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:09.017+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:09.123 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:09.121+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:09.139 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.140 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.149 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:09.224 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:09.221+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:09.253 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.254 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.267 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:09.325 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:09.322+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:09.382 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.383 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.392 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:09.428 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:09.429+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:09.529 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:09.525+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:09.545 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.545 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.554 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:09.631 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:09.629+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:09.672 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.672 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.682 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:09.768 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:09.765+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:09.832 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:09.830+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:09.834 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.835 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:09.844 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:09.933 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:09.929+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:09.996 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:09.996 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:10.006 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:10.034 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:10.034+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:10.103 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:39:10.135 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:10.129+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:10.165 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:10.165 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:10.174 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:10.193 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:39:10.214 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:10.206+0000 7fac24d93700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:10.218 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:10.218+0000 7fac1f59e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:10.236 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:10.234+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:10.296 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:10.294+0000 7fb925860700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:10.299 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:10.298+0000 7fb925860700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:10.327 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:10.327 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:10.331 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:10.336 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:10.338 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:10.333+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:10.353 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:10.374 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:10.395 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:10.422 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:10.439 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:10.437+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:10.447 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:10.448 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:10.448 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:10.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:10.449 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:10.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.449 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:10.449 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:10.452 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 219.296139834, 2020-06-12T02:39:10.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:39:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:10.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:10.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:39:10.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:39:10.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:39:10.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:39:10.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:39:10.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:39:10.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:39:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:39:10.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:39:10.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:39:10.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:39:10.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:39:10.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:39:10.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.485 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.485 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.491 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:39:10.491 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:10.492 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 214.14962632300001, 2020-06-12T02:39:10.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:39:10.492 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.492 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:10.492 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:10.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:10.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:39:10.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:39:10.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:39:10.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:39:10.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:39:10.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:39:10.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:39:10.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:39:10.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:39:10.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.506 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.506 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:39:10.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:39:10.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:39:10.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:39:10.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.508 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.508 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:39:10.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:39:10.509 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:39:10.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:39:10.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.510 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.510 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.472077649, 2020-06-12T02:39:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:39:10.512 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.512 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.512 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.512 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.512 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.513 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:39:10.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.513 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:10.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:39:10.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:39:10.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:39:10.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:39:10.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:39:10.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:39:10.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:39:10.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:39:10.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:39:10.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:10.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:39:10.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:39:10.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:39:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:39:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:39:10.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:39:10.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:39:10.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:39:10.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:39:10.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:39:10.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:39:10.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:39:10.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:39:10.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:39:10.535 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.535 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.535 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.536 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:10.536 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:10.536 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.471313721, 2020-06-12T02:39:10.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:39:10.536 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.537 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.537 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.537 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:39:10.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.538 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:10.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.540 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:10.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:39:10.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.540 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.541 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.541 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:39:10.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:39:10.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.543 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.543 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:39:10.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:39:10.544 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.544 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.545 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.545 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:39:10.545 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:39:10.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.545 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:39:10.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:39:10.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:39:10.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:39:10.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:10.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:39:10.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:39:10.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:39:10.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:39:10.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:10.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:39:10.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:39:10.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:39:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:39:10.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:39:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:39:10.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:39:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:39:10.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:39:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:39:10.555 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:10.556 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.24850866599999, 2020-06-12T02:39:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:39:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.557 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:39:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.558 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:10.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:39:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:39:10.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:39:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:39:10.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:39:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.563 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:39:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:39:10.565 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.567 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:39:10.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:39:10.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.569 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:39:10.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:39:10.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:39:10.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:39:10.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.573 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:39:10.573 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:39:10.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.574 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.574 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.574 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:39:10.575 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:39:10.575 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.575 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:39:10.576 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:39:10.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.577 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:39:10.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:39:10.578 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.579 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.579 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.579 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.580 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:10.580 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:10.581 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.24022237899999, 2020-06-12T02:39:10.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:39:10.581 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.582 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.582 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.582 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:39:10.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.583 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.583 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:10.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.584 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:39:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:39:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:39:10.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:39:10.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.587 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:39:10.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:39:10.589 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.589 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:39:10.590 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:39:10.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.590 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.590 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.590 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:39:10.591 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:39:10.592 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.592 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.592 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:39:10.592 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:39:10.593 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.593 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.593 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:39:10.593 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:39:10.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.594 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.594 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:39:10.594 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:39:10.595 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.595 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.595 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.596 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.596 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:10.596 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:10.596 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.23319313499999, 2020-06-12T02:39:10.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:39:10.597 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.597 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.598 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:39:10.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.598 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.598 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:10.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:39:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:39:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:39:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:39:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:39:10.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:39:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:39:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:39:10.605 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.606 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:39:10.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:39:10.606 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:39:10.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:39:10.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.608 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:39:10.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:39:10.609 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.609 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:10.610 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.23305568399999, 2020-06-12T02:39:10.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:39:10.611 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.611 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.611 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.611 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.612 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.612 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:39:10.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.612 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:10.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:39:10.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.615 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:39:10.616 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:39:10.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.616 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.616 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:39:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:39:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:39:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:39:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:39:10.619 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:39:10.620 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.620 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:39:10.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:39:10.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:39:10.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:39:10.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:39:10.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.623 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:10.624 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:10.624 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.43226794500001, 2020-06-12T02:39:10.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:39:10.624 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.624 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.625 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.625 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.625 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.625 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:39:10.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.627 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:10.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:39:10.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.628 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:39:10.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:39:10.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:39:10.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:39:10.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:39:10.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:10.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:39:10.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:39:10.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:39:10.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:39:10.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:10.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:39:10.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:39:10.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.635 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.635 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:39:10.635 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:39:10.636 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.636 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.636 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.636 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:39:10.636 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:39:10.637 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.637 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.637 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.637 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:39:10.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:39:10.638 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:39:10.639 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:39:10.639 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.640 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.640 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.640 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:10.641 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:10.641 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.43212133099999, 2020-06-12T02:39:10.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:39:10.641 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.641 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.643 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:10.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:39:10.645 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:39:10.645 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.645 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:39:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:39:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:39:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:39:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.647 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.650 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:39:10.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:39:10.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:39:10.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:39:10.653 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.653 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.653 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:39:10.654 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:39:10.655 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.655 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.655 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.655 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:39:10.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:39:10.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.656 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.656 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.656 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.656 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.657 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:10.657 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:10.657 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.47610845700001, 2020-06-12T02:39:10.657 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:39:10.657 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.658 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.658 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.658 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:10.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:10.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:39:10.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:39:10.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:39:10.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.662 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:39:10.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:39:10.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.664 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:39:10.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:39:10.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:39:10.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:39:10.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:39:10.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:39:10.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:39:10.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:39:10.669 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.669 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:39:10.669 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:39:10.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.671 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.671 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:39:10.671 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:39:10.671 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:10.673 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:10.673 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.47037694400001, 2020-06-12T02:39:10.673 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:39:10.673 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.673 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.674 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:10.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:39:10.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:39:10.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:39:10.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.679 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:39:10.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:39:10.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:39:10.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:39:10.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:39:10.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:39:10.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:39:10.684 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:39:10.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.685 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:39:10.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:39:10.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.686 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.686 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:39:10.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:39:10.686 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:10.687 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:10.688 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.469883428, 2020-06-12T02:39:10.688 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:39:10.688 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.688 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:10.688 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.689 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.689 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:39:10.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.689 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:10.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:39:10.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:39:10.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:39:10.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:39:10.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:39:10.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:39:10.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:39:10.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:39:10.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.695 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:39:10.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:39:10.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:39:10.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:39:10.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:39:10.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:39:10.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:39:10.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:39:10.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:10.703 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:39:10.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:39:10.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.704 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:39:10.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:39:10.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.705 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.705 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.706 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:10.706 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:10.706 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.469789421, 2020-06-12T02:39:10.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:39:10.707 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.707 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.707 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.708 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.708 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:39:10.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.708 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:10.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:10.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:39:10.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:39:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:39:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:39:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:39:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:39:10.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:39:10.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:39:10.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:39:10.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:39:10.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:39:10.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:10.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:39:10.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:39:10.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:39:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:39:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.721 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:39:10.721 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:10.721 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.43162839199999, 2020-06-12T02:39:10.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:39:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:10.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:39:10.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:39:10.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:39:10.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:39:10.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:39:10.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:39:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:39:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:39:10.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:39:10.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:10.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:39:10.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:39:10.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.732 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.732 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.39083139900001, 2020-06-12T02:39:10.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.734 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:39:10.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.736 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:10.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:10.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:39:10.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:39:10.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:39:10.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:39:10.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:39:10.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:39:10.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:39:10.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:39:10.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:39:10.744 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.744 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.744 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.745 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:10.745 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:10.745 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.39058933300001, 2020-06-12T02:39:10.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:39:10.746 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.746 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.746 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.746 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.746 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.747 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:39:10.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.747 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.747 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.747 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.748 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:10.749 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:39:10.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.749 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:39:10.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:39:10.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:39:10.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:39:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:39:10.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:39:10.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:39:10.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:39:10.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:39:10.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:39:10.755 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.756 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.756 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.757 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:10.757 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:10.757 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.390379642, 2020-06-12T02:39:10.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:39:10.757 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:10.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.759 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:10.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:39:10.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:39:10.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:39:10.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:39:10.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:39:10.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:39:10.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:39:10.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:39:10.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:39:10.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.767 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:39:10.768 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:10.769 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 169.37484548099999, 2020-06-12T02:39:10.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:39:10.769 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.769 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.769 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:10.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:39:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:39:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:39:10.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:39:10.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:39:10.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:39:10.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:39:10.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:39:10.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:39:10.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:39:10.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.778 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.778 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 160.476785447, 2020-06-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:10.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:39:10.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:10.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:39:10.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:39:10.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:10.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:39:10.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:39:10.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:10.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:39:10.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:39:10.790 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.791 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.791 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:10.791 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:10.791 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:10.793 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:10.793 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.794 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.794 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:10.794 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:10.794 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.794 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.795 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.795 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.795 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:39:10.795 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:10.796 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:10.796 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:10.794+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:10.796 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:10.895 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:10.894+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:10.950 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:10.950 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:10.951 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:10.951 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:10.960 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:10.997 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:10.994+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:11.072 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:11.072 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:11.073 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:11.073 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:11.087 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:11.125 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:39:11.135 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:11.133+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:11.198 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:11.198+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:11.200 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:11.200 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:11.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:11.200 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:11.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.201 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:213 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:11.201 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:11.201 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 221.07563231899999, 2020-06-12T02:39:11.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999, 2020-06-12T02:39:11.202 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.202 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.202 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.203 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.203 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 213 2020-06-12T02:39:11.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.203 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:11.205 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.206 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.206 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.206 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121941+0000", 2020-06-12T02:39:11.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9533999999999998e-05 2020-06-12T02:39:11.207 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.207 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.207 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.207 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121980+0000", 2020-06-12T02:39:11.207 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9320000000000008e-06 2020-06-12T02:39:11.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.208 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.121990+0000", 2020-06-12T02:39:11.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5664e-05 2020-06-12T02:39:11.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122016+0000", 2020-06-12T02:39:11.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8560000000000002e-06 2020-06-12T02:39:11.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122026+0000", 2020-06-12T02:39:11.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4331000000000003e-05 2020-06-12T02:39:11.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122110+0000", 2020-06-12T02:39:11.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0630000000000001e-05 2020-06-12T02:39:11.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:11.213 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122131+0000", 2020-06-12T02:39:11.213 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044966040000000004 2020-06-12T02:39:11.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126627+0000", 2020-06-12T02:39:11.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011648499999999999 2020-06-12T02:39:11.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.126744+0000", 2020-06-12T02:39:11.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00080537600000000001 2020-06-12T02:39:11.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.127549+0000", 2020-06-12T02:39:11.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046966789999999996 2020-06-12T02:39:11.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.132246+0000", 2020-06-12T02:39:11.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001881852 2020-06-12T02:39:11.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134128+0000", 2020-06-12T02:39:11.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000208335 2020-06-12T02:39:11.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.134336+0000", 2020-06-12T02:39:11.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012395277999999999 2020-06-12T02:39:11.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.221 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.222 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:214 1.cs0 1:3385b779:::smithi14213939-1:head [rollback 2] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:11.222 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:11.223 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 221.07549338300001, 2020-06-12T02:39:11.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736, 2020-06-12T02:39:11.223 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.223 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.223 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.224 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 214 2020-06-12T02:39:11.224 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.224 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:11.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122080+0000", 2020-06-12T02:39:11.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7330000000000002e-05 2020-06-12T02:39:11.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122137+0000", 2020-06-12T02:39:11.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0499999999999997e-06 2020-06-12T02:39:11.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122143+0000", 2020-06-12T02:39:11.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9599999999999995e-06 2020-06-12T02:39:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:39:11.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2029999999999997e-06 2020-06-12T02:39:11.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122159+0000", 2020-06-12T02:39:11.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2832999999999998e-05 2020-06-12T02:39:11.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122242+0000", 2020-06-12T02:39:11.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6680000000000007e-06 2020-06-12T02:39:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122251+0000", 2020-06-12T02:39:11.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064711279999999996 2020-06-12T02:39:11.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.234 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128722+0000", 2020-06-12T02:39:11.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016530599999999999 2020-06-12T02:39:11.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.128887+0000", 2020-06-12T02:39:11.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083393200000000001 2020-06-12T02:39:11.237 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.129721+0000", 2020-06-12T02:39:11.238 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036873180000000002 2020-06-12T02:39:11.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.238 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.238 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133408+0000", 2020-06-12T02:39:11.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041010120000000002 2020-06-12T02:39:11.239 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.239 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.239 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.239 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137509+0000", 2020-06-12T02:39:11.240 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6996000000000006e-05 2020-06-12T02:39:11.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.240 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.137586+0000", 2020-06-12T02:39:11.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015506736 2020-06-12T02:39:11.241 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.241 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.242 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.242 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:215 1.cs0 1:3385b779:::smithi14213939-1:head [append 0~0] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:11.242 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:11.243 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 221.075357545, 2020-06-12T02:39:11.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999, 2020-06-12T02:39:11.243 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.243 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.243 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.244 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.244 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 215 2020-06-12T02:39:11.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.244 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:11.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122216+0000", 2020-06-12T02:39:11.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4126000000000002e-05 2020-06-12T02:39:11.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122280+0000", 2020-06-12T02:39:11.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8619999999999997e-06 2020-06-12T02:39:11.249 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.249 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122287+0000", 2020-06-12T02:39:11.250 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3217000000000001e-05 2020-06-12T02:39:11.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.250 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.250 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122300+0000", 2020-06-12T02:39:11.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.464e-06 2020-06-12T02:39:11.251 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.251 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.251 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.251 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122304+0000", 2020-06-12T02:39:11.252 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4569e-05 2020-06-12T02:39:11.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.252 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.252 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122349+0000", 2020-06-12T02:39:11.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1946e-05 2020-06-12T02:39:11.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:11.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.122361+0000", 2020-06-12T02:39:11.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080389529999999997 2020-06-12T02:39:11.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.254 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130400+0000", 2020-06-12T02:39:11.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012484700000000001 2020-06-12T02:39:11.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.130525+0000", 2020-06-12T02:39:11.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00056172000000000004 2020-06-12T02:39:11.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.257 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.131086+0000", 2020-06-12T02:39:11.258 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0023494359999999999 2020-06-12T02:39:11.258 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.133436+0000", 2020-06-12T02:39:11.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047948310000000003 2020-06-12T02:39:11.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138231+0000", 2020-06-12T02:39:11.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5949000000000002e-05 2020-06-12T02:39:11.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:30.138296+0000", 2020-06-12T02:39:11.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016080919999999999 2020-06-12T02:39:11.261 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.261 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.261 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.262 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s2 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:11.262 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:11.262 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 220.05169269699999, 2020-06-12T02:39:11.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997, 2020-06-12T02:39:11.263 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.263 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.263 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:11.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.264 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.265 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.265 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145880+0000", 2020-06-12T02:39:11.265 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031383679999999999 2020-06-12T02:39:11.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.266 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.266 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149019+0000", 2020-06-12T02:39:11.267 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2763999999999999e-05 2020-06-12T02:39:11.267 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.267 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.267 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149062+0000", 2020-06-12T02:39:11.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1658000000000002e-05 2020-06-12T02:39:11.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149083+0000", 2020-06-12T02:39:11.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.106e-06 2020-06-12T02:39:11.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149091+0000", 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103751 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149195+0000", 2020-06-12T02:39:11.271 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4582999999999997e-05 2020-06-12T02:39:11.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.272 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.149230+0000", 2020-06-12T02:39:11.272 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065580450000000002 2020-06-12T02:39:11.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.273 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.273 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.273 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155788+0000", 2020-06-12T02:39:11.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4517000000000005e-05 2020-06-12T02:39:11.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.274 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.274 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.274 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155862+0000", 2020-06-12T02:39:11.275 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099817919999999997 2020-06-12T02:39:11.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.275 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.275 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.275 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:333 1.cs0 1:3385b779:::smithi14213939-1:head [delete] snapc c=[c,b,a,7,4] ondisk+write+peerstat_old+known_if_redirected e32)", 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 212.00424878699999, 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559, 2020-06-12T02:39:11.276 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.277 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.277 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.277 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 333 2020-06-12T02:39:11.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.278 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193324+0000", 2020-06-12T02:39:11.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000162607 2020-06-12T02:39:11.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.280 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.280 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193487+0000", 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9736000000000001e-05 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193517+0000", 2020-06-12T02:39:11.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5646999999999998e-05 2020-06-12T02:39:11.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.282 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193572+0000", 2020-06-12T02:39:11.282 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0296999999999999e-05 2020-06-12T02:39:11.283 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.283 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.283 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193593+0000", 2020-06-12T02:39:11.283 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001983 2020-06-12T02:39:11.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193791+0000", 2020-06-12T02:39:11.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7051e-05 2020-06-12T02:39:11.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:11.285 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.193808+0000", 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0069251269999999997 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200733+0000", 2020-06-12T02:39:11.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010849300000000001 2020-06-12T02:39:11.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.200842+0000", 2020-06-12T02:39:11.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001165588 2020-06-12T02:39:11.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.288 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.288 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.202007+0000", 2020-06-12T02:39:11.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028861809999999998 2020-06-12T02:39:11.289 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.289 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.289 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.204893+0000", 2020-06-12T02:39:11.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012619370000000001 2020-06-12T02:39:11.290 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.291 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206155+0000", 2020-06-12T02:39:11.291 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.4594999999999998e-05 2020-06-12T02:39:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:39.206250+0000", 2020-06-12T02:39:11.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012925559 2020-06-12T02:39:11.293 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.293 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.293 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.294 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=160, reqid=client.4555.0:444, at_version=38'47, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:39:11.294 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:11.295 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.26051174400001, 2020-06-12T02:39:11.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008, 2020-06-12T02:39:11.295 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.295 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.295 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:11.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.937061+0000", 2020-06-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020692829999999999 2020-06-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939131+0000", 2020-06-12T02:39:11.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2094999999999997e-05 2020-06-12T02:39:11.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939163+0000", 2020-06-12T02:39:11.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6052000000000001e-05 2020-06-12T02:39:11.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939189+0000", 2020-06-12T02:39:11.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3311e-05 2020-06-12T02:39:11.304 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.305 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.305 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939202+0000", 2020-06-12T02:39:11.305 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1643999999999994e-05 2020-06-12T02:39:11.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.306 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.306 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939274+0000", 2020-06-12T02:39:11.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8578000000000001e-05 2020-06-12T02:39:11.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.307 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.307 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.307 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939292+0000", 2020-06-12T02:39:11.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007421619 2020-06-12T02:39:11.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946714+0000", 2020-06-12T02:39:11.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3473000000000006e-05 2020-06-12T02:39:11.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.946787+0000", 2020-06-12T02:39:11.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097260550000000008 2020-06-12T02:39:11.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.310 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.310 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.311 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=230, reqid=osd.1.0:230, at_version=38'62, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:39:11.311 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:11.311 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.25953837399999, 2020-06-12T02:39:11.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999, 2020-06-12T02:39:11.312 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.312 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.312 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:11.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938035+0000", 2020-06-12T02:39:11.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0473000000000003e-05 2020-06-12T02:39:11.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.315 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938085+0000", 2020-06-12T02:39:11.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4193000000000003e-05 2020-06-12T02:39:11.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938119+0000", 2020-06-12T02:39:11.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6434000000000001e-05 2020-06-12T02:39:11.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938146+0000", 2020-06-12T02:39:11.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0077e-05 2020-06-12T02:39:11.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938156+0000", 2020-06-12T02:39:11.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9996e-05 2020-06-12T02:39:11.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.323 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.323 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.323 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938216+0000", 2020-06-12T02:39:11.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4409e-05 2020-06-12T02:39:11.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.938230+0000", 2020-06-12T02:39:11.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097239049999999997 2020-06-12T02:39:11.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.947954+0000", 2020-06-12T02:39:11.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109306 2020-06-12T02:39:11.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.948064+0000", 2020-06-12T02:39:11.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010028792999999999 2020-06-12T02:39:11.327 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.327 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.328 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.328 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 38/18 ECSubWrite(tid=231, reqid=osd.1.0:231, at_version=38'64, trim_to=0'0, roll_forward_to=38'60))", 2020-06-12T02:39:11.329 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:11.329 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.25832925399999, 2020-06-12T02:39:11.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001, 2020-06-12T02:39:11.329 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.330 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.330 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:11.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939244+0000", 2020-06-12T02:39:11.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0324000000000001e-05 2020-06-12T02:39:11.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939294+0000", 2020-06-12T02:39:11.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4372e-05 2020-06-12T02:39:11.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939319+0000", 2020-06-12T02:39:11.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3529999999999999e-05 2020-06-12T02:39:11.334 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.334 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.334 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.335 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939332+0000", 2020-06-12T02:39:11.335 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1929999999999998e-06 2020-06-12T02:39:11.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.335 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.336 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.939338+0000", 2020-06-12T02:39:11.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044866050000000003 2020-06-12T02:39:11.336 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.336 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.337 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.337 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943825+0000", 2020-06-12T02:39:11.337 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7830999999999999e-05 2020-06-12T02:39:11.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.337 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943843+0000", 2020-06-12T02:39:11.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059970620000000001 2020-06-12T02:39:11.338 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949840+0000", 2020-06-12T02:39:11.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5625999999999998e-05 2020-06-12T02:39:11.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949905+0000", 2020-06-12T02:39:11.342 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010661543000000001 2020-06-12T02:39:11.342 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.342 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.342 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 38/18 ECSubWrite(tid=163, reqid=osd.2.0:163, at_version=38'51, trim_to=0'0, roll_forward_to=36'46))", 2020-06-12T02:39:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:11.343 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 206.25706626900001, 2020-06-12T02:39:11.344 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001, 2020-06-12T02:39:11.344 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.344 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.344 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.344 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.345 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.345 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:11.345 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.345 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.345 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.346 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.346 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940507+0000", 2020-06-12T02:39:11.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6802999999999998e-05 2020-06-12T02:39:11.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.346 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940564+0000", 2020-06-12T02:39:11.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6816999999999998e-05 2020-06-12T02:39:11.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940580+0000", 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3154e-05 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940594+0000", 2020-06-12T02:39:11.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9700000000000001e-06 2020-06-12T02:39:11.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.940598+0000", 2020-06-12T02:39:11.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032407550000000001 2020-06-12T02:39:11.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943838+0000", 2020-06-12T02:39:11.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7031e-05 2020-06-12T02:39:11.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.943855+0000", 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0060195839999999997 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949875+0000", 2020-06-12T02:39:11.353 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9451999999999999e-05 2020-06-12T02:39:11.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.353 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.353 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.949934+0000", 2020-06-12T02:39:11.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094275660000000001 2020-06-12T02:39:11.354 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.354 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.354 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.354 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.355 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.5s1 59/18 ECSubWrite(tid=316, reqid=osd.2.0:316, at_version=59'95, trim_to=0'0, roll_forward_to=54'93))", 2020-06-12T02:39:11.355 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:11.355 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 185.24560814200001, 2020-06-12T02:39:11.355 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005, 2020-06-12T02:39:11.356 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.356 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.356 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:11.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.951965+0000", 2020-06-12T02:39:11.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0432000000000001e-05 2020-06-12T02:39:11.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.359 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952015+0000", 2020-06-12T02:39:11.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6111000000000001e-05 2020-06-12T02:39:11.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.360 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952042+0000", 2020-06-12T02:39:11.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5625e-05 2020-06-12T02:39:11.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952057+0000", 2020-06-12T02:39:11.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1240000000000002e-06 2020-06-12T02:39:11.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952063+0000", 2020-06-12T02:39:11.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8876999999999999e-05 2020-06-12T02:39:11.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952122+0000", 2020-06-12T02:39:11.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3223e-05 2020-06-12T02:39:11.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.952135+0000", 2020-06-12T02:39:11.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097460619999999998 2020-06-12T02:39:11.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961881+0000", 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7126999999999997e-05 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.961939+0000", 2020-06-12T02:39:11.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099735810000000005 2020-06-12T02:39:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.367 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.7s1 59/54 ECSubWrite(tid=222, reqid=osd.0.0:222, at_version=59'116, trim_to=0'0, roll_forward_to=56'112))", 2020-06-12T02:39:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 185.24260710199999, 2020-06-12T02:39:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158, 2020-06-12T02:39:11.368 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.369 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:11.370 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.371 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.954966+0000", 2020-06-12T02:39:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6525000000000004e-05 2020-06-12T02:39:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.372 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955033+0000", 2020-06-12T02:39:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5905e-05 2020-06-12T02:39:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.373 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955058+0000", 2020-06-12T02:39:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7238e-05 2020-06-12T02:39:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.374 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955076+0000", 2020-06-12T02:39:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7279999999999998e-06 2020-06-12T02:39:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.375 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955082+0000", 2020-06-12T02:39:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062890799999999996 2020-06-12T02:39:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.376 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955711+0000", 2020-06-12T02:39:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2503999999999999e-05 2020-06-12T02:39:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.377 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955724+0000", 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010015143000000001 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.378 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965739+0000", 2020-06-12T02:39:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6206999999999998e-05 2020-06-12T02:39:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.379 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.965805+0000", 2020-06-12T02:39:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010839158 2020-06-12T02:39:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.380 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:785 1.cs0 1:3385b779:::smithi14213939-1:head [copy-from ver 0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:11.381 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.219781103, 2020-06-12T02:39:11.382 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003, 2020-06-12T02:39:11.382 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.382 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:11.382 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.383 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.383 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.383 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 785 2020-06-12T02:39:11.383 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.383 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.384 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.385 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.385 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977792+0000", 2020-06-12T02:39:11.385 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.8150999999999999e-05 2020-06-12T02:39:11.386 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.387 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.387 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.387 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977850+0000", 2020-06-12T02:39:11.387 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.391e-06 2020-06-12T02:39:11.387 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.388 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.388 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.388 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977858+0000", 2020-06-12T02:39:11.388 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4082e-05 2020-06-12T02:39:11.389 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.389 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.389 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.390 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977872+0000", 2020-06-12T02:39:11.390 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4599999999999997e-06 2020-06-12T02:39:11.390 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.391 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.391 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.391 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977879+0000", 2020-06-12T02:39:11.391 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00042631599999999999 2020-06-12T02:39:11.392 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.392 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.392 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.393 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978305+0000", 2020-06-12T02:39:11.393 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7761000000000002e-05 2020-06-12T02:39:11.393 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.394 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.394 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:11.394 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978323+0000", 2020-06-12T02:39:11.395 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005307778 2020-06-12T02:39:11.395 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.396 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.396 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.397 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983631+0000", 2020-06-12T02:39:11.397 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012852799999999999 2020-06-12T02:39:11.397 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.398 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.398 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.398 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983759+0000", 2020-06-12T02:39:11.399 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033054270000000001 2020-06-12T02:39:11.399 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.399 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.400 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.400 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987065+0000", 2020-06-12T02:39:11.400 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092728940000000003 2020-06-12T02:39:11.400 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.401 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.401 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.401 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.402 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.402 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:786 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:11.402 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:11.403 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.219635711, 2020-06-12T02:39:11.403 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001, 2020-06-12T02:39:11.403 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.404 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.404 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.404 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.405 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.405 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 786 2020-06-12T02:39:11.405 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.405 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.406 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.406 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.406 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:11.407 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.407 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.407 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.407 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.408 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977937+0000", 2020-06-12T02:39:11.408 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.9666000000000002e-05 2020-06-12T02:39:11.408 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.408 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.408 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.409 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977987+0000", 2020-06-12T02:39:11.409 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7459999999999995e-06 2020-06-12T02:39:11.409 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.410 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.410 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.410 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977997+0000", 2020-06-12T02:39:11.411 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4939e-05 2020-06-12T02:39:11.411 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.411 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.412 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.412 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978012+0000", 2020-06-12T02:39:11.412 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9569999999999999e-06 2020-06-12T02:39:11.413 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.413 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.413 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.414 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978018+0000", 2020-06-12T02:39:11.414 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043765500000000001 2020-06-12T02:39:11.414 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.415 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.415 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.415 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978455+0000", 2020-06-12T02:39:11.416 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2702e-05 2020-06-12T02:39:11.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.416 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.416 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:11.417 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978468+0000", 2020-06-12T02:39:11.418 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054858509999999999 2020-06-12T02:39:11.418 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.418 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.419 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.419 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.983954+0000", 2020-06-12T02:39:11.419 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2460999999999997e-05 2020-06-12T02:39:11.419 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.420 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.420 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:11.420 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.984016+0000", 2020-06-12T02:39:11.421 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003144216 2020-06-12T02:39:11.421 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.421 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.421 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.422 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987161+0000", 2020-06-12T02:39:11.422 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012853499999999999 2020-06-12T02:39:11.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.422 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.423 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.423 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987289+0000", 2020-06-12T02:39:11.423 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0093517280000000001 2020-06-12T02:39:11.423 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.424 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.424 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.424 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.425 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:800 1.cs0 1:3385b779:::smithi14213939-1:head [write 551296~693520] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:11.425 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:11.425 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.18749443199999, 2020-06-12T02:39:11.425 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055, 2020-06-12T02:39:11.425 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.426 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.426 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.426 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 800 2020-06-12T02:39:11.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.429 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.429 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.429 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.430 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:11.430 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.430 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.431 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.431 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.431 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010079+0000", 2020-06-12T02:39:11.431 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012397129999999999 2020-06-12T02:39:11.432 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.432 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.432 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.432 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011318+0000", 2020-06-12T02:39:11.433 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3959999999999995e-06 2020-06-12T02:39:11.433 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.434 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.435 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.435 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011328+0000", 2020-06-12T02:39:11.435 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6708999999999999e-05 2020-06-12T02:39:11.435 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.435 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.436 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.436 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011344+0000", 2020-06-12T02:39:11.436 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0173999999999999e-05 2020-06-12T02:39:11.436 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.436 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.437 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.437 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011355+0000", 2020-06-12T02:39:11.437 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4957999999999996e-05 2020-06-12T02:39:11.437 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.437 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.438 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.438 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011430+0000", 2020-06-12T02:39:11.438 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000117099 2020-06-12T02:39:11.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011547+0000", 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018782479999999999 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.439 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.440 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.440 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.013425+0000", 2020-06-12T02:39:11.440 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011635972 2020-06-12T02:39:11.440 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.440 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.441 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.441 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025061+0000", 2020-06-12T02:39:11.441 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0671e-05 2020-06-12T02:39:11.441 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.441 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.442 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.442 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025152+0000", 2020-06-12T02:39:11.442 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012761000000000001 2020-06-12T02:39:11.442 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.442 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.443 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.443 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025279+0000", 2020-06-12T02:39:11.443 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01520055 2020-06-12T02:39:11.443 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.443 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.444 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.444 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.444 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:801 1.cs0 1:3385b779:::smithi14213939-1:head [write 2024048~127248] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:11.444 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:11.445 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.18236779700001, 2020-06-12T02:39:11.445 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001, 2020-06-12T02:39:11.445 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.445 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.445 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.446 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.446 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.446 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 801 2020-06-12T02:39:11.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.447 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.447 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.447 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.447 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:11.447 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.448 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.448 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.448 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.448 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015205+0000", 2020-06-12T02:39:11.448 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024325200000000001 2020-06-12T02:39:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015449+0000", 2020-06-12T02:39:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2283000000000001e-05 2020-06-12T02:39:11.450 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.450 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.450 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.450 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015461+0000", 2020-06-12T02:39:11.450 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7971999999999999e-05 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015489+0000", 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6819999999999998e-06 2020-06-12T02:39:11.451 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.452 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.452 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.452 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015498+0000", 2020-06-12T02:39:11.452 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011071200000000001 2020-06-12T02:39:11.452 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.453 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.453 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.453 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015609+0000", 2020-06-12T02:39:11.453 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00018369799999999999 2020-06-12T02:39:11.453 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015793+0000", 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018499059999999999 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.454 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.455 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.455 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.017643+0000", 2020-06-12T02:39:11.455 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084709710000000008 2020-06-12T02:39:11.455 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.455 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026114+0000", 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011773 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.456 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.457 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026232+0000", 2020-06-12T02:39:11.457 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015125300000000001 2020-06-12T02:39:11.457 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.457 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.457 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026383+0000", 2020-06-12T02:39:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011177459000000001 2020-06-12T02:39:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:802 1.cs0 1:3385b779:::smithi14213939-1:head [setxattr _header (56) in=7b,truncate 2151296] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.18198878699999, 2020-06-12T02:39:11.459 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999, 2020-06-12T02:39:11.460 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.460 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:11.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.460 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.461 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 802 2020-06-12T02:39:11.461 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.461 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.461 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.461 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.462 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:11.462 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.463 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.463 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.463 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.463 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015584+0000", 2020-06-12T02:39:11.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011105200000000001 2020-06-12T02:39:11.464 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.464 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.464 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015695+0000", 2020-06-12T02:39:11.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5259999999999999e-06 2020-06-12T02:39:11.465 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.465 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.465 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.465 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015705+0000", 2020-06-12T02:39:11.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8556999999999999e-05 2020-06-12T02:39:11.466 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015723+0000", 2020-06-12T02:39:11.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3359999999999997e-06 2020-06-12T02:39:11.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015731+0000", 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007025028 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022756+0000", 2020-06-12T02:39:11.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012740200000000001 2020-06-12T02:39:11.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.022883+0000", 2020-06-12T02:39:11.470 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00067993000000000003 2020-06-12T02:39:11.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.023563+0000", 2020-06-12T02:39:11.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028737569999999998 2020-06-12T02:39:11.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.471 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026437+0000", 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00069671299999999995 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:11.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027134+0000", 2020-06-12T02:39:11.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017499400000000001 2020-06-12T02:39:11.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.027309+0000", 2020-06-12T02:39:11.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011724294999999999 2020-06-12T02:39:11.474 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.474 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.475 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.476 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.476 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:803 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:11.476 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:11.476 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.18177133200001, 2020-06-12T02:39:11.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001, 2020-06-12T02:39:11.477 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.477 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:11.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.477 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.478 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 803 2020-06-12T02:39:11.478 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:11.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015802+0000", 2020-06-12T02:39:11.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7576999999999994e-05 2020-06-12T02:39:11.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015869+0000", 2020-06-12T02:39:11.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2099999999999999e-06 2020-06-12T02:39:11.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.481 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015879+0000", 2020-06-12T02:39:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8709999999999999e-05 2020-06-12T02:39:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015897+0000", 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0312999999999999e-05 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.015908+0000", 2020-06-12T02:39:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010029244 2020-06-12T02:39:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.025937+0000", 2020-06-12T02:39:11.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6257999999999999e-05 2020-06-12T02:39:11.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:11.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.026033+0000", 2020-06-12T02:39:11.490 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024310030000000002 2020-06-12T02:39:11.491 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.491 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.491 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.491 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028464+0000", 2020-06-12T02:39:11.492 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012464799999999999 2020-06-12T02:39:11.492 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.492 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.492 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.492 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.028589+0000", 2020-06-12T02:39:11.493 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0052731870000000004 2020-06-12T02:39:11.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.033862+0000", 2020-06-12T02:39:11.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018060150000000001 2020-06-12T02:39:11.494 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.494 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.494 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.495 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:837 1.cs0 1:3385b779:::smithi14213939-1:head [read 0~2151296,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:11.495 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:11.495 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 175.81782908700001, 2020-06-12T02:39:11.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001, 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.496 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 837 2020-06-12T02:39:11.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.497 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:11.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379744+0000", 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103578 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379848+0000", 2020-06-12T02:39:11.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3269999999999997e-06 2020-06-12T02:39:11.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379854+0000", 2020-06-12T02:39:11.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2847000000000001e-05 2020-06-12T02:39:11.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.501 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.501 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379867+0000", 2020-06-12T02:39:11.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1780000000000002e-06 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379872+0000", 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041587880000000001 2020-06-12T02:39:11.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384031+0000", 2020-06-12T02:39:11.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012939599999999999 2020-06-12T02:39:11.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.384160+0000", 2020-06-12T02:39:11.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0073618360000000001 2020-06-12T02:39:11.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.391522+0000", 2020-06-12T02:39:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011777950000000001 2020-06-12T02:39:11.505 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.506 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.506 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.508 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.fs2 73/18 ECSubWrite(tid=232, reqid=client.4555.0:923, at_version=73'44, trim_to=0'0, roll_forward_to=72'42))", 2020-06-12T02:39:11.508 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:11.508 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.22877629999999, 2020-06-12T02:39:11.508 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999, 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.509 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.968797+0000", 2020-06-12T02:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053143799999999996 2020-06-12T02:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969328+0000", 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2104000000000002e-05 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969370+0000", 2020-06-12T02:39:11.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7149e-05 2020-06-12T02:39:11.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969397+0000", 2020-06-12T02:39:11.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.411e-05 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969412+0000", 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3948000000000003e-05 2020-06-12T02:39:11.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969496+0000", 2020-06-12T02:39:11.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8991000000000002e-05 2020-06-12T02:39:11.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:11.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.969515+0000", 2020-06-12T02:39:11.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0094973060000000005 2020-06-12T02:39:11.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979012+0000", 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3671999999999996e-05 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.979076+0000", 2020-06-12T02:39:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010278717999999999 2020-06-12T02:39:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:931 1.cs0 1:3385b779:::smithi14213939-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.22574272700001, 2020-06-12T02:39:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999, 2020-06-12T02:39:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 931 2020-06-12T02:39:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:11.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.522 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:11.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971830+0000", 2020-06-12T02:39:11.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2381999999999999e-05 2020-06-12T02:39:11.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971903+0000", 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0533999999999999e-05 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:11.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971913+0000", 2020-06-12T02:39:11.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0726000000000001e-05 2020-06-12T02:39:11.525 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.525 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971934+0000", 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8210000000000002e-06 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:11.526 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.971942+0000", 2020-06-12T02:39:11.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022829600000000001 2020-06-12T02:39:11.527 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.527 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.527 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.527 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972170+0000", 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1507e-05 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972182+0000", 2020-06-12T02:39:11.528 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013910050000000001 2020-06-12T02:39:11.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973573+0000", 2020-06-12T02:39:11.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0827000000000003e-05 2020-06-12T02:39:11.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:11.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973663+0000", 2020-06-12T02:39:11.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0071466480000000002 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980810+0000", 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010977200000000001 2020-06-12T02:39:11.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.532 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:11.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.980920+0000", 2020-06-12T02:39:11.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000122185 2020-06-12T02:39:11.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981042+0000", 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092117029999999999 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.534 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:11.534 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:11.534 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:11.536 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:11.536 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:11.533+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:11.637 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:11.633+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:11.708 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:11.709 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:11.709 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:11.709 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:11.718 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:11.738 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:11.738+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:11.839 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:11.837+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:11.866 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:11.867 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:11.867 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:11.867 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:11.867 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:11.878 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:11.940 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:11.938+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:12.034 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:12.035 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:12.035 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:12.035 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:12.035 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.035 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:417 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e37)", 2020-06-12T02:39:12.036 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:39:12.037 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 207.782421597, 2020-06-12T02:39:12.037 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999, 2020-06-12T02:39:12.037 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.038 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.038 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.039 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.039 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 417 2020-06-12T02:39:12.039 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.039 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.039 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.040 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.040 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:39:12.040 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.040 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.040 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.041 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.041 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248456+0000", 2020-06-12T02:39:12.041 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016392699999999999 2020-06-12T02:39:12.041 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.041 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.042 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.043 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248620+0000", 2020-06-12T02:39:12.043 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1613000000000001e-05 2020-06-12T02:39:12.043 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.043 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.044 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.044 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248642+0000", 2020-06-12T02:39:12.044 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7839999999999997e-05 2020-06-12T02:39:12.044 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.044 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.045 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.045 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248679+0000", 2020-06-12T02:39:12.045 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6957e-05 2020-06-12T02:39:12.045 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.045 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.248696+0000", 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0064089500000000001 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.046 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255105+0000", 2020-06-12T02:39:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5202000000000002e-05 2020-06-12T02:39:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.047 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.048 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.255191+0000", 2020-06-12T02:39:12.048 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046252489999999997 2020-06-12T02:39:12.048 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.048 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.048 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.049 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259816+0000", 2020-06-12T02:39:12.049 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015170599999999999 2020-06-12T02:39:12.049 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.049 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.259967+0000", 2020-06-12T02:39:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057289630000000001 2020-06-12T02:39:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.051 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.051 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.265696+0000", 2020-06-12T02:39:12.051 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017240406999999999 2020-06-12T02:39:12.051 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.051 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.052 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.052 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.052 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.052 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:420 1.4s0 1:2125ca89:::smithi14213939-28:head [sparse-read 0~2453789] snapc 0=[] ondisk+read+known_if_redirected e37)", 2020-06-12T02:39:12.052 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:39:12.053 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 207.781004545, 2020-06-12T02:39:12.053 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789, 2020-06-12T02:39:12.053 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.053 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.053 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 420 2020-06-12T02:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.055 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.056 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.056 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.249873+0000", 2020-06-12T02:39:12.056 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000158336 2020-06-12T02:39:12.056 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.057 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.057 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.057 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250031+0000", 2020-06-12T02:39:12.057 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6169999999999999e-05 2020-06-12T02:39:12.058 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.058 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.058 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.058 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250048+0000", 2020-06-12T02:39:12.058 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6506000000000001e-05 2020-06-12T02:39:12.059 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.059 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.059 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.059 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250064+0000", 2020-06-12T02:39:12.060 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1940000000000001e-06 2020-06-12T02:39:12.060 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.060 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.060 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.060 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.250071+0000", 2020-06-12T02:39:12.061 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01103871 2020-06-12T02:39:12.061 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.061 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.061 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.061 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261110+0000", 2020-06-12T02:39:12.062 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00029468799999999998 2020-06-12T02:39:12.062 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.062 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.062 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.062 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.261405+0000", 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066641850000000004 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:44.268069+0000", 2020-06-12T02:39:12.063 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018195789 2020-06-12T02:39:12.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.064 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.064 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.064 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.064 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.065 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:673 1.4s0 1:2207f711:::smithi14213939-36:head [write 564735~613734,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.065 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:39:12.065 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.07044055700001, 2020-06-12T02:39:12.065 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001, 2020-06-12T02:39:12.065 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 673 2020-06-12T02:39:12.066 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.067 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.067 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.067 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.067 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:39:12.067 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.068 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.068 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.068 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.068 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960437+0000", 2020-06-12T02:39:12.068 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001645065 2020-06-12T02:39:12.069 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.069 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.069 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.069 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962082+0000", 2020-06-12T02:39:12.070 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1517e-05 2020-06-12T02:39:12.070 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.070 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.070 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.070 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962094+0000", 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.615e-05 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962110+0000", 2020-06-12T02:39:12.071 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5109999999999997e-06 2020-06-12T02:39:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962117+0000", 2020-06-12T02:39:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4492000000000004e-05 2020-06-12T02:39:12.073 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.073 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.073 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.073 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962192+0000", 2020-06-12T02:39:12.073 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014612300000000001 2020-06-12T02:39:12.074 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.074 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.074 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.074 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962338+0000", 2020-06-12T02:39:12.074 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.007352127 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969690+0000", 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013285 2020-06-12T02:39:12.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.076 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.076 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.076 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.969823+0000", 2020-06-12T02:39:12.076 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0062911410000000001 2020-06-12T02:39:12.076 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.077 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.077 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.077 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976114+0000", 2020-06-12T02:39:12.077 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0048529230000000003 2020-06-12T02:39:12.077 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.078 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.078 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.078 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.980967+0000", 2020-06-12T02:39:12.078 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089663969999999992 2020-06-12T02:39:12.078 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.989933+0000", 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000219853 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.079 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.080 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.080 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990153+0000", 2020-06-12T02:39:12.080 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.029716149000000001 2020-06-12T02:39:12.081 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.081 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.081 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.081 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.081 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:674 1.4s0 1:2207f711:::smithi14213939-36:head [write 1828021~669034] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.062759255, 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999, 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.082 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.083 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.083 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 674 2020-06-12T02:39:12.083 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.084 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.084 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.084 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.084 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:39:12.084 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.968118+0000", 2020-06-12T02:39:12.085 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002363862 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970482+0000", 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0742e-05 2020-06-12T02:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.087 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.087 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.087 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970493+0000", 2020-06-12T02:39:12.087 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4827000000000001e-05 2020-06-12T02:39:12.087 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.088 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.088 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.088 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970508+0000", 2020-06-12T02:39:12.088 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.17e-06 2020-06-12T02:39:12.088 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.970515+0000", 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001510345 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.089 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.090 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.090 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972025+0000", 2020-06-12T02:39:12.090 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000130715 2020-06-12T02:39:12.090 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.091 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.091 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.091 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972156+0000", 2020-06-12T02:39:12.091 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018116816000000001 2020-06-12T02:39:12.091 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.092 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.092 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.093 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990273+0000", 2020-06-12T02:39:12.093 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015155 2020-06-12T02:39:12.093 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.093 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.093 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.094 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990424+0000", 2020-06-12T02:39:12.094 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015714796 2020-06-12T02:39:12.094 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.094 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.094 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.006139+0000", 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080662210000000002 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.095 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014205+0000", 2020-06-12T02:39:12.096 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024989100000000002 2020-06-12T02:39:12.096 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.096 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.096 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.096 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014455+0000", 2020-06-12T02:39:12.097 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011373499999999999 2020-06-12T02:39:12.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.097 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.097 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.097 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014569+0000", 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.046450669999999999 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.098 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.099 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:675 1.4s0 1:2207f711:::smithi14213939-36:head [write 3134120~630615] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.099 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:39:12.099 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.053703958, 2020-06-12T02:39:12.099 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002, 2020-06-12T02:39:12.099 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.100 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.100 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.100 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.100 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 675 2020-06-12T02:39:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.101 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.102 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:39:12.102 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.102 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.102 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.103 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.977174+0000", 2020-06-12T02:39:12.103 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00083608700000000001 2020-06-12T02:39:12.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.103 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.103 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.104 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978010+0000", 2020-06-12T02:39:12.104 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0117e-05 2020-06-12T02:39:12.104 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.105 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.105 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.105 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978020+0000", 2020-06-12T02:39:12.105 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5985999999999999e-05 2020-06-12T02:39:12.106 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.106 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.114 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.114 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978036+0000", 2020-06-12T02:39:12.114 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1229999999999999e-05 2020-06-12T02:39:12.114 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.115 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.115 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.115 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978047+0000", 2020-06-12T02:39:12.115 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033714200000000002 2020-06-12T02:39:12.115 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.116 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.116 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.116 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978384+0000", 2020-06-12T02:39:12.116 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014741 2020-06-12T02:39:12.116 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.117 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.117 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.117 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978532+0000", 2020-06-12T02:39:12.117 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012346197 2020-06-12T02:39:12.117 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990878+0000", 2020-06-12T02:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6348999999999997e-05 2020-06-12T02:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.990954+0000", 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016970203999999999 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.119 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.120 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.120 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.007924+0000", 2020-06-12T02:39:12.120 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0066872479999999998 2020-06-12T02:39:12.120 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.120 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.121 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.121 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014612+0000", 2020-06-12T02:39:12.121 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016046499999999999 2020-06-12T02:39:12.121 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.122 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.122 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.122 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014772+0000", 2020-06-12T02:39:12.122 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000108582 2020-06-12T02:39:12.122 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.123 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.123 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.123 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014881+0000", 2020-06-12T02:39:12.123 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.037707017000000002 2020-06-12T02:39:12.123 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.124 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.124 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.124 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.124 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.124 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:676 1.4s0 1:2207f711:::smithi14213939-36:head [setxattr _header (57) in=7b,truncate 3764735] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.125 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:39:12.125 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.052764419, 2020-06-12T02:39:12.125 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001, 2020-06-12T02:39:12.125 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.125 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 676 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.126 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.127 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.127 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.127 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:39:12.127 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.127 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.128 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.128 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.128 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978113+0000", 2020-06-12T02:39:12.128 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8182000000000006e-05 2020-06-12T02:39:12.128 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978181+0000", 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6540000000000002e-06 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.129 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.130 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.130 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978188+0000", 2020-06-12T02:39:12.130 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1080999999999999e-05 2020-06-12T02:39:12.130 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.130 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.131 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.131 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978199+0000", 2020-06-12T02:39:12.131 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0579999999999997e-06 2020-06-12T02:39:12.131 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.132 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.132 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.132 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978204+0000", 2020-06-12T02:39:12.132 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00035670500000000002 2020-06-12T02:39:12.132 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.133 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.133 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.133 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978561+0000", 2020-06-12T02:39:12.133 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112978 2020-06-12T02:39:12.133 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.134 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.134 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.134 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978674+0000", 2020-06-12T02:39:12.134 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012521096000000001 2020-06-12T02:39:12.134 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991195+0000", 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000132242 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.135 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.136 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.136 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991327+0000", 2020-06-12T02:39:12.136 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017947919 2020-06-12T02:39:12.136 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.136 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.137 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.137 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.009275+0000", 2020-06-12T02:39:12.137 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005341241 2020-06-12T02:39:12.137 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.137 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014616+0000", 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00243888 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.138 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.139 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017055+0000", 2020-06-12T02:39:12.139 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014589099999999999 2020-06-12T02:39:12.139 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.139 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.139 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.140 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017201+0000", 2020-06-12T02:39:12.140 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.039087927000000001 2020-06-12T02:39:12.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.140 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.140 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.141 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.141 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.141 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:677 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:39:12.141 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:39:12.142 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.052632472, 2020-06-12T02:39:12.142 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998, 2020-06-12T02:39:12.142 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.142 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.142 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 677 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.143 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.144 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.144 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:39:12.144 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.144 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.144 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978245+0000", 2020-06-12T02:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7398999999999998e-05 2020-06-12T02:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978293+0000", 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4840000000000004e-06 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.146 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.147 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978301+0000", 2020-06-12T02:39:12.147 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5143999999999999e-05 2020-06-12T02:39:12.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.147 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.147 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.148 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978316+0000", 2020-06-12T02:39:12.148 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.66e-06 2020-06-12T02:39:12.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.148 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978322+0000", 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038221000000000002 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.149 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978704+0000", 2020-06-12T02:39:12.150 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010624999999999999 2020-06-12T02:39:12.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.150 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.150 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.150 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978810+0000", 2020-06-12T02:39:12.151 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012865105 2020-06-12T02:39:12.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.151 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.151 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.151 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991675+0000", 2020-06-12T02:39:12.152 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000109863 2020-06-12T02:39:12.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.152 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.152 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991785+0000", 2020-06-12T02:39:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026004947 2020-06-12T02:39:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.153 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017790+0000", 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1821000000000002e-05 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.154 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017862+0000", 2020-06-12T02:39:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010582720000000001 2020-06-12T02:39:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018920+0000", 2020-06-12T02:39:12.156 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.040675154999999998 2020-06-12T02:39:12.156 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.156 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.156 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.156 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:679 1.4s0 1:2125ca89:::smithi14213939-28:head [write 581542~688983,stat] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.044960175, 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001, 2020-06-12T02:39:12.157 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.158 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.158 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.158 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 679 2020-06-12T02:39:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.985917+0000", 2020-06-12T02:39:12.160 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00099124200000000003 2020-06-12T02:39:12.161 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.161 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.161 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.161 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986909+0000", 2020-06-12T02:39:12.161 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7479999999999996e-06 2020-06-12T02:39:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.162 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986915+0000", 2020-06-12T02:39:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8849999999999994e-06 2020-06-12T02:39:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.163 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986925+0000", 2020-06-12T02:39:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0390000000000004e-06 2020-06-12T02:39:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.164 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986930+0000", 2020-06-12T02:39:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00022125399999999999 2020-06-12T02:39:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.165 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987152+0000", 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013586499999999999 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.987287+0000", 2020-06-12T02:39:12.166 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0090668620000000002 2020-06-12T02:39:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.996354+0000", 2020-06-12T02:39:12.167 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021487379999999999 2020-06-12T02:39:12.168 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.168 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.168 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.168 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998503+0000", 2020-06-12T02:39:12.168 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039962979999999997 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002499+0000", 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000151268 2020-06-12T02:39:12.169 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.170 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.170 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.170 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.002651+0000", 2020-06-12T02:39:12.170 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016733199000000001 2020-06-12T02:39:12.170 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.171 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.171 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.171 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.171 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.171 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:680 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1886503~412692] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.172 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:39:12.172 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.03898520999999, 2020-06-12T02:39:12.172 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051, 2020-06-12T02:39:12.172 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.173 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.173 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.173 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 680 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.175 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.175 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.991892+0000", 2020-06-12T02:39:12.175 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040851 2020-06-12T02:39:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992301+0000", 2020-06-12T02:39:12.176 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992307+0000", 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:39:12.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992317+0000", 2020-06-12T02:39:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7910000000000004e-06 2020-06-12T02:39:12.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992321+0000", 2020-06-12T02:39:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.7664999999999999e-05 2020-06-12T02:39:12.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992359+0000", 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8074999999999999e-05 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.992457+0000", 2020-06-12T02:39:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010767115000000001 2020-06-12T02:39:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003224+0000", 2020-06-12T02:39:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012788799999999999 2020-06-12T02:39:12.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003352+0000", 2020-06-12T02:39:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0070201780000000002 2020-06-12T02:39:12.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.010372+0000", 2020-06-12T02:39:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042734959999999999 2020-06-12T02:39:12.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.014646+0000", 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027025909999999998 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017348+0000", 2020-06-12T02:39:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6081999999999993e-05 2020-06-12T02:39:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.017434+0000", 2020-06-12T02:39:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025542051 2020-06-12T02:39:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.187 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:681 1.4s0 1:2125ca89:::smithi14213939-28:head [write 2761543~670951] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:39:12.188 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.03215364799999, 2020-06-12T02:39:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999, 2020-06-12T02:39:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.189 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 681 2020-06-12T02:39:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.190 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.191 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.998724+0000", 2020-06-12T02:39:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00062303100000000002 2020-06-12T02:39:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.192 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.193 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999347+0000", 2020-06-12T02:39:12.193 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3749999999999999e-06 2020-06-12T02:39:12.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.193 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.194 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.194 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999353+0000", 2020-06-12T02:39:12.194 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1515000000000001e-05 2020-06-12T02:39:12.194 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.194 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999365+0000", 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7970000000000003e-06 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.195 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.196 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999372+0000", 2020-06-12T02:39:12.196 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8252e-05 2020-06-12T02:39:12.196 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.196 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.196 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.197 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999400+0000", 2020-06-12T02:39:12.197 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0322999999999996e-05 2020-06-12T02:39:12.197 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.197 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.197 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.198 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999490+0000", 2020-06-12T02:39:12.198 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042851520000000004 2020-06-12T02:39:12.198 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.198 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.198 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.199 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003775+0000", 2020-06-12T02:39:12.199 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0148000000000007e-05 2020-06-12T02:39:12.199 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.199 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.199 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.200 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.003846+0000", 2020-06-12T02:39:12.200 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084928539999999993 2020-06-12T02:39:12.200 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.200 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.200 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.201 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.012338+0000", 2020-06-12T02:39:12.201 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0065997240000000004 2020-06-12T02:39:12.201 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.201 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.201 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.018938+0000", 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030355759999999999 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.202 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.021974+0000", 2020-06-12T02:39:12.203 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013925499999999999 2020-06-12T02:39:12.203 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.203 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.204 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.204 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022113+0000", 2020-06-12T02:39:12.204 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.023389001999999999 2020-06-12T02:39:12.204 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.205 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.205 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.205 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.205 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.206 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:682 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 3781542] snapc 26=[26,25,24,23,21,1e,1d,16] ondisk+write+known_if_redirected e59)", 2020-06-12T02:39:12.206 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:39:12.206 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.03147069900001, 2020-06-12T02:39:12.206 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663, 2020-06-12T02:39:12.207 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.207 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.207 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.208 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 682 2020-06-12T02:39:12.208 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.208 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.208 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.208 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.209 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999407+0000", 2020-06-12T02:39:12.210 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2203999999999998e-05 2020-06-12T02:39:12.210 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.210 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.210 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.210 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999449+0000", 2020-06-12T02:39:12.211 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.7790000000000003e-06 2020-06-12T02:39:12.211 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.211 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.211 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.211 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999454+0000", 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.405e-06 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999462+0000", 2020-06-12T02:39:12.212 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.96e-06 2020-06-12T02:39:12.213 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.213 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.213 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999465+0000", 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0204999999999998e-05 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.214 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999515+0000", 2020-06-12T02:39:12.215 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8500999999999999e-05 2020-06-12T02:39:12.215 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.215 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.215 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.215 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999594+0000", 2020-06-12T02:39:12.216 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0044740980000000001 2020-06-12T02:39:12.216 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.216 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.216 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.216 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004068+0000", 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3739999999999995e-05 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004142+0000", 2020-06-12T02:39:12.217 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095221679999999993 2020-06-12T02:39:12.218 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.218 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.218 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.218 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.013664+0000", 2020-06-12T02:39:12.218 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0084835599999999994 2020-06-12T02:39:12.219 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.219 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.219 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.219 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.022148+0000", 2020-06-12T02:39:12.219 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013250880000000001 2020-06-12T02:39:12.220 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.220 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.220 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.220 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023473+0000", 2020-06-12T02:39:12.220 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.8955000000000005e-05 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.023562+0000", 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024154663 2020-06-12T02:39:12.221 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.222 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.222 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.222 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.222 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.222 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:683 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e59)", 2020-06-12T02:39:12.223 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:39:12.223 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.03138393699999, 2020-06-12T02:39:12.223 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553, 2020-06-12T02:39:12.223 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.224 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.224 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.224 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 683 2020-06-12T02:39:12.225 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.225 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.225 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.225 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.225 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999494+0000", 2020-06-12T02:39:12.226 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5286000000000002e-05 2020-06-12T02:39:12.227 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.227 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.227 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.227 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999519+0000", 2020-06-12T02:39:12.227 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.5710000000000002e-06 2020-06-12T02:39:12.228 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.228 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.228 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.228 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999523+0000", 2020-06-12T02:39:12.228 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1250000000000004e-06 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999530+0000", 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.734e-06 2020-06-12T02:39:12.229 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999532+0000", 2020-06-12T02:39:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5402999999999995e-05 2020-06-12T02:39:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.231 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.231 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.231 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999618+0000", 2020-06-12T02:39:12.231 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7329000000000005e-05 2020-06-12T02:39:12.231 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.999685+0000", 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0047523770000000003 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.232 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.233 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.233 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004438+0000", 2020-06-12T02:39:12.233 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8299000000000002e-05 2020-06-12T02:39:12.233 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.233 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.234 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.234 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.004536+0000", 2020-06-12T02:39:12.234 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019553065000000001 2020-06-12T02:39:12.234 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.235 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.235 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.235 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024089+0000", 2020-06-12T02:39:12.235 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0686999999999994e-05 2020-06-12T02:39:12.235 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.236 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.236 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.236 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.024180+0000", 2020-06-12T02:39:12.236 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001072677 2020-06-12T02:39:12.236 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:06.025252+0000", 2020-06-12T02:39:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025758553 2020-06-12T02:39:12.237 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.238 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.238 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.238 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.238 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.238 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:828 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~3260525,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.65299033100001, 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001, 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.239 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.240 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.240 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 828 2020-06-12T02:39:12.240 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.240 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.241 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.241 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.241 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:39:12.241 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.241 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377887+0000", 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.2004999999999998e-05 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.242 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.243 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.243 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377969+0000", 2020-06-12T02:39:12.243 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0649999999999999e-06 2020-06-12T02:39:12.243 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.243 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.244 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.244 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377977+0000", 2020-06-12T02:39:12.244 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4207e-05 2020-06-12T02:39:12.244 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.245 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.245 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.245 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377992+0000", 2020-06-12T02:39:12.245 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1699999999999996e-06 2020-06-12T02:39:12.245 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.246 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.246 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.246 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.377997+0000", 2020-06-12T02:39:12.246 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012555089999999999 2020-06-12T02:39:12.246 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.247 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.247 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.247 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379252+0000", 2020-06-12T02:39:12.247 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9869000000000002e-05 2020-06-12T02:39:12.247 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.379352+0000", 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016646235999999998 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.248 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.395998+0000", 2020-06-12T02:39:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018111061000000001 2020-06-12T02:39:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.249 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.250 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.250 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.250 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.250 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:850 1.4s0 1:255d7265:::smithi14213939-30:head [delete] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+peerstat_old+known_if_redirected e68)", 2020-06-12T02:39:12.250 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 176.63056839399999, 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001, 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.251 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.252 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.252 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 850 2020-06-12T02:39:12.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.252 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.252 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.253 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.253 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:39:12.253 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.253 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.253 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.254 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.254 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400309+0000", 2020-06-12T02:39:12.254 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6463e-05 2020-06-12T02:39:12.254 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400346+0000", 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0639999999999996e-06 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.255 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.256 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.256 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400353+0000", 2020-06-12T02:39:12.256 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4555999999999999e-05 2020-06-12T02:39:12.256 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.256 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.257 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.257 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:39:12.257 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2119999999999997e-06 2020-06-12T02:39:12.257 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.258 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.258 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.258 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400375+0000", 2020-06-12T02:39:12.259 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.3106000000000003e-05 2020-06-12T02:39:12.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.259 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.259 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.259 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400428+0000", 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012342000000000001 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.400551+0000", 2020-06-12T02:39:12.260 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054310199999999995 2020-06-12T02:39:12.261 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.261 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.261 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.261 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.401094+0000", 2020-06-12T02:39:12.261 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001529351 2020-06-12T02:39:12.262 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.262 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.262 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.262 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.402624+0000", 2020-06-12T02:39:12.262 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013994253999999999 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416618+0000", 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.7299999999999994e-05 2020-06-12T02:39:12.263 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.264 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.264 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.264 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.416705+0000", 2020-06-12T02:39:12.264 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016395828000000001 2020-06-12T02:39:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.266 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:901 1.4s0 1:2125ca89:::smithi14213939-28:head [write 1867350~468823] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:39:12.266 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:39:12.266 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.78459369800001, 2020-06-12T02:39:12.266 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999, 2020-06-12T02:39:12.266 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.267 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.267 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.267 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 901 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:39:12.268 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.269 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.269 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.269 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.269 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246284+0000", 2020-06-12T02:39:12.269 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00064005400000000004 2020-06-12T02:39:12.270 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.270 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.270 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.270 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246924+0000", 2020-06-12T02:39:12.270 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.517e-05 2020-06-12T02:39:12.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.271 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.271 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.271 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246939+0000", 2020-06-12T02:39:12.274 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7523999999999999e-05 2020-06-12T02:39:12.274 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.275 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.275 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.276 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246967+0000", 2020-06-12T02:39:12.276 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2813000000000001e-05 2020-06-12T02:39:12.276 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.276 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.276 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.277 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.246979+0000", 2020-06-12T02:39:12.277 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0016306389999999999 2020-06-12T02:39:12.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.278 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.278 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.278 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248610+0000", 2020-06-12T02:39:12.278 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00038371999999999999 2020-06-12T02:39:12.278 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.279 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.279 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.280 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.248994+0000", 2020-06-12T02:39:12.280 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049998880000000001 2020-06-12T02:39:12.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.281 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.281 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.281 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.253994+0000", 2020-06-12T02:39:12.281 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000126036 2020-06-12T02:39:12.282 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.282 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.282 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.283 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254120+0000", 2020-06-12T02:39:12.284 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0059995409999999997 2020-06-12T02:39:12.284 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.284 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.284 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.284 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.260119+0000", 2020-06-12T02:39:12.285 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025201939999999999 2020-06-12T02:39:12.285 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.285 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.285 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.286 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.262640+0000", 2020-06-12T02:39:12.286 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011685319999999999 2020-06-12T02:39:12.286 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.286 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.286 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.287 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263808+0000", 2020-06-12T02:39:12.287 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4771999999999994e-05 2020-06-12T02:39:12.287 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.287 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.287 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263893+0000", 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017608882999999999 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.288 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.289 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.289 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:902 1.4s0 1:2125ca89:::smithi14213939-28:head [setxattr _header (57) in=7b,truncate 2336173] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:39:12.289 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:39:12.289 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.783776534, 2020-06-12T02:39:12.289 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998, 2020-06-12T02:39:12.290 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.290 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.290 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.291 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 902 2020-06-12T02:39:12.291 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.291 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.291 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.291 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.292 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:39:12.292 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.292 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.292 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.292 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247101+0000", 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011823400000000001 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.293 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247219+0000", 2020-06-12T02:39:12.294 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0623e-05 2020-06-12T02:39:12.294 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.294 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.294 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.294 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247230+0000", 2020-06-12T02:39:12.295 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0823e-05 2020-06-12T02:39:12.295 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.295 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.295 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.295 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247251+0000", 2020-06-12T02:39:12.296 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2140000000000001e-05 2020-06-12T02:39:12.296 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.296 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.296 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.296 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247263+0000", 2020-06-12T02:39:12.297 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0018910260000000001 2020-06-12T02:39:12.297 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.297 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.297 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.297 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249154+0000", 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00034726700000000001 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249501+0000", 2020-06-12T02:39:12.298 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049426139999999997 2020-06-12T02:39:12.299 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.299 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.299 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.299 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254444+0000", 2020-06-12T02:39:12.299 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5377000000000006e-05 2020-06-12T02:39:12.300 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.300 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.300 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.300 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254529+0000", 2020-06-12T02:39:12.300 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0072968019999999998 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.261826+0000", 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020993190000000001 2020-06-12T02:39:12.301 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.302 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.302 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.302 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.263925+0000", 2020-06-12T02:39:12.302 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000557476 2020-06-12T02:39:12.302 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.303 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.303 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:12.303 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264483+0000", 2020-06-12T02:39:12.303 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6303000000000003e-05 2020-06-12T02:39:12.303 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.304 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.304 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.304 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.264579+0000", 2020-06-12T02:39:12.304 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017478003999999998 2020-06-12T02:39:12.305 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.305 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.305 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.306 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:903 1.4s0 1:2125ca89:::smithi14213939-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:39:12.306 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:39:12.306 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.783539894, 2020-06-12T02:39:12.306 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001, 2020-06-12T02:39:12.306 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 903 2020-06-12T02:39:12.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.308 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.308 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.308 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.308 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:39:12.308 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247338+0000", 2020-06-12T02:39:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3003999999999994e-05 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247411+0000", 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0159999999999997e-06 2020-06-12T02:39:12.310 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.311 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.311 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.311 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247420+0000", 2020-06-12T02:39:12.311 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9304e-05 2020-06-12T02:39:12.311 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247439+0000", 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7530000000000004e-06 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.312 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.313 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.313 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.247446+0000", 2020-06-12T02:39:12.313 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022444959999999999 2020-06-12T02:39:12.313 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.313 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.314 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.314 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.249690+0000", 2020-06-12T02:39:12.314 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00036681399999999997 2020-06-12T02:39:12.314 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.314 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.315 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.315 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.250057+0000", 2020-06-12T02:39:12.315 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004809809 2020-06-12T02:39:12.315 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.316 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.316 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.316 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.254867+0000", 2020-06-12T02:39:12.316 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00024075600000000001 2020-06-12T02:39:12.316 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.317 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.317 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.317 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.255108+0000", 2020-06-12T02:39:12.317 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010313927000000001 2020-06-12T02:39:12.317 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.318 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.318 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.318 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265422+0000", 2020-06-12T02:39:12.318 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016274900000000001 2020-06-12T02:39:12.318 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.319 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.319 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.319 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.265584+0000", 2020-06-12T02:39:12.319 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0010966120000000001 2020-06-12T02:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.266681+0000", 2020-06-12T02:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019343240000000001 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.321 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:933 1.4s0 1:2207f711:::smithi14213939-36:head [read 0~3764735,checksum] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:39:12.322 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:39:12.322 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.05804696300001, 2020-06-12T02:39:12.322 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998, 2020-06-12T02:39:12.322 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.322 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.323 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.323 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 933 2020-06-12T02:39:12.323 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.324 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.325 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.325 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.325 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972831+0000", 2020-06-12T02:39:12.325 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015097400000000001 2020-06-12T02:39:12.325 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.326 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.326 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.326 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.972982+0000", 2020-06-12T02:39:12.326 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2988000000000001e-05 2020-06-12T02:39:12.326 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973005+0000", 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9539999999999999e-05 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.327 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.328 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.328 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973024+0000", 2020-06-12T02:39:12.328 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8790000000000003e-06 2020-06-12T02:39:12.328 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.328 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.329 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.329 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973032+0000", 2020-06-12T02:39:12.329 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5202000000000003e-05 2020-06-12T02:39:12.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.329 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.330 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.330 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973107+0000", 2020-06-12T02:39:12.330 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.541e-05 2020-06-12T02:39:12.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.330 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973123+0000", 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0080113289999999993 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.331 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.332 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981134+0000", 2020-06-12T02:39:12.332 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014484 2020-06-12T02:39:12.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.332 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.332 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981279+0000", 2020-06-12T02:39:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089730499999999998 2020-06-12T02:39:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.333 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.334 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.990252+0000", 2020-06-12T02:39:12.334 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.017421211999999998 2020-06-12T02:39:12.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.335 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.335 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.335 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.335 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:934 1.4s0 1:2207f711:::smithi14213939-36:head [sparse-read 0~3764735] snapc 0=[] ondisk+read+known_if_redirected e73)", 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.05776614999999, 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001, 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.336 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 934 2020-06-12T02:39:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.338 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.338 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.338 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.338 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:39:12.338 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973111+0000", 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4952999999999999e-05 2020-06-12T02:39:12.339 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.340 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.340 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.340 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973186+0000", 2020-06-12T02:39:12.340 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9490000000000008e-06 2020-06-12T02:39:12.340 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.341 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.341 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.341 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973196+0000", 2020-06-12T02:39:12.341 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9391000000000001e-05 2020-06-12T02:39:12.341 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.342 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.342 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.342 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973216+0000", 2020-06-12T02:39:12.346 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3380000000000005e-06 2020-06-12T02:39:12.346 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.347 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.347 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.347 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973224+0000", 2020-06-12T02:39:12.347 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00039032500000000001 2020-06-12T02:39:12.347 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.348 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.348 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.348 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973614+0000", 2020-06-12T02:39:12.348 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4960000000000001e-05 2020-06-12T02:39:12.348 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.973629+0000", 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.008031425 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.349 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.350 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.350 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981661+0000", 2020-06-12T02:39:12.350 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017151699999999999 2020-06-12T02:39:12.350 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.350 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.351 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.351 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.981832+0000", 2020-06-12T02:39:12.351 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011315472 2020-06-12T02:39:12.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.351 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:19.993148+0000", 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020036330000000001 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.352 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.353 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.353 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:964 1.4s0 1:2b9499a4:::smithi14213939-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e74)", 2020-06-12T02:39:12.353 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:39:12.353 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 170.97899491499999, 2020-06-12T02:39:12.354 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453, 2020-06-12T02:39:12.354 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:12.354 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:12.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:12.354 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 964 2020-06-12T02:39:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:12.355 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:39:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.356 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051883+0000", 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.6580000000000003e-05 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.357 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:12.358 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051949+0000", 2020-06-12T02:39:12.358 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0301e-05 2020-06-12T02:39:12.358 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.358 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.358 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:12.359 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051960+0000", 2020-06-12T02:39:12.359 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0656999999999999e-05 2020-06-12T02:39:12.359 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.359 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.360 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:12.360 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051980+0000", 2020-06-12T02:39:12.360 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8180000000000004e-06 2020-06-12T02:39:12.360 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.361 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.361 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.361 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051988+0000", 2020-06-12T02:39:12.361 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001622397 2020-06-12T02:39:12.361 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053610+0000", 2020-06-12T02:39:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0879999999999998e-05 2020-06-12T02:39:12.362 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.363 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.363 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.363 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.053691+0000", 2020-06-12T02:39:12.363 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0099139899999999993 2020-06-12T02:39:12.363 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063605+0000", 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012417799999999999 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.365 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:12.365 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.063730+0000", 2020-06-12T02:39:12.365 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042596520000000001 2020-06-12T02:39:12.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:12.365 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:12.366 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:12.366 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067989+0000", 2020-06-12T02:39:12.366 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016106453 2020-06-12T02:39:12.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.366 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.367 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:12.367 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:12.367 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:12.369 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:12.370 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:12.365+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:12.470 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:12.470+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:12.485 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:12.486 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:12.486 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:39:12.486 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:12.495 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:12.571 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:12.569+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:12.651 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:12.652 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:12.652 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:12.652 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:12.652 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:12.661 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:12.710 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:12.710+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:12.773 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.67182134199999, 2020-06-12T02:39:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:39:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:39:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:39:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:39:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:39:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:39:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:39:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:39:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:39:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:39:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:39:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:39:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:39:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:39:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:39:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:39:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:39:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:39:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:39:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:39:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:39:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:39:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.67165097500001, 2020-06-12T02:39:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:39:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:39:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:39:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:39:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:39:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:39:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:39:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:39:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:39:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:39:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:39:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:39:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:39:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:39:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:39:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:39:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:39:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:39:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:39:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:39:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:39:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:39:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:39:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:39:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:39:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.65351294800001, 2020-06-12T02:39:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:39:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:39:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:39:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:39:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:39:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:39:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:39:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:39:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:39:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:39:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:39:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:39:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:39:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:39:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:39:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:39:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:39:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:39:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:39:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:39:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:39:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:39:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:39:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.64757606500001, 2020-06-12T02:39:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:39:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:39:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:39:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:39:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:39:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:39:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:39:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:39:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:39:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:39:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:39:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:39:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:39:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:39:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:39:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:39:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:39:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:39:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:39:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:39:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:39:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:39:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:39:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.647066994, 2020-06-12T02:39:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:39:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:39:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:39:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:39:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:39:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:39:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:39:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:39:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:39:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:39:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:39:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:39:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:39:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:39:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:39:12.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:39:12.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:39:12.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:39:12.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:39:12.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:39:12.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:39:12.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:39:12.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:39:12.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.876 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:39:12.877 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:12.877 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.646908728, 2020-06-12T02:39:12.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:39:12.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:12.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.879 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.879 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:39:12.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.880 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:12.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:39:12.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:39:12.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:39:12.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:39:12.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:39:12.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:39:12.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:39:12.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:39:12.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:39:12.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:39:12.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:39:12.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:39:12.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:39:12.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:39:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:39:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:39:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:39:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:39:12.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:39:12.893 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.894 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.894 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.895 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:39:12.895 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:12.895 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 207.572511926, 2020-06-12T02:39:12.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.896 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:39:12.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.897 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:12.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:12.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:39:12.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:39:12.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:39:12.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:39:12.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:39:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:39:12.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:39:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:39:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:39:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:39:12.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:39:12.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:39:12.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:39:12.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:39:12.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:39:12.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:39:12.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:39:12.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:39:12.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:39:12.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:39:12.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:39:12.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.913 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.914 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:39:12.914 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:12.914 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 207.56550110399999, 2020-06-12T02:39:12.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:39:12.915 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:12.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.916 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:39:12.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.917 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:12.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:12.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:39:12.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:39:12.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:39:12.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:39:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:39:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:39:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:39:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:39:12.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:39:12.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:39:12.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:39:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:39:12.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:39:12.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:39:12.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:39:12.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:39:12.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:39:12.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:39:12.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:39:12.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.931 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:12.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:12.933 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 192.805714561, 2020-06-12T02:39:12.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:39:12.933 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.934 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.934 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.934 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.935 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:39:12.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.936 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:12.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:12.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:39:12.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:39:12.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:39:12.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:39:12.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:39:12.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:39:12.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:39:12.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:39:12.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:39:12.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:39:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:39:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:39:12.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:39:12.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:39:12.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:39:12.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:39:12.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:39:12.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:39:12.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:39:12.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:39:12.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:39:12.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:39:12.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:39:12.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:39:12.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:39:12.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:39:12.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:39:12.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:39:12.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:39:12.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:39:12.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:39:12.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:39:12.957 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.957 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.957 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.958 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:12.962 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:12.963 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 192.805586965, 2020-06-12T02:39:12.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:39:12.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.963 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:12.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.964 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:39:12.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:12.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:12.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:39:12.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:39:12.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:39:12.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:39:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:39:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:39:12.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:39:12.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:39:12.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:39:12.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:39:12.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:39:12.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:39:12.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:39:12.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:39:12.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:39:12.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:39:12.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:12.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:39:12.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:39:12.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:12.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:39:12.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:39:12.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:12.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:39:12.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:39:12.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:12.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:39:12.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:39:12.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:12.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:39:12.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:39:12.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:12.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:39:12.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:39:12.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:12.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:12.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:12.990 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:12.990 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.390606324, 2020-06-12T02:39:12.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:39:12.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:12.991 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:12.991 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:12.991 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:12.991 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:12.991 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:39:12.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.992 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:12.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:12.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:12.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:12.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:12.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:12.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:39:12.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:12.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:39:12.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:39:12.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:12.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:39:12.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:39:12.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:12.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:12.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:12.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:39:12.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:39:13.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:39:13.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:39:13.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:39:13.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:39:13.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:39:13.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:39:13.004 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.005 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.005 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:13.006 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:13.006 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.39046156699999, 2020-06-12T02:39:13.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:39:13.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:13.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:39:13.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.008 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:13.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:13.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:39:13.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:39:13.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:39:13.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:39:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:39:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:39:13.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:39:13.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:39:13.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:39:13.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:39:13.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:39:13.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:39:13.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.018 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:13.019 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:13.019 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.39033071700001, 2020-06-12T02:39:13.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:39:13.019 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:13.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.021 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:39:13.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:13.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:13.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:39:13.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:39:13.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:39:13.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:39:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:39:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:39:13.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:39:13.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:39:13.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:39:13.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:39:13.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:39:13.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:39:13.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:39:13.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:39:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:39:13.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:13.032 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:13.033 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.390186395, 2020-06-12T02:39:13.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:39:13.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.033 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:13.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:39:13.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.034 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:39:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:39:13.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:39:13.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:39:13.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:39:13.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:39:13.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:39:13.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:39:13.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:39:13.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:39:13.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:39:13.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:13.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:39:13.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:39:13.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:13.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:39:13.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:39:13.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:39:13.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:39:13.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:13.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:13.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.390074414, 2020-06-12T02:39:13.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:39:13.050 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:13.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.051 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.051 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:39:13.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:13.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:13.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:39:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:39:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:39:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:39:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:39:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:39:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:39:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:39:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:39:13.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:39:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:39:13.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:13.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:39:13.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:39:13.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:13.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:39:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:39:13.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:39:13.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:39:13.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.075 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:13.075 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:13.075 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.389921929, 2020-06-12T02:39:13.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:39:13.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:13.076 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.076 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.076 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.076 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:39:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:13.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:39:13.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:39:13.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:39:13.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:39:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:39:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:39:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:39:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:39:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:39:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:39:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:39:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:13.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:39:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:39:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:13.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:39:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:39:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:39:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:39:13.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:39:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:39:13.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.369176791, 2020-06-12T02:39:13.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:39:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.095 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:39:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:13.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:39:13.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:39:13.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:39:13.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:39:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:39:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:39:13.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:39:13.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:39:13.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:39:13.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:39:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:39:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:39:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:39:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:39:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:39:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:13.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:39:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:39:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:39:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:39:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:13.111 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.368851697, 2020-06-12T02:39:13.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:39:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:39:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:39:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:39:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:39:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:39:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:39:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:39:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:39:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:39:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:39:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:39:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:39:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:39:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:39:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:39:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:39:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:39:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:39:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:39:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:39:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:39:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:39:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:39:13.129 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.25320521399999, 2020-06-12T02:39:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:39:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:13.130 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:39:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.131 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:39:13.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:39:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:39:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:39:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:39:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:39:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:39:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:39:13.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:39:13.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:13.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:39:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:39:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:13.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:39:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:39:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:13.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:39:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:39:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:39:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:39:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.252864956, 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:39:13.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:13.146 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:39:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:13.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:39:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:39:13.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:39:13.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:39:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:39:13.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:39:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:39:13.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:39:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:39:13.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:39:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:39:13.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:39:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:39:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:39:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:39:13.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:39:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:39:13.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:39:13.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:13.160 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:13.161 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:12.770+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:13.161 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:39:13.166 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-06-12T02:39:13.168 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:13.166+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:13.169 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:13.273 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:13.266+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:13.310 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:13.306+0000 7f5ea584f700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:13.310+0000 7f5e9ffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:13.319 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:13.310+0000 7efc06bde700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:13.322 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:13.322+0000 7efc06bde700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:13.335 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:13.361 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:13.369 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:13.366+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:13.382 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:13.405 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:13.430 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:13.451 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:13.465 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:13.466 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:13.471 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:13.465+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:13.474 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:13.479 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:13.479 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.480 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.481 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.481 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:39:13.482 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:13.483 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:13.572 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:13.570+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:13.578 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:13.579 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:13.588 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:13.674 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:13.669+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:13.742 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:13.743 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:13.752 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:13.798 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:13.798+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:13.859 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:13.868 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:13.910 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:13.910+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:13.977 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:13.973+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:14.021 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.021 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.030 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:14.078 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:14.073+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:14.137 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is set 2020-06-12T02:39:14.150 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.150 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.159 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:14.203 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:14.201+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:14.284 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:14.281+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:14.316 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.316 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.326 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:14.389 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:14.382+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:14.478 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.478 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.485 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:14.486+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:14.487 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:14.586 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:14.581+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:14.598 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.598 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.604 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:14.687 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:14.686+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:14.758 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.759 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.768 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:14.788 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:14.786+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:14.872 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.872 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:14.882 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:14.898 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:14.885+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:14.990 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:14.985+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:14.992 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:14.993 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.002 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:15.092 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:15.090+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:15.156 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:15.157 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.166 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:15.211 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:15.209+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:15.275 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:15.275 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.284 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:15.293 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:15.290+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:15.394 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:15.389+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:15.437 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:15.437 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.447 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:15.483 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:39:15.534 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:15.534+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:15.595 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:15.594+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:15.597 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:15.594+0000 7f184b798700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:15.598 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:15.598 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.604 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:15.602+0000 7f184a536700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:15.607 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:15.632 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:15.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:15.678 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:15.696 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:15.694+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:15.703 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:15.713 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:15.713 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:15.723 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:15.727 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:15.751 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:15.776 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:15.777 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.777 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.777 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:15.778 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:15.778 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.778 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:39:15.780 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:15.781 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:15.822 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:15.822+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:15.836 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:15.837 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:15.837 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:39:15.837 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:15.844 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:15.899 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:15.897+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:15.994 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:15.995 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:15.995 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:15.995 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:15.996 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:16.000 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:15.998+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:16.008 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:16.102 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:16.102+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:16.158 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-06-12T02:39:16.181 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:16.182 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:16.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:16.195 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:16.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:206 1.2s0 1:4edac3c4:::smithi14213939-9:head [copy-from ver 12] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:16.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:16.198 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.06619531000001, 2020-06-12T02:39:16.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001, 2020-06-12T02:39:16.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.202 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.203 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.203 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.203 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 206 2020-06-12T02:39:16.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.204 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:16.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097469+0000", 2020-06-12T02:39:16.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7257999999999998e-05 2020-06-12T02:39:16.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097546+0000", 2020-06-12T02:39:16.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1491999999999999e-05 2020-06-12T02:39:16.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097557+0000", 2020-06-12T02:39:16.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8202999999999998e-05 2020-06-12T02:39:16.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097576+0000", 2020-06-12T02:39:16.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1389999999999999e-05 2020-06-12T02:39:16.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097587+0000", 2020-06-12T02:39:16.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7093999999999999e-05 2020-06-12T02:39:16.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097644+0000", 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012590299999999999 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097770+0000", 2020-06-12T02:39:16.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022834956 2020-06-12T02:39:16.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.120605+0000", 2020-06-12T02:39:16.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078328930000000005 2020-06-12T02:39:16.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128438+0000", 2020-06-12T02:39:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036266269999999999 2020-06-12T02:39:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132064+0000", 2020-06-12T02:39:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013611499999999999 2020-06-12T02:39:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.132201+0000", 2020-06-12T02:39:16.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034731931000000001 2020-06-12T02:39:16.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.235 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:207 1.2s0 1:4edac3c4:::smithi14213939-9:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.066024943, 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998, 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.236 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.237 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.237 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 207 2020-06-12T02:39:16.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.237 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097639+0000", 2020-06-12T02:39:16.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3943999999999998e-05 2020-06-12T02:39:16.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097683+0000", 2020-06-12T02:39:16.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5899999999999996e-06 2020-06-12T02:39:16.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097690+0000", 2020-06-12T02:39:16.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3101999999999999e-05 2020-06-12T02:39:16.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097703+0000", 2020-06-12T02:39:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2960000000000004e-06 2020-06-12T02:39:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.097709+0000", 2020-06-12T02:39:16.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037105599999999998 2020-06-12T02:39:16.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098080+0000", 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109098 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.098189+0000", 2020-06-12T02:39:16.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028133552999999999 2020-06-12T02:39:16.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126323+0000", 2020-06-12T02:39:16.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012935299999999999 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126452+0000", 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069056550000000001 2020-06-12T02:39:16.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133358+0000", 2020-06-12T02:39:16.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012358000000000001 2020-06-12T02:39:16.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133481+0000", 2020-06-12T02:39:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014200399999999999 2020-06-12T02:39:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.133623+0000", 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035984230999999998 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:209 1.2s0 1:40342bec:::smithi14213939-47:head [write 1309629~542666] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.04788691600001, 2020-06-12T02:39:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998, 2020-06-12T02:39:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 209 2020-06-12T02:39:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.115777+0000", 2020-06-12T02:39:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035273500000000002 2020-06-12T02:39:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116130+0000", 2020-06-12T02:39:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1409999999999999e-05 2020-06-12T02:39:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116141+0000", 2020-06-12T02:39:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5042000000000001e-05 2020-06-12T02:39:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116176+0000", 2020-06-12T02:39:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0025e-05 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.116186+0000", 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010736710999999999 2020-06-12T02:39:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.126923+0000", 2020-06-12T02:39:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115791 2020-06-12T02:39:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127039+0000", 2020-06-12T02:39:16.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018713311 2020-06-12T02:39:16.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.145752+0000", 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037419490000000001 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149494+0000", 2020-06-12T02:39:16.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002270191 2020-06-12T02:39:16.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151764+0000", 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2828e-05 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.151857+0000", 2020-06-12T02:39:16.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036079992999999998 2020-06-12T02:39:16.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.270 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:210 1.2s0 1:40342bec:::smithi14213939-47:head [write 2323973~516377] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:16.270 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:16.270 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.04195003300001, 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001, 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.271 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 210 2020-06-12T02:39:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.121714+0000", 2020-06-12T02:39:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040989500000000002 2020-06-12T02:39:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122124+0000", 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1218e-05 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122135+0000", 2020-06-12T02:39:16.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8189000000000002e-05 2020-06-12T02:39:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122153+0000", 2020-06-12T02:39:16.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0088999999999999e-05 2020-06-12T02:39:16.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122163+0000", 2020-06-12T02:39:16.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052643000000000004 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127428+0000", 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012618899999999999 2020-06-12T02:39:16.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127554+0000", 2020-06-12T02:39:16.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020223307999999999 2020-06-12T02:39:16.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.147777+0000", 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051986549999999999 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.152976+0000", 2020-06-12T02:39:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00077817900000000005 2020-06-12T02:39:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153754+0000", 2020-06-12T02:39:16.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115561 2020-06-12T02:39:16.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153869+0000", 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032155583000000001 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.284 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:211 1.2s0 1:40342bec:::smithi14213939-47:head [setxattr _header (56) in=7b,truncate 2840350] snapc 3=[3,2] ondisk+write+known_if_redirected e23)", 2020-06-12T02:39:16.284 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:16.284 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.041440962, 2020-06-12T02:39:16.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001, 2020-06-12T02:39:16.285 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.285 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.285 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 211 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:16.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122223+0000", 2020-06-12T02:39:16.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4401999999999996e-05 2020-06-12T02:39:16.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122307+0000", 2020-06-12T02:39:16.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8909999999999995e-06 2020-06-12T02:39:16.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122315+0000", 2020-06-12T02:39:16.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2808e-05 2020-06-12T02:39:16.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122328+0000", 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.058e-06 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122335+0000", 2020-06-12T02:39:16.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055651260000000001 2020-06-12T02:39:16.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.127900+0000", 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103769 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128004+0000", 2020-06-12T02:39:16.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021024345999999999 2020-06-12T02:39:16.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.149028+0000", 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040352010000000004 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.153064+0000", 2020-06-12T02:39:16.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012763119999999999 2020-06-12T02:39:16.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154340+0000", 2020-06-12T02:39:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013721299999999999 2020-06-12T02:39:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.154477+0000", 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032254126000000001 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.299 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:212 1.2s0 1:40342bec:::smithi14213939-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e23)", 2020-06-12T02:39:16.299 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:16.299 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.041282696, 2020-06-12T02:39:16.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547, 2020-06-12T02:39:16.299 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.300 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.300 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.300 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.300 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.300 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 212 2020-06-12T02:39:16.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.301 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:16.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122381+0000", 2020-06-12T02:39:16.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7787000000000002e-05 2020-06-12T02:39:16.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122429+0000", 2020-06-12T02:39:16.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870000000000002e-06 2020-06-12T02:39:16.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122436+0000", 2020-06-12T02:39:16.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7129000000000002e-05 2020-06-12T02:39:16.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122453+0000", 2020-06-12T02:39:16.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8879999999999996e-06 2020-06-12T02:39:16.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.122458+0000", 2020-06-12T02:39:16.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058438329999999997 2020-06-12T02:39:16.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128302+0000", 2020-06-12T02:39:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012815999999999999 2020-06-12T02:39:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.128430+0000", 2020-06-12T02:39:16.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026786766 2020-06-12T02:39:16.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155217+0000", 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120531 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.155337+0000", 2020-06-12T02:39:16.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0017674660000000001 2020-06-12T02:39:16.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:30.157105+0000", 2020-06-12T02:39:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034723547 2020-06-12T02:39:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:450 1.2s0 1:4fe4d12b:::smithi14213939-34:head [write 1573512~741359] snapc 11=[11,c,a] ondisk+write+known_if_redirected e38)", 2020-06-12T02:39:16.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:16.315 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 210.966885894, 2020-06-12T02:39:16.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999, 2020-06-12T02:39:16.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 450 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.316 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:16.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.196778+0000", 2020-06-12T02:39:16.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047518000000000001 2020-06-12T02:39:16.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197253+0000", 2020-06-12T02:39:16.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5909999999999998e-06 2020-06-12T02:39:16.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197261+0000", 2020-06-12T02:39:16.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2020-06-12T02:39:16.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197274+0000", 2020-06-12T02:39:16.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2099999999999998e-06 2020-06-12T02:39:16.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.197280+0000", 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00086508099999999997 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198145+0000", 2020-06-12T02:39:16.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000347053 2020-06-12T02:39:16.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.198492+0000", 2020-06-12T02:39:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010365642 2020-06-12T02:39:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.208858+0000", 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048266680000000001 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.213684+0000", 2020-06-12T02:39:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081793370000000001 2020-06-12T02:39:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221864+0000", 2020-06-12T02:39:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107537 2020-06-12T02:39:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.221971+0000", 2020-06-12T02:39:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025193021999999999 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:453 1.2s0 1:4fe4d12b:::smithi14213939-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e38)", 2020-06-12T02:39:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 210.95987507199999, 2020-06-12T02:39:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054, 2020-06-12T02:39:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 453 2020-06-12T02:39:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203789+0000", 2020-06-12T02:39:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3553000000000006e-05 2020-06-12T02:39:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203852+0000", 2020-06-12T02:39:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650000000000006e-06 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203861+0000", 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7278999999999998e-05 2020-06-12T02:39:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203878+0000", 2020-06-12T02:39:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2500000000000003e-06 2020-06-12T02:39:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.203884+0000", 2020-06-12T02:39:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090575499999999995 2020-06-12T02:39:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204790+0000", 2020-06-12T02:39:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170799999999999 2020-06-12T02:39:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.204932+0000", 2020-06-12T02:39:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018630229000000002 2020-06-12T02:39:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223562+0000", 2020-06-12T02:39:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012368899999999999 2020-06-12T02:39:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.223686+0000", 2020-06-12T02:39:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001088426 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:45.224774+0000", 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020985054 2020-06-12T02:39:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:585 1.2s0 1:40342bec:::smithi14213939-47:head [rollback 21] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.200088529, 2020-06-12T02:39:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999, 2020-06-12T02:39:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 585 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963575+0000", 2020-06-12T02:39:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1103000000000002e-05 2020-06-12T02:39:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963627+0000", 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6499999999999996e-06 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963634+0000", 2020-06-12T02:39:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3512999999999999e-05 2020-06-12T02:39:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963648+0000", 2020-06-12T02:39:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2020-06-12T02:39:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963653+0000", 2020-06-12T02:39:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026319960000000002 2020-06-12T02:39:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966285+0000", 2020-06-12T02:39:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017348400000000001 2020-06-12T02:39:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966458+0000", 2020-06-12T02:39:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260029 2020-06-12T02:39:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:39:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.966718+0000", 2020-06-12T02:39:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12887418 2020-06-12T02:39:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095593+0000", 2020-06-12T02:39:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028234799999999997 2020-06-12T02:39:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095875+0000", 2020-06-12T02:39:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012840486999999999 2020-06-12T02:39:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108715+0000", 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.108879+0000", 2020-06-12T02:39:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010192300000000001 2020-06-12T02:39:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.109899+0000", 2020-06-12T02:39:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043473180000000002 2020-06-12T02:39:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114246+0000", 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012026280000000001 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115449+0000", 2020-06-12T02:39:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028985099999999999 2020-06-12T02:39:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.115738+0000", 2020-06-12T02:39:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.15216300099999999 2020-06-12T02:39:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:586 1.2s0 1:40342bec:::smithi14213939-47:head [append 0~0] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 196.199960933, 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841, 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 586 2020-06-12T02:39:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963703+0000", 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8535999999999997e-05 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963752+0000", 2020-06-12T02:39:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.883e-06 2020-06-12T02:39:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963758+0000", 2020-06-12T02:39:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3339000000000001e-05 2020-06-12T02:39:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963772+0000", 2020-06-12T02:39:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1399999999999999e-06 2020-06-12T02:39:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.963777+0000", 2020-06-12T02:39:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045429099999999998 2020-06-12T02:39:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968320+0000", 2020-06-12T02:39:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016317299999999999 2020-06-12T02:39:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for degraded object", 2020-06-12T02:39:16.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:59.968483+0000", 2020-06-12T02:39:16.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.12751218 2020-06-12T02:39:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.095995+0000", 2020-06-12T02:39:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036568100000000002 2020-06-12T02:39:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.096361+0000", 2020-06-12T02:39:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016079408 2020-06-12T02:39:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112440+0000", 2020-06-12T02:39:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021999500000000001 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.112660+0000", 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00085499100000000004 2020-06-12T02:39:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.113515+0000", 2020-06-12T02:39:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014371729999999999 2020-06-12T02:39:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.114952+0000", 2020-06-12T02:39:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015844329999999999 2020-06-12T02:39:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116537+0000", 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022499900000000001 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:00.116762+0000", 2020-06-12T02:39:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.153058841 2020-06-12T02:39:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:820 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.784980292, 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933, 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 820 2020-06-12T02:39:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378684+0000", 2020-06-12T02:39:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4746000000000001e-05 2020-06-12T02:39:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378738+0000", 2020-06-12T02:39:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458e-05 2020-06-12T02:39:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378749+0000", 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7405e-05 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378766+0000", 2020-06-12T02:39:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4930000000000004e-06 2020-06-12T02:39:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378776+0000", 2020-06-12T02:39:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.376e-05 2020-06-12T02:39:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378830+0000", 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000186286 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379016+0000", 2020-06-12T02:39:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023482784999999999 2020-06-12T02:39:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402499+0000", 2020-06-12T02:39:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023814933 2020-06-12T02:39:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:821 1.2s0 1:40a24690:::smithi14213939-8:head [sparse-read 0~3529437] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.78483553500001, 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999, 2020-06-12T02:39:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 821 2020-06-12T02:39:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378828+0000", 2020-06-12T02:39:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8440999999999999e-05 2020-06-12T02:39:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378877+0000", 2020-06-12T02:39:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2089999999999999e-06 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378884+0000", 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1303e-05 2020-06-12T02:39:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378895+0000", 2020-06-12T02:39:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7879999999999995e-06 2020-06-12T02:39:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378904+0000", 2020-06-12T02:39:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069699300000000003 2020-06-12T02:39:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379601+0000", 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165623 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379767+0000", 2020-06-12T02:39:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027888726999999999 2020-06-12T02:39:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.407655+0000", 2020-06-12T02:39:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028827083999999999 2020-06-12T02:39:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:822 1.2s0 1:40a24690:::smithi14213939-8:head [read 0~3529437,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.78470468500001, 2020-06-12T02:39:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998, 2020-06-12T02:39:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 822 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.378959+0000", 2020-06-12T02:39:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6091e-05 2020-06-12T02:39:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379035+0000", 2020-06-12T02:39:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0419999999999997e-06 2020-06-12T02:39:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379042+0000", 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2668e-05 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379055+0000", 2020-06-12T02:39:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-06 2020-06-12T02:39:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379060+0000", 2020-06-12T02:39:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001615918 2020-06-12T02:39:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380676+0000", 2020-06-12T02:39:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050690999999999996 2020-06-12T02:39:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381183+0000", 2020-06-12T02:39:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029042610999999999 2020-06-12T02:39:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410225+0000", 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031266139999999998 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:823 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.784560363, 2020-06-12T02:39:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999, 2020-06-12T02:39:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 823 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379104+0000", 2020-06-12T02:39:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3868000000000001e-05 2020-06-12T02:39:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379147+0000", 2020-06-12T02:39:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3740000000000003e-06 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379154+0000", 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4328000000000001e-05 2020-06-12T02:39:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379168+0000", 2020-06-12T02:39:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3950000000000003e-06 2020-06-12T02:39:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379173+0000", 2020-06-12T02:39:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068215400000000001 2020-06-12T02:39:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385994+0000", 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8096999999999995e-05 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386062+0000", 2020-06-12T02:39:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000571723 2020-06-12T02:39:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.386634+0000", 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011679559000000001 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398313+0000", 2020-06-12T02:39:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012128138 2020-06-12T02:39:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410442+0000", 2020-06-12T02:39:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9915999999999999e-05 2020-06-12T02:39:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410522+0000", 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031417937999999999 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:824 1.2s0 1:4fe4d12b:::smithi14213939-34:head [rollback 16] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.78444838199999, 2020-06-12T02:39:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003, 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 824 2020-06-12T02:39:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379216+0000", 2020-06-12T02:39:16.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1051999999999998e-05 2020-06-12T02:39:16.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379267+0000", 2020-06-12T02:39:16.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4010000000000002e-06 2020-06-12T02:39:16.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379273+0000", 2020-06-12T02:39:16.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1939e-05 2020-06-12T02:39:16.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379285+0000", 2020-06-12T02:39:16.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170000000000001e-06 2020-06-12T02:39:16.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379289+0000", 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097554709999999999 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389045+0000", 2020-06-12T02:39:16.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131507 2020-06-12T02:39:16.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389176+0000", 2020-06-12T02:39:16.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00067138400000000002 2020-06-12T02:39:16.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.389848+0000", 2020-06-12T02:39:16.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084677529999999997 2020-06-12T02:39:16.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012354206 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410670+0000", 2020-06-12T02:39:16.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6066000000000001e-05 2020-06-12T02:39:16.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410736+0000", 2020-06-12T02:39:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031520296000000003 2020-06-12T02:39:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.466 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:825 1.2s0 1:4fe4d12b:::smithi14213939-34:head [append 0~0] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:16.466 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:16.466 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.78429589699999, 2020-06-12T02:39:16.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997, 2020-06-12T02:39:16.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.467 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.468 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.468 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2020-06-12T02:39:16.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:16.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379368+0000", 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9431000000000001e-05 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379427+0000", 2020-06-12T02:39:16.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8239999999999995e-06 2020-06-12T02:39:16.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379437+0000", 2020-06-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7037e-05 2020-06-12T02:39:16.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379454+0000", 2020-06-12T02:39:16.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4139999999999994e-06 2020-06-12T02:39:16.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379463+0000", 2020-06-12T02:39:16.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011505741999999999 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.390968+0000", 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015265 2020-06-12T02:39:16.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391121+0000", 2020-06-12T02:39:16.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056415299999999996 2020-06-12T02:39:16.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.391685+0000", 2020-06-12T02:39:16.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066311529999999999 2020-06-12T02:39:16.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.398316+0000", 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013017802 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411334+0000", 2020-06-12T02:39:16.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000139634 2020-06-12T02:39:16.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.411474+0000", 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032105839999999997 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.480 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.482 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:848 1.2s0 1:40342bec:::smithi14213939-47:head [copy-from ver 18] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:16.482 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:16.482 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.763550759, 2020-06-12T02:39:16.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001, 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.483 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 848 2020-06-12T02:39:16.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.484 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:16.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400113+0000", 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024497100000000002 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400358+0000", 2020-06-12T02:39:16.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3249999999999997e-06 2020-06-12T02:39:16.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400367+0000", 2020-06-12T02:39:16.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4277000000000001e-05 2020-06-12T02:39:16.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400382+0000", 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1319999999999996e-06 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400389+0000", 2020-06-12T02:39:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1557999999999996e-05 2020-06-12T02:39:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400450+0000", 2020-06-12T02:39:16.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154165 2020-06-12T02:39:16.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400605+0000", 2020-06-12T02:39:16.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034533343000000001 2020-06-12T02:39:16.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.435138+0000", 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085126520000000008 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.443651+0000", 2020-06-12T02:39:16.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083747439999999999 2020-06-12T02:39:16.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452025+0000", 2020-06-12T02:39:16.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107205 2020-06-12T02:39:16.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.452133+0000", 2020-06-12T02:39:16.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052019372000000001 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:849 1.2s0 1:40342bec:::smithi14213939-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.76322566499999, 2020-06-12T02:39:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999, 2020-06-12T02:39:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 849 2020-06-12T02:39:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400438+0000", 2020-06-12T02:39:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9910000000000001e-05 2020-06-12T02:39:16.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400498+0000", 2020-06-12T02:39:16.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.241e-06 2020-06-12T02:39:16.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400504+0000", 2020-06-12T02:39:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2097e-05 2020-06-12T02:39:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400517+0000", 2020-06-12T02:39:16.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.887e-06 2020-06-12T02:39:16.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400521+0000", 2020-06-12T02:39:16.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021493369999999999 2020-06-12T02:39:16.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402671+0000", 2020-06-12T02:39:16.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8900999999999994e-05 2020-06-12T02:39:16.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:16.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402770+0000", 2020-06-12T02:39:16.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036324344000000001 2020-06-12T02:39:16.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439094+0000", 2020-06-12T02:39:16.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013905699999999999 2020-06-12T02:39:16.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.439233+0000", 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013900337 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453133+0000", 2020-06-12T02:39:16.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015113799999999999 2020-06-12T02:39:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453285+0000", 2020-06-12T02:39:16.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2020-06-12T02:39:16.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.453471+0000", 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053032902999999999 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:916 1.2s0 1:40a24690:::smithi14213939-8:head [copy-from ver 126] snapc 32=[32,30,24,23,1e,16] ondisk+write+known_if_redirected e72)", 2020-06-12T02:39:16.514 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:16.515 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.64757918199999, 2020-06-12T02:39:16.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999, 2020-06-12T02:39:16.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 916 2020-06-12T02:39:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516085+0000", 2020-06-12T02:39:16.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018975099999999999 2020-06-12T02:39:16.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516275+0000", 2020-06-12T02:39:16.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2020-06-12T02:39:16.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516297+0000", 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0782999999999999e-05 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516338+0000", 2020-06-12T02:39:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6257e-05 2020-06-12T02:39:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516354+0000", 2020-06-12T02:39:16.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8641999999999999e-05 2020-06-12T02:39:16.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516413+0000", 2020-06-12T02:39:16.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026772599999999998 2020-06-12T02:39:16.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516680+0000", 2020-06-12T02:39:16.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014504527 2020-06-12T02:39:16.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:16.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.531185+0000", 2020-06-12T02:39:16.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081387769999999998 2020-06-12T02:39:16.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:16.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.539324+0000", 2020-06-12T02:39:16.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001648421 2020-06-12T02:39:16.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:16.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.540972+0000", 2020-06-12T02:39:16.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016610299999999999 2020-06-12T02:39:16.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.541138+0000", 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.025053328999999999 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.530 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:917 1.2s0 1:40a24690:::smithi14213939-8:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e72)", 2020-06-12T02:39:16.530 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:16.530 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.64723892399999, 2020-06-12T02:39:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703, 2020-06-12T02:39:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.531 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 917 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:16.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516425+0000", 2020-06-12T02:39:16.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015008799999999999 2020-06-12T02:39:16.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516575+0000", 2020-06-12T02:39:16.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9462000000000001e-05 2020-06-12T02:39:16.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516595+0000", 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7194999999999999e-05 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516632+0000", 2020-06-12T02:39:16.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1175999999999999e-05 2020-06-12T02:39:16.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.516643+0000", 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045029599999999999 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517093+0000", 2020-06-12T02:39:16.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0234000000000006e-05 2020-06-12T02:39:16.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:16.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.517163+0000", 2020-06-12T02:39:16.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019705381000000001 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.536869+0000", 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000133521 2020-06-12T02:39:16.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.537002+0000", 2020-06-12T02:39:16.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064389139999999996 2020-06-12T02:39:16.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543441+0000", 2020-06-12T02:39:16.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019793 2020-06-12T02:39:16.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543639+0000", 2020-06-12T02:39:16.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000184506 2020-06-12T02:39:16.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.543824+0000", 2020-06-12T02:39:16.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027398703 2020-06-12T02:39:16.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.546 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:16.546 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:16.548 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:16.258+0000 7f57c25c6700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:16.548 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:16.270+0000 7f57c1364700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:16.549 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:16.549+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:16.649 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:16.650+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:16.670 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:16.671 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:16.671 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:39:16.671 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:16.682 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:16.751 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:16.749+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:16.840 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:16.841 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:16.850 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:16.853 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:16.850+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:16.952 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:16.949+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:16.954 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:180 1.8s0 1:1019c0e2:::smithi14213939-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e21)", 2020-06-12T02:39:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:39:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 228.23419664299999, 2020-06-12T02:39:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001, 2020-06-12T02:39:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 180 2020-06-12T02:39:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:39:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719358+0000", 2020-06-12T02:39:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2646999999999999e-05 2020-06-12T02:39:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719411+0000", 2020-06-12T02:39:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0960000000000007e-06 2020-06-12T02:39:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719420+0000", 2020-06-12T02:39:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3585e-05 2020-06-12T02:39:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719433+0000", 2020-06-12T02:39:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9620000000000001e-06 2020-06-12T02:39:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719438+0000", 2020-06-12T02:39:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4869000000000001e-05 2020-06-12T02:39:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719473+0000", 2020-06-12T02:39:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5818e-05 2020-06-12T02:39:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.719529+0000", 2020-06-12T02:39:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005928099 2020-06-12T02:39:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725457+0000", 2020-06-12T02:39:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112475 2020-06-12T02:39:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.725570+0000", 2020-06-12T02:39:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076560899999999999 2020-06-12T02:39:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733226+0000", 2020-06-12T02:39:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012804299999999999 2020-06-12T02:39:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.733354+0000", 2020-06-12T02:39:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00189263 2020-06-12T02:39:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:28.735246+0000", 2020-06-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015888314000000001 2020-06-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:282 1.7s0 1:e5c78654:::smithi14213939-21:head [sparse-read 0~2336140] snapc 0=[] ondisk+read+known_if_redirected e27)", 2020-06-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 222.80421739100001, 2020-06-12T02:39:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999, 2020-06-12T02:39:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 282 2020-06-12T02:39:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:39:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149337+0000", 2020-06-12T02:39:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018213699999999999 2020-06-12T02:39:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149519+0000", 2020-06-12T02:39:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3118000000000001e-05 2020-06-12T02:39:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149543+0000", 2020-06-12T02:39:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2642000000000003e-05 2020-06-12T02:39:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149585+0000", 2020-06-12T02:39:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:39:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149601+0000", 2020-06-12T02:39:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9898000000000001e-05 2020-06-12T02:39:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149661+0000", 2020-06-12T02:39:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7677e-05 2020-06-12T02:39:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.149679+0000", 2020-06-12T02:39:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069120450000000003 2020-06-12T02:39:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156591+0000", 2020-06-12T02:39:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000134478 2020-06-12T02:39:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.156726+0000", 2020-06-12T02:39:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072648319999999997 2020-06-12T02:39:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:34.163990+0000", 2020-06-12T02:39:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014653078999999999 2020-06-12T02:39:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:303 1.7s0 1:e1df0bbe:::smithi14213939-19:head [copy-from ver 6] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:39:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.688254226, 2020-06-12T02:39:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002, 2020-06-12T02:39:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 303 2020-06-12T02:39:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:39:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265300+0000", 2020-06-12T02:39:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018910300000000001 2020-06-12T02:39:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265490+0000", 2020-06-12T02:39:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2020-06-12T02:39:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265511+0000", 2020-06-12T02:39:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9149000000000002e-05 2020-06-12T02:39:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265540+0000", 2020-06-12T02:39:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5230000000000001e-06 2020-06-12T02:39:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265550+0000", 2020-06-12T02:39:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105954 2020-06-12T02:39:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265656+0000", 2020-06-12T02:39:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000260277 2020-06-12T02:39:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265916+0000", 2020-06-12T02:39:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018374455000000001 2020-06-12T02:39:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284290+0000", 2020-06-12T02:39:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056944739999999997 2020-06-12T02:39:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289985+0000", 2020-06-12T02:39:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040517139999999997 2020-06-12T02:39:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294037+0000", 2020-06-12T02:39:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013354600000000001 2020-06-12T02:39:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.294170+0000", 2020-06-12T02:39:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028869621000000002 2020-06-12T02:39:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:304 1.7s0 1:e1df0bbe:::smithi14213939-19:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:39:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.68787722499999, 2020-06-12T02:39:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001, 2020-06-12T02:39:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 304 2020-06-12T02:39:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:39:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265677+0000", 2020-06-12T02:39:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012064 2020-06-12T02:39:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265798+0000", 2020-06-12T02:39:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9651000000000001e-05 2020-06-12T02:39:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265828+0000", 2020-06-12T02:39:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3935e-05 2020-06-12T02:39:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265862+0000", 2020-06-12T02:39:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3424999999999999e-05 2020-06-12T02:39:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.265875+0000", 2020-06-12T02:39:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045373000000000001 2020-06-12T02:39:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266329+0000", 2020-06-12T02:39:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012863100000000001 2020-06-12T02:39:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266457+0000", 2020-06-12T02:39:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020434101999999999 2020-06-12T02:39:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.286892+0000", 2020-06-12T02:39:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012910100000000001 2020-06-12T02:39:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.287021+0000", 2020-06-12T02:39:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080569360000000007 2020-06-12T02:39:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295078+0000", 2020-06-12T02:39:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104079 2020-06-12T02:39:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295182+0000", 2020-06-12T02:39:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013417299999999999 2020-06-12T02:39:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295316+0000", 2020-06-12T02:39:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029638403000000001 2020-06-12T02:39:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:308 1.8s0 1:10b42b05:::smithi14213939-4:head [copy-from ver 14] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:39:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.68746769000001, 2020-06-12T02:39:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002, 2020-06-12T02:39:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 308 2020-06-12T02:39:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266087+0000", 2020-06-12T02:39:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019933400000000001 2020-06-12T02:39:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266286+0000", 2020-06-12T02:39:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.738e-05 2020-06-12T02:39:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266304+0000", 2020-06-12T02:39:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1092e-05 2020-06-12T02:39:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266335+0000", 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4851000000000001e-05 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266350+0000", 2020-06-12T02:39:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3219000000000006e-05 2020-06-12T02:39:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266413+0000", 2020-06-12T02:39:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010653 2020-06-12T02:39:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266519+0000", 2020-06-12T02:39:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024091873999999999 2020-06-12T02:39:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290611+0000", 2020-06-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049659040000000002 2020-06-12T02:39:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295577+0000", 2020-06-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077616200000000003 2020-06-12T02:39:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303339+0000", 2020-06-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014056499999999999 2020-06-12T02:39:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.303479+0000", 2020-06-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037392369000000002 2020-06-12T02:39:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:309 1.8s0 1:10b42b05:::smithi14213939-4:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.687075359, 2020-06-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999, 2020-06-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 309 2020-06-12T02:39:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:39:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266479+0000", 2020-06-12T02:39:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120083 2020-06-12T02:39:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266599+0000", 2020-06-12T02:39:17.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6543000000000001e-05 2020-06-12T02:39:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266616+0000", 2020-06-12T02:39:17.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0746e-05 2020-06-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266647+0000", 2020-06-12T02:39:17.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4109e-05 2020-06-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266661+0000", 2020-06-12T02:39:17.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5731e-05 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266707+0000", 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4586000000000002e-05 2020-06-12T02:39:17.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.266761+0000", 2020-06-12T02:39:17.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028717953000000001 2020-06-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295479+0000", 2020-06-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3789000000000006e-05 2020-06-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295573+0000", 2020-06-12T02:39:17.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085814429999999994 2020-06-12T02:39:17.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304154+0000", 2020-06-12T02:39:17.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000125485 2020-06-12T02:39:17.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304280+0000", 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000145654 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.304425+0000", 2020-06-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037946121999999999 2020-06-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:314 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 1553542~708338] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.67014093099999, 2020-06-12T02:39:17.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799, 2020-06-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 314 2020-06-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283414+0000", 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031226000000000002 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283726+0000", 2020-06-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5386000000000001e-05 2020-06-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283741+0000", 2020-06-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3071e-05 2020-06-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283764+0000", 2020-06-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5469e-05 2020-06-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283780+0000", 2020-06-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000135692 2020-06-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.283916+0000", 2020-06-12T02:39:17.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147501 2020-06-12T02:39:17.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.284063+0000", 2020-06-12T02:39:17.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011445656 2020-06-12T02:39:17.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.295509+0000", 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005392979 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300902+0000", 2020-06-12T02:39:17.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052301860000000004 2020-06-12T02:39:17.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306132+0000", 2020-06-12T02:39:17.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2599e-05 2020-06-12T02:39:17.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306215+0000", 2020-06-12T02:39:17.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022800799 2020-06-12T02:39:17.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:315 1.9s0 1:9e3c9860:::smithi14213939-15:head [write 2964119~94722] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:17.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:39:17.085 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.664146332, 2020-06-12T02:39:17.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378, 2020-06-12T02:39:17.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.086 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 315 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:39:17.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.289408+0000", 2020-06-12T02:39:17.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010317270000000001 2020-06-12T02:39:17.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290440+0000", 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0871e-05 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290451+0000", 2020-06-12T02:39:17.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6738000000000001e-05 2020-06-12T02:39:17.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290468+0000", 2020-06-12T02:39:17.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-06 2020-06-12T02:39:17.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290475+0000", 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4759000000000003e-05 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290520+0000", 2020-06-12T02:39:17.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120556 2020-06-12T02:39:17.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290640+0000", 2020-06-12T02:39:17.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080428900000000005 2020-06-12T02:39:17.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.298683+0000", 2020-06-12T02:39:17.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022241090000000002 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300907+0000", 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059690940000000003 2020-06-12T02:39:17.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.306876+0000", 2020-06-12T02:39:17.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014344600000000001 2020-06-12T02:39:17.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307020+0000", 2020-06-12T02:39:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017611378 2020-06-12T02:39:17.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:316 1.9s0 1:9e3c9860:::smithi14213939-15:head [setxattr _header (56) in=7b,truncate 3058841] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:17.099 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:39:17.100 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.66300975799999, 2020-06-12T02:39:17.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001, 2020-06-12T02:39:17.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.101 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.101 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.101 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.102 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.102 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 316 2020-06-12T02:39:17.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.102 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:39:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290545+0000", 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1452000000000005e-05 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290636+0000", 2020-06-12T02:39:17.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:39:17.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290644+0000", 2020-06-12T02:39:17.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3312999999999999e-05 2020-06-12T02:39:17.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290657+0000", 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.045e-06 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290662+0000", 2020-06-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028106000000000002 2020-06-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290943+0000", 2020-06-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014075099999999999 2020-06-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291084+0000", 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092277269999999998 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.300312+0000", 2020-06-12T02:39:17.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001039021 2020-06-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.301351+0000", 2020-06-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057662039999999996 2020-06-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307117+0000", 2020-06-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6314e-05 2020-06-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307213+0000", 2020-06-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016668280000000001 2020-06-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:317 1.9s0 1:9e3c9860:::smithi14213939-15:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 220.66282766099999, 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565, 2020-06-12T02:39:17.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.117 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 317 2020-06-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290727+0000", 2020-06-12T02:39:17.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1310999999999997e-05 2020-06-12T02:39:17.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290778+0000", 2020-06-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1540000000000008e-06 2020-06-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290787+0000", 2020-06-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3964999999999999e-05 2020-06-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290801+0000", 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3159999999999996e-06 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.290807+0000", 2020-06-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000557304 2020-06-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291364+0000", 2020-06-12T02:39:17.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014172699999999999 2020-06-12T02:39:17.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.291506+0000", 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016143472999999998 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307649+0000", 2020-06-12T02:39:17.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121005 2020-06-12T02:39:17.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.307770+0000", 2020-06-12T02:39:17.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00098531000000000009 2020-06-12T02:39:17.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.308756+0000", 2020-06-12T02:39:17.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018028565 2020-06-12T02:39:17.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.132 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:337 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:39:17.132 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:39:17.132 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 216.01564233900001, 2020-06-12T02:39:17.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685, 2020-06-12T02:39:17.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.134 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.134 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.134 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 337 2020-06-12T02:39:17.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.134 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:39:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.937912+0000", 2020-06-12T02:39:17.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132287 2020-06-12T02:39:17.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938045+0000", 2020-06-12T02:39:17.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3390000000000001e-05 2020-06-12T02:39:17.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938058+0000", 2020-06-12T02:39:17.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0958000000000002e-05 2020-06-12T02:39:17.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938079+0000", 2020-06-12T02:39:17.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6115000000000001e-05 2020-06-12T02:39:17.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938095+0000", 2020-06-12T02:39:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027038069999999999 2020-06-12T02:39:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940799+0000", 2020-06-12T02:39:17.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4142999999999996e-05 2020-06-12T02:39:17.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940893+0000", 2020-06-12T02:39:17.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037003869999999999 2020-06-12T02:39:17.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944593+0000", 2020-06-12T02:39:17.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119238 2020-06-12T02:39:17.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.944713+0000", 2020-06-12T02:39:17.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085993600000000003 2020-06-12T02:39:17.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.953312+0000", 2020-06-12T02:39:17.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015399685 2020-06-12T02:39:17.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.147 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.147 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:338 1.es0 1:7e821f7f:::smithi14213939-44:head [read 0~2722701,checksum] snapc 0=[] ondisk+read+known_if_redirected e34)", 2020-06-12T02:39:17.148 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:39:17.148 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 216.01532994999999, 2020-06-12T02:39:17.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001, 2020-06-12T02:39:17.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.148 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.149 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.149 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.149 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.149 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 338 2020-06-12T02:39:17.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.150 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:39:17.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938225+0000", 2020-06-12T02:39:17.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000141822 2020-06-12T02:39:17.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938367+0000", 2020-06-12T02:39:17.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946e-05 2020-06-12T02:39:17.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938379+0000", 2020-06-12T02:39:17.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0628e-05 2020-06-12T02:39:17.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938399+0000", 2020-06-12T02:39:17.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0159999999999999e-05 2020-06-12T02:39:17.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.938409+0000", 2020-06-12T02:39:17.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025211460000000002 2020-06-12T02:39:17.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940930+0000", 2020-06-12T02:39:17.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6499000000000001e-05 2020-06-12T02:39:17.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.940997+0000", 2020-06-12T02:39:17.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043283710000000001 2020-06-12T02:39:17.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945325+0000", 2020-06-12T02:39:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112037 2020-06-12T02:39:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.945437+0000", 2020-06-12T02:39:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095506989999999993 2020-06-12T02:39:17.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:40.954988+0000", 2020-06-12T02:39:17.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016763308000000001 2020-06-12T02:39:17.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:549 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:39:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:39:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 203.00376135799999, 2020-06-12T02:39:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404, 2020-06-12T02:39:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.168 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.168 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.169 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.169 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 549 2020-06-12T02:39:17.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.169 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:39:17.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949793+0000", 2020-06-12T02:39:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001317 2020-06-12T02:39:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949925+0000", 2020-06-12T02:39:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2163000000000001e-05 2020-06-12T02:39:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949947+0000", 2020-06-12T02:39:17.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2450999999999997e-05 2020-06-12T02:39:17.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.949990+0000", 2020-06-12T02:39:17.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5875e-05 2020-06-12T02:39:17.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950006+0000", 2020-06-12T02:39:17.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016154599999999999 2020-06-12T02:39:17.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950167+0000", 2020-06-12T02:39:17.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8566000000000001e-05 2020-06-12T02:39:17.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950196+0000", 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054918730000000004 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955687+0000", 2020-06-12T02:39:17.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101037 2020-06-12T02:39:17.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.955789+0000", 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010958579999999999 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.956884+0000", 2020-06-12T02:39:17.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049376769999999997 2020-06-12T02:39:17.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.961822+0000", 2020-06-12T02:39:17.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003620341 2020-06-12T02:39:17.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965442+0000", 2020-06-12T02:39:17.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000104953 2020-06-12T02:39:17.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.965547+0000", 2020-06-12T02:39:17.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01575404 2020-06-12T02:39:17.186 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.186 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:550 1.7s0 1:e19ef0f4:::smithi14213939-6:head [rollback 16] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:39:17.187 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 203.00342190000001, 2020-06-12T02:39:17.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999, 2020-06-12T02:39:17.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.188 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.188 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.189 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.189 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 550 2020-06-12T02:39:17.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.189 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950133+0000", 2020-06-12T02:39:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011765900000000001 2020-06-12T02:39:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950250+0000", 2020-06-12T02:39:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7175000000000001e-05 2020-06-12T02:39:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950268+0000", 2020-06-12T02:39:17.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0224000000000001e-05 2020-06-12T02:39:17.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950298+0000", 2020-06-12T02:39:17.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1946999999999999e-05 2020-06-12T02:39:17.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950310+0000", 2020-06-12T02:39:17.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058105099999999996 2020-06-12T02:39:17.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950891+0000", 2020-06-12T02:39:17.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3601999999999999e-05 2020-06-12T02:39:17.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:17.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950914+0000", 2020-06-12T02:39:17.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072374350000000004 2020-06-12T02:39:17.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958152+0000", 2020-06-12T02:39:17.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012230699999999999 2020-06-12T02:39:17.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958274+0000", 2020-06-12T02:39:17.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069458200000000001 2020-06-12T02:39:17.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.958969+0000", 2020-06-12T02:39:17.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050951629999999998 2020-06-12T02:39:17.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964064+0000", 2020-06-12T02:39:17.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026728699999999999 2020-06-12T02:39:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966737+0000", 2020-06-12T02:39:17.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7838999999999997e-05 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.966825+0000", 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016691853999999999 2020-06-12T02:39:17.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.205 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:551 1.7s0 1:e19ef0f4:::smithi14213939-6:head [append 0~0] snapc 1b=[1b,16,13,11] ondisk+write+known_if_redirected e47)", 2020-06-12T02:39:17.206 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:39:17.206 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 203.003125455, 2020-06-12T02:39:17.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001, 2020-06-12T02:39:17.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.206 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.207 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.207 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.207 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.207 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 551 2020-06-12T02:39:17.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.208 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:39:17.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950429+0000", 2020-06-12T02:39:17.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011095999999999999 2020-06-12T02:39:17.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950540+0000", 2020-06-12T02:39:17.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5027e-05 2020-06-12T02:39:17.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950555+0000", 2020-06-12T02:39:17.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9308000000000001e-05 2020-06-12T02:39:17.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950585+0000", 2020-06-12T02:39:17.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0458999999999999e-05 2020-06-12T02:39:17.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950595+0000", 2020-06-12T02:39:17.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038242000000000001 2020-06-12T02:39:17.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950977+0000", 2020-06-12T02:39:17.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0679999999999999e-05 2020-06-12T02:39:17.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:17.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.950998+0000", 2020-06-12T02:39:17.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087627569999999995 2020-06-12T02:39:17.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959761+0000", 2020-06-12T02:39:17.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116579 2020-06-12T02:39:17.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.959877+0000", 2020-06-12T02:39:17.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050874000000000004 2020-06-12T02:39:17.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.960386+0000", 2020-06-12T02:39:17.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036814679999999998 2020-06-12T02:39:17.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.964068+0000", 2020-06-12T02:39:17.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032854009999999999 2020-06-12T02:39:17.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967353+0000", 2020-06-12T02:39:17.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8382999999999997e-05 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:53.967441+0000", 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017012182000000001 2020-06-12T02:39:17.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.229 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1108 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:39:17.230 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:39:17.230 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.96609167899999, 2020-06-12T02:39:17.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997, 2020-06-12T02:39:17.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.231 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.231 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.231 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.231 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1108 2020-06-12T02:39:17.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.232 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:39:17.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987463+0000", 2020-06-12T02:39:17.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218111 2020-06-12T02:39:17.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987681+0000", 2020-06-12T02:39:17.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568999999999999e-05 2020-06-12T02:39:17.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987694+0000", 2020-06-12T02:39:17.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2529999999999999e-05 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987716+0000", 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0621e-05 2020-06-12T02:39:17.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987727+0000", 2020-06-12T02:39:17.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6925000000000001e-05 2020-06-12T02:39:17.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987784+0000", 2020-06-12T02:39:17.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7730000000000001e-06 2020-06-12T02:39:17.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:39:17.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.987788+0000", 2020-06-12T02:39:17.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96256948600000003 2020-06-12T02:39:17.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950357+0000", 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8254000000000002e-05 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950415+0000", 2020-06-12T02:39:17.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.96295226899999997 2020-06-12T02:39:17.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.241 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1109 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:39:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:39:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.958485231, 2020-06-12T02:39:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002, 2020-06-12T02:39:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1109 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:39:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995069+0000", 2020-06-12T02:39:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037866100000000003 2020-06-12T02:39:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995448+0000", 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0229999999999998e-06 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995457+0000", 2020-06-12T02:39:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6622000000000001e-05 2020-06-12T02:39:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995474+0000", 2020-06-12T02:39:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2840000000000006e-06 2020-06-12T02:39:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995482+0000", 2020-06-12T02:39:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4904000000000001e-05 2020-06-12T02:39:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995547+0000", 2020-06-12T02:39:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6969999999999999e-06 2020-06-12T02:39:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.995551+0000", 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95492752199999997 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950478+0000", 2020-06-12T02:39:17.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9169999999999995e-06 2020-06-12T02:39:17.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950487+0000", 2020-06-12T02:39:17.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95541763000000002 2020-06-12T02:39:17.254 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.254 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1110 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:39:17.255 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.955106693, 2020-06-12T02:39:17.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996, 2020-06-12T02:39:17.256 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.256 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.257 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.257 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1110 2020-06-12T02:39:17.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.257 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:39:17.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998448+0000", 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000153707 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998602+0000", 2020-06-12T02:39:17.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2285e-05 2020-06-12T02:39:17.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998614+0000", 2020-06-12T02:39:17.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9998999999999999e-05 2020-06-12T02:39:17.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998634+0000", 2020-06-12T02:39:17.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2262000000000001e-05 2020-06-12T02:39:17.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998646+0000", 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2972e-05 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998699+0000", 2020-06-12T02:39:17.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6460000000000002e-06 2020-06-12T02:39:17.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:39:17.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998702+0000", 2020-06-12T02:39:17.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95184501200000005 2020-06-12T02:39:17.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950547+0000", 2020-06-12T02:39:17.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2020-06-12T02:39:17.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950554+0000", 2020-06-12T02:39:17.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95210639799999996 2020-06-12T02:39:17.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.272 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.272 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.273 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1111 1.7s0 1.2273be17 (undecoded) ondisk+write+known_if_redirected e87)", 2020-06-12T02:39:17.273 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:39:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.95483643899999, 2020-06-12T02:39:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001, 2020-06-12T02:39:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1111 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:39:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998718+0000", 2020-06-12T02:39:17.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7622999999999998e-05 2020-06-12T02:39:17.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998806+0000", 2020-06-12T02:39:17.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3719999999999994e-06 2020-06-12T02:39:17.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998815+0000", 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6880000000000001e-05 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998832+0000", 2020-06-12T02:39:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2580000000000001e-06 2020-06-12T02:39:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998838+0000", 2020-06-12T02:39:17.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-05 2020-06-12T02:39:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998891+0000", 2020-06-12T02:39:17.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1179999999999999e-06 2020-06-12T02:39:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:39:17.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998893+0000", 2020-06-12T02:39:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95169583999999996 2020-06-12T02:39:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950589+0000", 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.61e-06 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950596+0000", 2020-06-12T02:39:17.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95187825100000001 2020-06-12T02:39:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1112 1.7s0 1.2273be17 (undecoded) ondisk+read+rwordered+known_if_redirected e87)", 2020-06-12T02:39:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:39:17.287 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 162.954655317, 2020-06-12T02:39:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004, 2020-06-12T02:39:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.288 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1112 2020-06-12T02:39:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.289 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:39:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998899+0000", 2020-06-12T02:39:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8495000000000001e-05 2020-06-12T02:39:17.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998968+0000", 2020-06-12T02:39:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5710000000000004e-06 2020-06-12T02:39:17.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998977+0000", 2020-06-12T02:39:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6095000000000001e-05 2020-06-12T02:39:17.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998994+0000", 2020-06-12T02:39:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6359999999999999e-06 2020-06-12T02:39:17.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.998999+0000", 2020-06-12T02:39:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1779999999999995e-05 2020-06-12T02:39:17.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999061+0000", 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9529999999999999e-06 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2020-06-12T02:39:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:33.999064+0000", 2020-06-12T02:39:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95156667699999997 2020-06-12T02:39:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950631+0000", 2020-06-12T02:39:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1999999999999994e-06 2020-06-12T02:39:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:34.950639+0000", 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.95173940700000004 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.300 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.300 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:17.302 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is unset 2020-06-12T02:39:17.302 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:17.301+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:17.303 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:17.402 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:17.402+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:17.420 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:17.420 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2020-06-12T02:39:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:17.431 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:17.507 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:17.505+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:17.590 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:17.592 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:17.599 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:17.608 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:17.605+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:17.705 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:17.706 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:17.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:17.706 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:17.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.706 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:17.707 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:17.707 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.583452443, 2020-06-12T02:39:17.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:39:17.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.708 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.708 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.708 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.708 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:39:17.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.709 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:17.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:17.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:39:17.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:39:17.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:39:17.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:39:17.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:39:17.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:39:17.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:39:17.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:39:17.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:39:17.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:39:17.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:39:17.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:39:17.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:39:17.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:39:17.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:39:17.722 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.722 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:17.723 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 226.58322900100001, 2020-06-12T02:39:17.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:39:17.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.724 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.724 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.724 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.725 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.725 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:39:17.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.725 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:17.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:17.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:39:17.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:39:17.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:39:17.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:39:17.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:39:17.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:39:17.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:39:17.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:39:17.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:39:17.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:39:17.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:39:17.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:39:17.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:39:17.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:39:17.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:39:17.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:39:17.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:39:17.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:39:17.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:39:17.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:39:17.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:39:17.740 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.740 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.740 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.741 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:17.741 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:17.741 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 221.54074989200001, 2020-06-12T02:39:17.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:39:17.742 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.742 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.742 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.742 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.743 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.743 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:39:17.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.744 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:17.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:17.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:39:17.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:39:17.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:39:17.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:39:17.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:39:17.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:39:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:39:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:39:17.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:39:17.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:39:17.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:39:17.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:39:17.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:39:17.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:39:17.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:39:17.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:39:17.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:39:17.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:39:17.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:39:17.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:39:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:39:17.761 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.762 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:17.763 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:17.763 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 221.54041499799999, 2020-06-12T02:39:17.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:39:17.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.764 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.764 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.764 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.764 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.764 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:39:17.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.765 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:17.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:39:17.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:39:17.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:39:17.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:39:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:39:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:39:17.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:39:17.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:39:17.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:39:17.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:39:17.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:39:17.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:17.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:39:17.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:39:17.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:39:17.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:39:17.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:39:17.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:39:17.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:39:17.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:39:17.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:39:17.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.780 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:17.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:17.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.33953911500001, 2020-06-12T02:39:17.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:39:17.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:39:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:39:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:39:17.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:39:17.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:39:17.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:39:17.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:39:17.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:39:17.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:39:17.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:39:17.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:39:17.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:39:17.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:39:17.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:39:17.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:39:17.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:39:17.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:39:17.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:39:17.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:39:17.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:39:17.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.797 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:17.797 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:17.797 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.339379302, 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.798 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.799 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:39:17.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:17.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:39:17.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:39:17.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:39:17.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:39:17.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:39:17.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:39:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:39:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:39:17.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:39:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:39:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:39:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:39:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:39:17.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:39:17.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:39:17.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.811 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:17.812 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:17.812 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.33929858900001, 2020-06-12T02:39:17.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:39:17.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.812 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.813 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:17.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:39:17.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:39:17.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:39:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:39:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:39:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:39:17.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:39:17.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:39:17.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:17.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:39:17.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:39:17.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:39:17.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.824 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.825 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:17.825 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:17.825 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.339052036, 2020-06-12T02:39:17.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:39:17.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.826 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.826 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:39:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:17.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:39:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:39:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:39:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:39:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:39:17.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:39:17.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:39:17.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:39:17.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:39:17.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:39:17.835 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:17.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:17.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.325701713, 2020-06-12T02:39:17.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:39:17.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:39:17.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:17.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:39:17.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:39:17.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:39:17.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:39:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:39:17.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:39:17.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:39:17.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:39:17.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:39:17.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:39:17.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:39:17.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:39:17.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:39:17.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:39:17.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:39:17.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.851 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.851 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:17.852 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:17.852 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.325515459, 2020-06-12T02:39:17.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:39:17.852 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.853 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.853 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.853 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.853 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.853 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:39:17.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.854 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:17.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:39:17.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:39:17.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:39:17.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:39:17.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:39:17.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:39:17.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:39:17.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:39:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:39:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:39:17.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:39:17.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:39:17.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:39:17.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:39:17.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:39:17.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:39:17.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:39:17.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:39:17.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:39:17.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.867 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:17.868 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:17.868 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 182.32531474800001, 2020-06-12T02:39:17.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:39:17.868 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.868 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.869 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:39:17.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.870 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:17.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:17.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:39:17.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:39:17.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:39:17.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:39:17.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:39:17.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:39:17.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:39:17.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:39:17.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:39:17.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:39:17.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:39:17.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:39:17.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:39:17.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:39:17.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:39:17.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:39:17.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:39:17.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.885 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.886 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:17.886 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:17.886 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.73282678699999, 2020-06-12T02:39:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:39:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.887 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:17.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:39:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:39:17.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:39:17.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:39:17.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:39:17.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:39:17.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:39:17.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:39:17.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:39:17.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:39:17.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:39:17.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:39:17.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:39:17.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:39:17.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:39:17.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:39:17.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:39:17.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:39:17.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:39:17.901 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.901 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.901 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.73240304000001, 2020-06-12T02:39:17.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:39:17.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.903 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.904 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.904 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:17.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.905 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:17.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:17.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:39:17.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:39:17.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:39:17.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:39:17.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:17.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:39:17.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:39:17.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:39:17.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:39:17.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:39:17.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:39:17.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:17.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:39:17.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:39:17.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:39:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:39:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:39:17.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:39:17.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.923 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.923 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.923 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.732249182, 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:17.924 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.925 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.925 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.925 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:17.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.925 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:17.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:17.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:39:17.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:39:17.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:39:17.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:39:17.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:39:17.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:39:17.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:39:17.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:39:17.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:39:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:39:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:39:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:39:17.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:39:17.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:39:17.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:39:17.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:39:17.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:39:17.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.939 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.939 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.940 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:17.940 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:17.940 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.729518394, 2020-06-12T02:39:17.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:39:17.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.941 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:17.941 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.942 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.943 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.944 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:17.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.945 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:17.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:39:17.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:39:17.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:39:17.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:39:17.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:39:17.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:39:17.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:39:17.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:39:17.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:17.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:39:17.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:39:17.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:39:17.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.963 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:17.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:17.964 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.729098067, 2020-06-12T02:39:17.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:39:17.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.964 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:17.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.965 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.965 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:17.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:17.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:39:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:39:17.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:39:17.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:39:17.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:39:17.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:39:17.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:39:17.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:39:17.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:39:17.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:39:17.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:39:17.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:17.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:39:17.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:39:17.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:39:17.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:39:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.976 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:17.976 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:17.976 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 177.729003234, 2020-06-12T02:39:17.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:39:17.976 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.977 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:17.977 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.977 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.977 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.978 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:17.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.978 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:17.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:17.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:39:17.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:39:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:39:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:39:17.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:39:17.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:39:17.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:39:17.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:39:17.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:39:17.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:17.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:39:17.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:39:17.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:39:17.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:39:17.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:17.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:39:17.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:39:17.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:17.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:17.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.990 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:17.990 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:17.991 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.69922388000001, 2020-06-12T02:39:17.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:39:17.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:17.991 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:17.991 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:17.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:17.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:17.992 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:39:17.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.992 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:17.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:17.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:17.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:17.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:17.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:17.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:39:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:17.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:39:17.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:39:17.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:17.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:39:17.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:39:17.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:17.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:17.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:17.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:39:18.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:39:18.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:18.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:39:18.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:39:18.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:39:18.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:39:18.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:18.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:39:18.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:39:18.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:18.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:39:18.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:39:18.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:18.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:39:18.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:39:18.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:18.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:39:18.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:39:18.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:18.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:39:18.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:39:18.008 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.008 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:18.009 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.69875826699999, 2020-06-12T02:39:18.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:39:18.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:18.010 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:18.010 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:18.010 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:18.011 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:18.011 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:39:18.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.012 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:18.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:18.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:18.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:18.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:39:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:18.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:39:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:39:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:18.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:39:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:39:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:39:18.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:39:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:39:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:39:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:18.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:39:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:39:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:39:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:39:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:18.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:39:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:39:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:39:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:39:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:39:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:39:18.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:39:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:39:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:39:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:39:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:18.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:39:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:18.032 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 173.698584332, 2020-06-12T02:39:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:39:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:18.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:18.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:18.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:39:18.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:39:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:39:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:39:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:39:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:39:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:39:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:18.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:39:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:39:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:39:18.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:39:18.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:18.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:39:18.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:39:18.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:18.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:39:18.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:39:18.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:18.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:18.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:18.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:39:18.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:39:18.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:18.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:18.048 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:18.049 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:39:18.051 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:18.052 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:18.045+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:18.151 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:18.149+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:18.174 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:18.175 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:18.175 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:18.175 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:18.186 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:18.202 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:18.198+0000 7f4e08cbc700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:18.207 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:18.206+0000 7f4e0359e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:18.241 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:18.252 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:18.250+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:18.263 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:18.287 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:18.312 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:18.339 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.339 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.340 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:18.349 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:18.353 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:18.349+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:18.369 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:18.394 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.396 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.396 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.396 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:39:18.398 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:18.402 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:18.454 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:18.454+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:18.457 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.457 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.467 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:18.554 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:18.554+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:18.571 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.571 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.580 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:18.655 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:18.653+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:18.690 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.690 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.712 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:18.756 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:18.753+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:18.857 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:18.854+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:18.862 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.863 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.872 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:18.958 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:18.958+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:18.983 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:18.983 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:18.993 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:19.062 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:19.057+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:19.100 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.100 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.109 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:19.199 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:19.197+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:19.262 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.262 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.268 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:19.266+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:19.271 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:19.305 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-06-12T02:39:19.368 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:19.366+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:19.442 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.443 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.443 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:19.422+0000 7f01956f9700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:19.443 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:19.438+0000 7f018ffff700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:19.444 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:19.470 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:19.470+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:19.551 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.552 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.561 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:19.570 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:19.570+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:19.671 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.672 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.672 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:19.669+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:19.680 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:19.774 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:19.770+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:19.793 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.794 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.810 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:19.898 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:19.898+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:19.964 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:19.965 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:19.973 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:19.976 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:19.973+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:20.077 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:20.073+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:20.127 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:20.128 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:20.137 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:20.178 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:20.173+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:20.183 INFO:teuthology.orchestra.run.smithi142.stderr:nodeep-scrub is unset 2020-06-12T02:39:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:20.249 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:20.258 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:20.279 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:20.277+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:20.359 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:20.359 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:20.368 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:20.403 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-06-12T02:39:20.414 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:20.414+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:20.476 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:20.476 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:20.480 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:20.477+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:20.495 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-06-12T02:39:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:20.514+0000 7f2aab392700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:20.522+0000 7f2aab392700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:20.562 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:20.581 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:20.577+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:20.582 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:20.609 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:20.610 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:20.610 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:20.612 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-06-12T02:39:20.631 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:20.660 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:20.684 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:20.682+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:20.687 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-06-12T02:39:20.717 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:20.718 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:20.746 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2020-06-12T02:39:20.746 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2020-06-12T02:39:20.747 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2020-06-12T02:39:20.747 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:20.754 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-06-12T02:39:20.783 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:20.781+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:20.884 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:20.885+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:20.909 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2020-06-12T02:39:20.909 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2020-06-12T02:39:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2020-06-12T02:39:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2020-06-12T02:39:20.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:221 1.1s0 1:82c302db:::smithi14213939-48:head [copy-from ver 6] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:20.911 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 229.786472245, 2020-06-12T02:39:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001, 2020-06-12T02:39:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 221 2020-06-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122125+0000", 2020-06-12T02:39:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115191 2020-06-12T02:39:20.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122240+0000", 2020-06-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.152e-05 2020-06-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122251+0000", 2020-06-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9687999999999999e-05 2020-06-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122271+0000", 2020-06-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6900000000000004e-06 2020-06-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122281+0000", 2020-06-12T02:39:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059170900000000005 2020-06-12T02:39:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122872+0000", 2020-06-12T02:39:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011321 2020-06-12T02:39:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122986+0000", 2020-06-12T02:39:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.02230097 2020-06-12T02:39:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.145287+0000", 2020-06-12T02:39:20.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032240139999999999 2020-06-12T02:39:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.148511+0000", 2020-06-12T02:39:20.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078933570000000002 2020-06-12T02:39:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156404+0000", 2020-06-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4475999999999997e-05 2020-06-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.156469+0000", 2020-06-12T02:39:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034343825000000001 2020-06-12T02:39:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:20.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:222 1.1s0 1:82c302db:::smithi14213939-48:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 229.78624880300001, 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523, 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 222 2020-06-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122348+0000", 2020-06-12T02:39:20.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9709999999999995e-05 2020-06-12T02:39:20.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:20.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122418+0000", 2020-06-12T02:39:20.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.827e-06 2020-06-12T02:39:20.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:20.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122425+0000", 2020-06-12T02:39:20.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6252e-05 2020-06-12T02:39:20.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:20.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122441+0000", 2020-06-12T02:39:20.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3970000000000002e-06 2020-06-12T02:39:20.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:20.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.122446+0000", 2020-06-12T02:39:20.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00075688199999999995 2020-06-12T02:39:20.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123203+0000", 2020-06-12T02:39:20.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4181999999999997e-05 2020-06-12T02:39:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.123257+0000", 2020-06-12T02:39:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.024519936999999999 2020-06-12T02:39:20.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147777+0000", 2020-06-12T02:39:20.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6125999999999995e-05 2020-06-12T02:39:20.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:20.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.147863+0000", 2020-06-12T02:39:20.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092392359999999996 2020-06-12T02:39:20.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157103+0000", 2020-06-12T02:39:20.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132633 2020-06-12T02:39:20.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:20.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157235+0000", 2020-06-12T02:39:20.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016334100000000001 2020-06-12T02:39:20.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:31.157399+0000", 2020-06-12T02:39:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.035050523 2020-06-12T02:39:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:300 1.6s0 1:6f0b6341:::smithi14213939-20:head [copy-from ver 12] snapc 8=[7,4] ondisk+write+known_if_redirected e29)", 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 224.74376969400001, 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769, 2020-06-12T02:39:20.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:20.973 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:20.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:20.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:20.973 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:20.973 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 300 2020-06-12T02:39:20.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.974 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:20.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:20.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:20.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:20.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:20.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164827+0000", 2020-06-12T02:39:20.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164666 2020-06-12T02:39:20.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:20.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.164992+0000", 2020-06-12T02:39:20.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6948000000000001e-05 2020-06-12T02:39:20.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:20.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165009+0000", 2020-06-12T02:39:20.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9416000000000001e-05 2020-06-12T02:39:20.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:20.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165038+0000", 2020-06-12T02:39:20.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4861999999999999e-05 2020-06-12T02:39:20.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:20.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165053+0000", 2020-06-12T02:39:20.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2020-06-12T02:39:20.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165132+0000", 2020-06-12T02:39:20.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0409999999999998e-06 2020-06-12T02:39:20.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2020-06-12T02:39:20.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165140+0000", 2020-06-12T02:39:20.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024058080000000002 2020-06-12T02:39:20.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167546+0000", 2020-06-12T02:39:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014900199999999999 2020-06-12T02:39:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167695+0000", 2020-06-12T02:39:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018591099999999999 2020-06-12T02:39:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:20.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.186286+0000", 2020-06-12T02:39:20.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004185762 2020-06-12T02:39:20.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:20.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190472+0000", 2020-06-12T02:39:20.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045046280000000001 2020-06-12T02:39:20.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:20.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.194977+0000", 2020-06-12T02:39:20.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011550800000000001 2020-06-12T02:39:20.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:20.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195092+0000", 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030264769 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.991 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:301 1.6s0 1:6f0b6341:::smithi14213939-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e29)", 2020-06-12T02:39:20.991 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:20.991 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 224.74343479999999, 2020-06-12T02:39:20.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001, 2020-06-12T02:39:20.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:20.992 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 301 2020-06-12T02:39:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:20.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:20.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:20.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:20.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165162+0000", 2020-06-12T02:39:20.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2666999999999999e-05 2020-06-12T02:39:20.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:20.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165255+0000", 2020-06-12T02:39:20.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.52e-05 2020-06-12T02:39:20.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165270+0000", 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7858e-05 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:20.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165298+0000", 2020-06-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1722000000000001e-05 2020-06-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:20.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165310+0000", 2020-06-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024000000000002e-05 2020-06-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:20.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165367+0000", 2020-06-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8830000000000003e-06 2020-06-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.165372+0000", 2020-06-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025427599999999998 2020-06-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.167915+0000", 2020-06-12T02:39:21.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5937000000000001e-05 2020-06-12T02:39:21.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:21.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.168001+0000", 2020-06-12T02:39:21.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021953520000000001 2020-06-12T02:39:21.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.189955+0000", 2020-06-12T02:39:21.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8487999999999996e-05 2020-06-12T02:39:21.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.190053+0000", 2020-06-12T02:39:21.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056440420000000002 2020-06-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195697+0000", 2020-06-12T02:39:21.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109858 2020-06-12T02:39:21.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195807+0000", 2020-06-12T02:39:21.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016443999999999999 2020-06-12T02:39:21.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:35:36.195972+0000", 2020-06-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030809399000000001 2020-06-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:808 1.6s0 1:600984fc:::smithi14213939-13:head [write 2082530~85573] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:21.013 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.54255891700001, 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999, 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 808 2020-06-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366038+0000", 2020-06-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9671000000000002e-05 2020-06-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366138+0000", 2020-06-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.618e-06 2020-06-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366144+0000", 2020-06-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6600000000000007e-06 2020-06-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366154+0000", 2020-06-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3930000000000002e-06 2020-06-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366161+0000", 2020-06-12T02:39:21.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052818099999999996 2020-06-12T02:39:21.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371443+0000", 2020-06-12T02:39:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109626 2020-06-12T02:39:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371553+0000", 2020-06-12T02:39:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021983279000000001 2020-06-12T02:39:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.393536+0000", 2020-06-12T02:39:21.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024564629999999999 2020-06-12T02:39:21.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.395993+0000", 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006828677 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.402821+0000", 2020-06-12T02:39:21.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018027200000000001 2020-06-12T02:39:21.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.403001+0000", 2020-06-12T02:39:21.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.036963468999999999 2020-06-12T02:39:21.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.029 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.030 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:809 1.6s0 1:600984fc:::smithi14213939-13:head [setxattr _header (57) in=7b,truncate 2168103] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:21.030 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.542399104, 2020-06-12T02:39:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998, 2020-06-12T02:39:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.031 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 809 2020-06-12T02:39:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.032 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366198+0000", 2020-06-12T02:39:21.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2857e-05 2020-06-12T02:39:21.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366241+0000", 2020-06-12T02:39:21.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1949999999999996e-06 2020-06-12T02:39:21.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366245+0000", 2020-06-12T02:39:21.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8650000000000003e-06 2020-06-12T02:39:21.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366252+0000", 2020-06-12T02:39:21.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0539999999999999e-06 2020-06-12T02:39:21.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366255+0000", 2020-06-12T02:39:21.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055839069999999999 2020-06-12T02:39:21.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371839+0000", 2020-06-12T02:39:21.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1732999999999997e-05 2020-06-12T02:39:21.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371930+0000", 2020-06-12T02:39:21.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022966245999999999 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.394897+0000", 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001836956 2020-06-12T02:39:21.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.396734+0000", 2020-06-12T02:39:21.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081190280000000004 2020-06-12T02:39:21.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404853+0000", 2020-06-12T02:39:21.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143504 2020-06-12T02:39:21.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.404996+0000", 2020-06-12T02:39:21.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.038798344999999998 2020-06-12T02:39:21.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.045 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.046 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:810 1.6s0 1:600984fc:::smithi14213939-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:21.046 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:21.046 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.54231839100001, 2020-06-12T02:39:21.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997, 2020-06-12T02:39:21.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.047 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.047 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.047 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.047 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.047 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 810 2020-06-12T02:39:21.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.048 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:21.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366279+0000", 2020-06-12T02:39:21.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4041000000000002e-05 2020-06-12T02:39:21.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366313+0000", 2020-06-12T02:39:21.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6179999999999999e-06 2020-06-12T02:39:21.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366316+0000", 2020-06-12T02:39:21.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5449999999999998e-06 2020-06-12T02:39:21.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366324+0000", 2020-06-12T02:39:21.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9239999999999999e-06 2020-06-12T02:39:21.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366327+0000", 2020-06-12T02:39:21.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059365829999999996 2020-06-12T02:39:21.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372263+0000", 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015181099999999999 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.372415+0000", 2020-06-12T02:39:21.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033282849000000003 2020-06-12T02:39:21.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:21.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013339499999999999 2020-06-12T02:39:21.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405831+0000", 2020-06-12T02:39:21.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023548979999999998 2020-06-12T02:39:21.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.408186+0000", 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.041907663999999997 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.061 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:813 1.1s0 1:82c302db:::smithi14213939-48:head [read 0~3949612,checksum] snapc 0=[] ondisk+read+known_if_redirected e68)", 2020-06-12T02:39:21.061 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:21.062 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.542071838, 2020-06-12T02:39:21.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001, 2020-06-12T02:39:21.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 813 2020-06-12T02:39:21.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366525+0000", 2020-06-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8081999999999997e-05 2020-06-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366583+0000", 2020-06-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4490000000000002e-06 2020-06-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366591+0000", 2020-06-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2568000000000001e-05 2020-06-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366603+0000", 2020-06-12T02:39:21.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2536e-05 2020-06-12T02:39:21.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.366616+0000", 2020-06-12T02:39:21.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047306249999999996 2020-06-12T02:39:21.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371346+0000", 2020-06-12T02:39:21.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132395 2020-06-12T02:39:21.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.371479+0000", 2020-06-12T02:39:21.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029199638999999999 2020-06-12T02:39:21.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.400678+0000", 2020-06-12T02:39:21.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.034153294000000001 2020-06-12T02:39:21.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.076 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:817 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:21.076 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:21.076 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.528721515, 2020-06-12T02:39:21.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999, 2020-06-12T02:39:21.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.078 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 817 2020-06-12T02:39:21.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.078 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:21.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379875+0000", 2020-06-12T02:39:21.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2732999999999997e-05 2020-06-12T02:39:21.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379938+0000", 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7450000000000001e-06 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379947+0000", 2020-06-12T02:39:21.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1788000000000001e-05 2020-06-12T02:39:21.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379979+0000", 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6800000000000004e-06 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.379985+0000", 2020-06-12T02:39:21.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053633919999999998 2020-06-12T02:39:21.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385349+0000", 2020-06-12T02:39:21.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016212999999999999 2020-06-12T02:39:21.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.385511+0000", 2020-06-12T02:39:21.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020187277999999999 2020-06-12T02:39:21.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.405698+0000", 2020-06-12T02:39:21.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000543119 2020-06-12T02:39:21.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.406241+0000", 2020-06-12T02:39:21.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040345390000000002 2020-06-12T02:39:21.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.410276+0000", 2020-06-12T02:39:21.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030400403999999999 2020-06-12T02:39:21.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:818 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [copy-from ver 42] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.528535261, 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002, 2020-06-12T02:39:21.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.093 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.093 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.093 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 818 2020-06-12T02:39:21.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.094 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:21.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380062+0000", 2020-06-12T02:39:21.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102439 2020-06-12T02:39:21.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380164+0000", 2020-06-12T02:39:21.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.081e-06 2020-06-12T02:39:21.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380173+0000", 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6518e-05 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380190+0000", 2020-06-12T02:39:21.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3119999999999999e-06 2020-06-12T02:39:21.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380196+0000", 2020-06-12T02:39:21.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013892700000000001 2020-06-12T02:39:21.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380335+0000", 2020-06-12T02:39:21.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000164749 2020-06-12T02:39:21.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380500+0000", 2020-06-12T02:39:21.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.037922617999999998 2020-06-12T02:39:21.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.418422+0000", 2020-06-12T02:39:21.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096838930000000007 2020-06-12T02:39:21.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.428106+0000", 2020-06-12T02:39:21.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039963139999999999 2020-06-12T02:39:21.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432103+0000", 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013584400000000001 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.432238+0000", 2020-06-12T02:39:21.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.052176695000000002 2020-06-12T02:39:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.110 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:819 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:21.110 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:21.110 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 185.52833455000001, 2020-06-12T02:39:21.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002, 2020-06-12T02:39:21.110 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.111 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.111 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.111 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.111 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.111 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 819 2020-06-12T02:39:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:21.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380262+0000", 2020-06-12T02:39:21.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3167e-05 2020-06-12T02:39:21.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380326+0000", 2020-06-12T02:39:21.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7649999999999999e-06 2020-06-12T02:39:21.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380334+0000", 2020-06-12T02:39:21.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6855e-05 2020-06-12T02:39:21.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380351+0000", 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3240000000000003e-06 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380359+0000", 2020-06-12T02:39:21.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00056800600000000002 2020-06-12T02:39:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.380928+0000", 2020-06-12T02:39:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7509999999999994e-05 2020-06-12T02:39:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.381015+0000", 2020-06-12T02:39:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.044405274000000002 2020-06-12T02:39:21.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425420+0000", 2020-06-12T02:39:21.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014233299999999999 2020-06-12T02:39:21.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.425563+0000", 2020-06-12T02:39:21.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077830410000000001 2020-06-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433346+0000", 2020-06-12T02:39:21.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013442099999999999 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433480+0000", 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012306200000000001 2020-06-12T02:39:21.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:15.433603+0000", 2020-06-12T02:39:21.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.053340758000000002 2020-06-12T02:39:21.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.125 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.125 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:21.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:21.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.93584658899999, 2020-06-12T02:39:21.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003, 2020-06-12T02:39:21.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.126 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.127 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:21.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.128 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:21.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.972750+0000", 2020-06-12T02:39:21.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027677099999999998 2020-06-12T02:39:21.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973027+0000", 2020-06-12T02:39:21.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7249999999999997e-06 2020-06-12T02:39:21.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973035+0000", 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7810999999999999e-05 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973093+0000", 2020-06-12T02:39:21.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2459999999999992e-06 2020-06-12T02:39:21.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973102+0000", 2020-06-12T02:39:21.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9914999999999998e-05 2020-06-12T02:39:21.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973162+0000", 2020-06-12T02:39:21.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016125499999999999 2020-06-12T02:39:21.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973323+0000", 2020-06-12T02:39:21.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.026797636999999999 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.000121+0000", 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033145169999999999 2020-06-12T02:39:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.003435+0000", 2020-06-12T02:39:21.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001526716 2020-06-12T02:39:21.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004962+0000", 2020-06-12T02:39:21.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017430500000000001 2020-06-12T02:39:21.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.005136+0000", 2020-06-12T02:39:21.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032385898000000003 2020-06-12T02:39:21.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.143 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] ondisk+write+known_if_redirected e73)", 2020-06-12T02:39:21.144 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:21.144 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.93542284200001, 2020-06-12T02:39:21.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997, 2020-06-12T02:39:21.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.146 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.147 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.147 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:21.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:21.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973174+0000", 2020-06-12T02:39:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1015999999999999e-05 2020-06-12T02:39:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973245+0000", 2020-06-12T02:39:21.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9539999999999993e-06 2020-06-12T02:39:21.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973254+0000", 2020-06-12T02:39:21.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2926e-05 2020-06-12T02:39:21.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973267+0000", 2020-06-12T02:39:21.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:21.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973274+0000", 2020-06-12T02:39:21.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00046205399999999999 2020-06-12T02:39:21.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973736+0000", 2020-06-12T02:39:21.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113294 2020-06-12T02:39:21.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973849+0000", 2020-06-12T02:39:21.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028688556 2020-06-12T02:39:21.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.002538+0000", 2020-06-12T02:39:21.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001934156 2020-06-12T02:39:21.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004472+0000", 2020-06-12T02:39:21.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00157996 2020-06-12T02:39:21.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006052+0000", 2020-06-12T02:39:21.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015556000000000001 2020-06-12T02:39:21.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006207+0000", 2020-06-12T02:39:21.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.033033361999999997 2020-06-12T02:39:21.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.171 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:21.171 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:21.171 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.935268984, 2020-06-12T02:39:21.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758, 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.172 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:21.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973328+0000", 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2045999999999997e-05 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973370+0000", 2020-06-12T02:39:21.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8140000000000001e-06 2020-06-12T02:39:21.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973378+0000", 2020-06-12T02:39:21.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2578000000000001e-05 2020-06-12T02:39:21.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973390+0000", 2020-06-12T02:39:21.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4859999999999999e-06 2020-06-12T02:39:21.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.973395+0000", 2020-06-12T02:39:21.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072332799999999997 2020-06-12T02:39:21.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974118+0000", 2020-06-12T02:39:21.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010343700000000001 2020-06-12T02:39:21.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.974222+0000", 2020-06-12T02:39:21.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.032570149999999999 2020-06-12T02:39:21.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006792+0000", 2020-06-12T02:39:21.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1960999999999999e-05 2020-06-12T02:39:21.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006804+0000", 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0334758 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.185 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:924 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [write 1527054~766050] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:21.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:21.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.932538196, 2020-06-12T02:39:21.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001, 2020-06-12T02:39:21.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.186 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:21.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.186 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 924 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:21.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976059+0000", 2020-06-12T02:39:21.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036316899999999999 2020-06-12T02:39:21.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976422+0000", 2020-06-12T02:39:21.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3619999999999997e-06 2020-06-12T02:39:21.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976427+0000", 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1501999999999999e-05 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976439+0000", 2020-06-12T02:39:21.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2399999999999998e-06 2020-06-12T02:39:21.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976444+0000", 2020-06-12T02:39:21.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7367999999999999e-05 2020-06-12T02:39:21.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976481+0000", 2020-06-12T02:39:21.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8480999999999998e-05 2020-06-12T02:39:21.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976540+0000", 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028454790000000001 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.004995+0000", 2020-06-12T02:39:21.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028935912000000001 2020-06-12T02:39:21.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:925 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [setxattr _header (57) in=7b,truncate 2420208] snapc 34=[34,32,30,24,23,1e,16] RETRY=2 ondisk+retry+write+known_if_redirected e73)", 2020-06-12T02:39:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.932117869, 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999, 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "delayed", 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.198 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.199 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.199 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 925 2020-06-12T02:39:21.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.199 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:21.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976479+0000", 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5234000000000001e-05 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976524+0000", 2020-06-12T02:39:21.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000004e-06 2020-06-12T02:39:21.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976530+0000", 2020-06-12T02:39:21.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4950000000000008e-06 2020-06-12T02:39:21.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976538+0000", 2020-06-12T02:39:21.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3110000000000002e-06 2020-06-12T02:39:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976545+0000", 2020-06-12T02:39:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3468999999999998e-05 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976568+0000", 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0772000000000001e-05 2020-06-12T02:39:21.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for ondisk", 2020-06-12T02:39:21.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976619+0000", 2020-06-12T02:39:21.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029457727 2020-06-12T02:39:21.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006076+0000", 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.029597413999999999 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.208 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:926 1.fs0 1:fc5ea2d2:::smithi14213939-41:head [read 0~1] snapc 0=[] RETRY=2 ondisk+retry+read+rwordered+known_if_redirected e73)", 2020-06-12T02:39:21.209 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:21.210 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 180.932023036, 2020-06-12T02:39:21.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998, 2020-06-12T02:39:21.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.211 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 926 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:21.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976574+0000", 2020-06-12T02:39:21.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6665e-05 2020-06-12T02:39:21.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976601+0000", 2020-06-12T02:39:21.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4539999999999999e-06 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976604+0000", 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0061000000000001e-05 2020-06-12T02:39:21.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976614+0000", 2020-06-12T02:39:21.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9560000000000002e-06 2020-06-12T02:39:21.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976617+0000", 2020-06-12T02:39:21.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2503000000000001e-05 2020-06-12T02:39:21.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976640+0000", 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4966000000000001e-05 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:19.976705+0000", 2020-06-12T02:39:21.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030136690000000001 2020-06-12T02:39:21.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006841+0000", 2020-06-12T02:39:21.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2751999999999996e-05 2020-06-12T02:39:21.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.006934+0000", 2020-06-12T02:39:21.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012099719999999999 2020-06-12T02:39:21.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:20.008144+0000", 2020-06-12T02:39:21.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.031570018999999998 2020-06-12T02:39:21.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.224 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:998 1.9s0 1:92300f98:::smithi14213939-7:head [write 1770967~531722] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:21.224 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:21.225 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.90224368200001, 2020-06-12T02:39:21.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001, 2020-06-12T02:39:21.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.225 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.226 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.226 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.226 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 998 2020-06-12T02:39:21.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006353+0000", 2020-06-12T02:39:21.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035953999999999999 2020-06-12T02:39:21.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006713+0000", 2020-06-12T02:39:21.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1252e-05 2020-06-12T02:39:21.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006724+0000", 2020-06-12T02:39:21.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7578999999999999e-05 2020-06-12T02:39:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006742+0000", 2020-06-12T02:39:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2020-06-12T02:39:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006749+0000", 2020-06-12T02:39:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020849099999999999 2020-06-12T02:39:21.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006958+0000", 2020-06-12T02:39:21.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014531799999999999 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007103+0000", 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017405262000000001 2020-06-12T02:39:21.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024508+0000", 2020-06-12T02:39:21.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001382 2020-06-12T02:39:21.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.024647+0000", 2020-06-12T02:39:21.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040678019999999997 2020-06-12T02:39:21.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.028714+0000", 2020-06-12T02:39:21.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041407659999999997 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032855+0000", 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002213656 2020-06-12T02:39:21.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035069+0000", 2020-06-12T02:39:21.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5469e-05 2020-06-12T02:39:21.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035124+0000", 2020-06-12T02:39:21.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028771079000000001 2020-06-12T02:39:21.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.241 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:999 1.9s0 1:92300f98:::smithi14213939-7:head [setxattr _header (56) in=7b,truncate 2638699] snapc 35=[35,34,32,24,16] ondisk+write+known_if_redirected e77)", 2020-06-12T02:39:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.90177806899999, 2020-06-12T02:39:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001, 2020-06-12T02:39:21.242 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.243 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 999 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:21.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006819+0000", 2020-06-12T02:39:21.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0990999999999998e-05 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006900+0000", 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3610000000000003e-06 2020-06-12T02:39:21.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006907+0000", 2020-06-12T02:39:21.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3287e-05 2020-06-12T02:39:21.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006921+0000", 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4249999999999997e-06 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006926+0000", 2020-06-12T02:39:21.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000220781 2020-06-12T02:39:21.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007147+0000", 2020-06-12T02:39:21.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111759 2020-06-12T02:39:21.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007258+0000", 2020-06-12T02:39:21.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017784563 2020-06-12T02:39:21.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025043+0000", 2020-06-12T02:39:21.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011854900000000001 2020-06-12T02:39:21.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.025162+0000", 2020-06-12T02:39:21.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051589269999999998 2020-06-12T02:39:21.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.030321+0000", 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025376169999999998 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.032858+0000", 2020-06-12T02:39:21.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024623589999999999 2020-06-12T02:39:21.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035320+0000", 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144652 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.035465+0000", 2020-06-12T02:39:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.028646271000000001 2020-06-12T02:39:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4555.0:1000 1.9s0 1:92300f98:::smithi14213939-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e77)", 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 176.901604134, 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999, 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2020-06-12T02:39:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2020-06-12T02:39:21.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4555", 2020-06-12T02:39:21.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1000 2020-06-12T02:39:21.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2020-06-12T02:39:21.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2020-06-12T02:39:21.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:21.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2020-06-12T02:39:21.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2020-06-12T02:39:21.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.006993+0000", 2020-06-12T02:39:21.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7942999999999997e-05 2020-06-12T02:39:21.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2020-06-12T02:39:21.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007051+0000", 2020-06-12T02:39:21.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0319999999999998e-06 2020-06-12T02:39:21.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2020-06-12T02:39:21.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007058+0000", 2020-06-12T02:39:21.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5153e-05 2020-06-12T02:39:21.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2020-06-12T02:39:21.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007073+0000", 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.007078+0000", 2020-06-12T02:39:21.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084402130000000002 2020-06-12T02:39:21.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015519+0000", 2020-06-12T02:39:21.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012890500000000001 2020-06-12T02:39:21.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.015647+0000", 2020-06-12T02:39:21.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010385861999999999 2020-06-12T02:39:21.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026033+0000", 2020-06-12T02:39:21.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424700000000001 2020-06-12T02:39:21.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.026148+0000", 2020-06-12T02:39:21.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098763159999999996 2020-06-12T02:39:21.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2020-06-12T02:39:21.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036024+0000", 2020-06-12T02:39:21.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000120361 2020-06-12T02:39:21.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2020-06-12T02:39:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.036144+0000", 2020-06-12T02:39:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001027196 2020-06-12T02:39:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2020-06-12T02:39:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2020-06-12T02:39:21.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2020-06-12T02:39:21.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2020-06-12T02:36:24.037171+0000", 2020-06-12T02:39:21.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.030178680999999999 2020-06-12T02:39:21.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.275 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.275 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.275 INFO:teuthology.orchestra.run.smithi142.stdout: } 2020-06-12T02:39:21.275 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2020-06-12T02:39:21.276 INFO:teuthology.orchestra.run.smithi142.stdout:} 2020-06-12T02:39:21.277 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-06-12T02:39:21.278 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:21.274+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:21.390 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:21.378+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:21.394 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:21.395 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:21.395 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:21.405 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-06-12T02:39:21.480 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:21.477+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:21.514 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:21.515 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:21.515 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:21.524 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-06-12T02:39:21.615 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:21.613+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:21.682 INFO:tasks.ceph.osd.6.smithi117.stderr:2020-06-12T02:39:21.677+0000 7f413de24700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12014) UID: 0 2020-06-12T02:39:21.684 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:21.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:226 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 473964~611066] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 230.54920788300001, 2020-06-12T02:39:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333, 2020-06-12T02:39:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.687 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 226 2020-06-12T02:39:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.688 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.132797+0000", 2020-06-12T02:39:21.689 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001167001 2020-06-12T02:39:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133964+0000", 2020-06-12T02:39:21.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.0009e-05 2020-06-12T02:39:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.133994+0000", 2020-06-12T02:39:21.691 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8496e-05 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134022+0000", 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6058000000000001e-05 2020-06-12T02:39:21.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134038+0000", 2020-06-12T02:39:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000100357 2020-06-12T02:39:21.693 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134139+0000", 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7357e-05 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.134156+0000", 2020-06-12T02:39:21.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0028407089999999999 2020-06-12T02:39:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.136997+0000", 2020-06-12T02:39:21.696 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013428600000000001 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.137131+0000", 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003482045 2020-06-12T02:39:21.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.140613+0000", 2020-06-12T02:39:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053065899999999999 2020-06-12T02:39:21.698 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145920+0000", 2020-06-12T02:39:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.1223000000000005e-05 2020-06-12T02:39:21.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146001+0000", 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00090920200000000001 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146910+0000", 2020-06-12T02:39:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014113333 2020-06-12T02:39:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.701 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:227 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 1826593~546335] snapc 4=[4,3,2] RETRY=1 ondisk+retry+write+known_if_redirected e24)", 2020-06-12T02:39:21.702 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 230.53831650199999, 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001, 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.703 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 227 2020-06-12T02:39:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.143688+0000", 2020-06-12T02:39:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00050109299999999998 2020-06-12T02:39:21.706 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144189+0000", 2020-06-12T02:39:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3475000000000001e-05 2020-06-12T02:39:21.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144203+0000", 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2373000000000002e-05 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.708 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144245+0000", 2020-06-12T02:39:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9091000000000001e-05 2020-06-12T02:39:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144264+0000", 2020-06-12T02:39:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011052000000000001 2020-06-12T02:39:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.710 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144375+0000", 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140288 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144515+0000", 2020-06-12T02:39:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0096437650000000003 2020-06-12T02:39:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.154159+0000", 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041975049999999998 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158356+0000", 2020-06-12T02:39:21.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011357999999999999 2020-06-12T02:39:21.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.714 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158470+0000", 2020-06-12T02:39:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000113349 2020-06-12T02:39:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158583+0000", 2020-06-12T02:39:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014895039000000001 2020-06-12T02:39:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.716 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:228 1.bs0 1:d9ff502f:::smithi14213939-10:head [write 2778819~95145] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:21.717 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 230.53718445800001, 2020-06-12T02:39:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001, 2020-06-12T02:39:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.718 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 228 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144820+0000", 2020-06-12T02:39:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015599799999999999 2020-06-12T02:39:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144976+0000", 2020-06-12T02:39:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0805000000000001e-05 2020-06-12T02:39:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.722 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.144987+0000", 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6895e-05 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.723 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145004+0000", 2020-06-12T02:39:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0467e-05 2020-06-12T02:39:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.724 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145015+0000", 2020-06-12T02:39:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9292999999999998e-05 2020-06-12T02:39:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145054+0000", 2020-06-12T02:39:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010899 2020-06-12T02:39:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145163+0000", 2020-06-12T02:39:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010918964999999999 2020-06-12T02:39:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156082+0000", 2020-06-12T02:39:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0022760499999999999 2020-06-12T02:39:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.158358+0000", 2020-06-12T02:39:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013271719999999999 2020-06-12T02:39:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159685+0000", 2020-06-12T02:39:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1129000000000003e-05 2020-06-12T02:39:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159756+0000", 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014935764000000001 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.731 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:229 1.bs0 1:d9ff502f:::smithi14213939-10:head [setxattr _header (56) in=7b,truncate 2873964] snapc 4=[4,3,2] ondisk+write+known_if_redirected e24)", 2020-06-12T02:39:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:21.732 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 230.536929273, 2020-06-12T02:39:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677, 2020-06-12T02:39:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.733 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.734 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 229 2020-06-12T02:39:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.735 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.736 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145076+0000", 2020-06-12T02:39:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3373000000000004e-05 2020-06-12T02:39:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145149+0000", 2020-06-12T02:39:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0820000000000004e-06 2020-06-12T02:39:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.738 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145155+0000", 2020-06-12T02:39:21.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0519999999999999e-05 2020-06-12T02:39:21.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145166+0000", 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.2719999999999999e-06 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145170+0000", 2020-06-12T02:39:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000316459 2020-06-12T02:39:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145486+0000", 2020-06-12T02:39:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012217400000000001 2020-06-12T02:39:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145608+0000", 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012071838 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.157680+0000", 2020-06-12T02:39:21.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001323439 2020-06-12T02:39:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.159004+0000", 2020-06-12T02:39:21.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001146174 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160150+0000", 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2439000000000002e-05 2020-06-12T02:39:21.745 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160222+0000", 2020-06-12T02:39:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01514677 2020-06-12T02:39:21.746 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.747 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:230 1.bs0 1:d9ff502f:::smithi14213939-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e24)", 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 230.53677008599999, 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002, 2020-06-12T02:39:21.748 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.749 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 230 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:21.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145235+0000", 2020-06-12T02:39:21.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9777000000000002e-05 2020-06-12T02:39:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145274+0000", 2020-06-12T02:39:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9460000000000004e-06 2020-06-12T02:39:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145283+0000", 2020-06-12T02:39:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1314999999999999e-05 2020-06-12T02:39:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145295+0000", 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4850000000000003e-06 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145299+0000", 2020-06-12T02:39:21.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001689872 2020-06-12T02:39:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.146989+0000", 2020-06-12T02:39:21.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010479 2020-06-12T02:39:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.147094+0000", 2020-06-12T02:39:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013631476 2020-06-12T02:39:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.758 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160725+0000", 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00015887599999999999 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.759 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.160884+0000", 2020-06-12T02:39:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0011730270000000001 2020-06-12T02:39:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.760 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.162057+0000", 2020-06-12T02:39:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.016822564000000002 2020-06-12T02:39:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.761 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:326 1.3s0 1:cc54bbdc:::smithi14213939-16:head [sparse-read 0~2252105] snapc 0=[] ondisk+read+known_if_redirected e29)", 2020-06-12T02:39:21.762 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 225.392447508, 2020-06-12T02:39:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469, 2020-06-12T02:39:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.763 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 326 2020-06-12T02:39:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.764 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:21.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289557+0000", 2020-06-12T02:39:21.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2872000000000004e-05 2020-06-12T02:39:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289620+0000", 2020-06-12T02:39:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9609999999999994e-06 2020-06-12T02:39:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289629+0000", 2020-06-12T02:39:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6345e-05 2020-06-12T02:39:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289645+0000", 2020-06-12T02:39:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.2899999999999997e-06 2020-06-12T02:39:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.770 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.289653+0000", 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095259200000000004 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290605+0000", 2020-06-12T02:39:21.771 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013045099999999999 2020-06-12T02:39:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.290736+0000", 2020-06-12T02:39:21.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012116178999999999 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.302852+0000", 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01329469 2020-06-12T02:39:21.773 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.779 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:604 1.bs0 1:d6659338:::smithi14213939-43:head [write 1876518~654358] snapc 21=[21,1f,1e,1d,16,13] ondisk+write+known_if_redirected e53)", 2020-06-12T02:39:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 201.65137801099999, 2020-06-12T02:39:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001, 2020-06-12T02:39:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.780 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 604 2020-06-12T02:39:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.030627+0000", 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00092382100000000002 2020-06-12T02:39:21.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031551+0000", 2020-06-12T02:39:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0515e-05 2020-06-12T02:39:21.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031561+0000", 2020-06-12T02:39:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1124e-05 2020-06-12T02:39:21.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031582+0000", 2020-06-12T02:39:21.786 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4167e-05 2020-06-12T02:39:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.787 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031596+0000", 2020-06-12T02:39:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.8380999999999994e-05 2020-06-12T02:39:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031675+0000", 2020-06-12T02:39:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017953000000000001 2020-06-12T02:39:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.789 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.790 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.031854+0000", 2020-06-12T02:39:21.790 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012846369999999999 2020-06-12T02:39:21.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.790 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.791 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.791 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033139+0000", 2020-06-12T02:39:21.791 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000216178 2020-06-12T02:39:21.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.791 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.792 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.792 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.033355+0000", 2020-06-12T02:39:21.792 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034767259999999999 2020-06-12T02:39:21.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.792 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.036832+0000", 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.005032974 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.793 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.794 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.041865+0000", 2020-06-12T02:39:21.794 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002047409 2020-06-12T02:39:21.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.794 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.794 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.043912+0000", 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00033924999999999998 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.795 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:00.044252+0000", 2020-06-12T02:39:21.796 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013624712000000001 2020-06-12T02:39:21.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.796 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.796 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.797 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.797 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:656 1.3s0 1:cc54bbdc:::smithi14213939-16:head [stat,delete] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:21.797 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:21.797 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 197.71367561, 2020-06-12T02:39:21.797 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001, 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.798 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 656 2020-06-12T02:39:21.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.799 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.799 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.799 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.799 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:21.800 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.800 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.800 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.800 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968329+0000", 2020-06-12T02:39:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000150855 2020-06-12T02:39:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.801 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.802 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968480+0000", 2020-06-12T02:39:21.802 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3394e-05 2020-06-12T02:39:21.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.802 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.802 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.803 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968503+0000", 2020-06-12T02:39:21.803 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.9657999999999997e-05 2020-06-12T02:39:21.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.803 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.803 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968563+0000", 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0579000000000001e-05 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.804 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.968584+0000", 2020-06-12T02:39:21.805 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00053584399999999995 2020-06-12T02:39:21.805 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.805 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.805 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.805 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969120+0000", 2020-06-12T02:39:21.806 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4165999999999999e-05 2020-06-12T02:39:21.806 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.806 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.806 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:21.806 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969144+0000", 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0046020920000000003 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.973746+0000", 2020-06-12T02:39:21.807 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00031458300000000001 2020-06-12T02:39:21.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.808 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.808 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.808 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974060+0000", 2020-06-12T02:39:21.808 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020531460000000001 2020-06-12T02:39:21.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.809 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.809 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.809 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.976114+0000", 2020-06-12T02:39:21.809 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027358410000000001 2020-06-12T02:39:21.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.810 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.810 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.810 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.978849+0000", 2020-06-12T02:39:21.811 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036879360000000002 2020-06-12T02:39:21.811 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.811 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.811 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.811 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982537+0000", 2020-06-12T02:39:21.812 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012785800000000001 2020-06-12T02:39:21.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.813 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.813 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.813 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.982665+0000", 2020-06-12T02:39:21.813 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014335952000000001 2020-06-12T02:39:21.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.814 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.814 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.814 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:670 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:21.815 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:21.815 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.73179952999999, 2020-06-12T02:39:21.815 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447, 2020-06-12T02:39:21.815 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.815 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 670 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.816 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.817 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.817 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.817 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:21.817 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.817 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.818 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.818 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.818 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950205+0000", 2020-06-12T02:39:21.818 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5989000000000006e-05 2020-06-12T02:39:21.818 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950291+0000", 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0624e-05 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.819 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.820 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.820 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950302+0000", 2020-06-12T02:39:21.820 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7975999999999999e-05 2020-06-12T02:39:21.820 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.820 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.821 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.821 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950320+0000", 2020-06-12T02:39:21.821 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6920000000000008e-06 2020-06-12T02:39:21.822 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.822 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.822 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.822 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950329+0000", 2020-06-12T02:39:21.822 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8781000000000004e-05 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950397+0000", 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2696e-05 2020-06-12T02:39:21.823 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.824 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.824 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:21.824 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950410+0000", 2020-06-12T02:39:21.824 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049647989999999998 2020-06-12T02:39:21.824 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.825 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.825 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.825 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955375+0000", 2020-06-12T02:39:21.825 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012431700000000001 2020-06-12T02:39:21.825 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.955499+0000", 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018200595999999999 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.827 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.827 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973700+0000", 2020-06-12T02:39:21.827 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.02349447 2020-06-12T02:39:21.827 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.827 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:671 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:21.828 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.73160621400001, 2020-06-12T02:39:21.829 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425, 2020-06-12T02:39:21.829 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.829 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.829 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.829 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.830 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.830 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 671 2020-06-12T02:39:21.830 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.830 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.830 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.831 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.831 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:21.831 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.831 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.832 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.832 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.832 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950399+0000", 2020-06-12T02:39:21.832 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4348e-05 2020-06-12T02:39:21.832 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.833 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.833 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.833 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950473+0000", 2020-06-12T02:39:21.833 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0289999999999996e-06 2020-06-12T02:39:21.833 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.834 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.834 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.834 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950478+0000", 2020-06-12T02:39:21.834 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.0530000000000007e-06 2020-06-12T02:39:21.834 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950486+0000", 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9020000000000001e-06 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.835 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.836 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.836 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950490+0000", 2020-06-12T02:39:21.836 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2015000000000003e-05 2020-06-12T02:39:21.836 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.836 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950542+0000", 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0910000000000001e-05 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.837 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:21.838 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950553+0000", 2020-06-12T02:39:21.838 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0058035459999999997 2020-06-12T02:39:21.838 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.838 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.838 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956356+0000", 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0175999999999999e-05 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.839 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956447+0000", 2020-06-12T02:39:21.840 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020087445999999998 2020-06-12T02:39:21.840 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.840 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.840 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.840 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976534+0000", 2020-06-12T02:39:21.841 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026135425 2020-06-12T02:39:21.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.841 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.841 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.842 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.842 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.842 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:672 1.3s0 1:cf654cd5:::smithi14213939-2:head [read 0~2890771,checksum] snapc 0=[] ondisk+read+known_if_redirected e59)", 2020-06-12T02:39:21.843 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:21.843 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.73145775899999, 2020-06-12T02:39:21.843 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001, 2020-06-12T02:39:21.844 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.844 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.844 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.845 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.845 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 672 2020-06-12T02:39:21.845 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.846 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.846 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.846 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.847 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:21.847 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.847 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.848 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.848 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.848 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950547+0000", 2020-06-12T02:39:21.848 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1313999999999997e-05 2020-06-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950598+0000", 2020-06-12T02:39:21.849 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1427e-05 2020-06-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950620+0000", 2020-06-12T02:39:21.850 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4959e-05 2020-06-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950635+0000", 2020-06-12T02:39:21.851 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7419999999999992e-06 2020-06-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.852 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950644+0000", 2020-06-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.0506000000000004e-05 2020-06-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.853 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950735+0000", 2020-06-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.8677000000000001e-05 2020-06-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.854 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.950754+0000", 2020-06-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0061902720000000001 2020-06-12T02:39:21.855 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.956944+0000", 2020-06-12T02:39:21.856 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2361999999999997e-05 2020-06-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957006+0000", 2020-06-12T02:39:21.857 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021044061999999999 2020-06-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.858 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.978050+0000", 2020-06-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.027503321000000001 2020-06-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpReadReply(1.3s0 59/51 ECSubReadReply(tid=169, attrs_read=0))", 2020-06-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:21.860 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.72402480900001, 2020-06-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607, 2020-06-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.861 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.862 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.863 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.957980+0000", 2020-06-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021911200000000001 2020-06-12T02:39:21.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958199+0000", 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3489999999999998e-06 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.958208+0000", 2020-06-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014055563 2020-06-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972264+0000", 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4583000000000002e-05 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.869 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.870 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.972319+0000", 2020-06-12T02:39:21.870 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014338607 2020-06-12T02:39:21.870 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.870 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.870 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=225, reqid=client.4555.0:667, at_version=59'131, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.72161630900001, 2020-06-12T02:39:21.871 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826, 2020-06-12T02:39:21.872 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.872 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.872 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.872 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.873 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.873 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:21.873 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.874 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.874 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960388+0000", 2020-06-12T02:39:21.874 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7525999999999998e-05 2020-06-12T02:39:21.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.875 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.875 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960446+0000", 2020-06-12T02:39:21.875 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5794000000000001e-05 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960472+0000", 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6901e-05 2020-06-12T02:39:21.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.877 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.877 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960489+0000", 2020-06-12T02:39:21.877 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8170000000000001e-06 2020-06-12T02:39:21.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.960496+0000", 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0035601930000000001 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964056+0000", 2020-06-12T02:39:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5396999999999998e-05 2020-06-12T02:39:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.964071+0000", 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089707810000000006 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.880 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.881 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973042+0000", 2020-06-12T02:39:21.881 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4416999999999998e-05 2020-06-12T02:39:21.881 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.881 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.881 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973096+0000", 2020-06-12T02:39:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012707826 2020-06-12T02:39:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.882 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=226, reqid=client.4555.0:668, at_version=59'132, trim_to=0'0, roll_forward_to=55'125))", 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.71958916400001, 2020-06-12T02:39:21.883 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268, 2020-06-12T02:39:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.884 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.885 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962416+0000", 2020-06-12T02:39:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0578000000000002e-05 2020-06-12T02:39:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.886 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962476+0000", 2020-06-12T02:39:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9954000000000002e-05 2020-06-12T02:39:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.887 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962506+0000", 2020-06-12T02:39:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.2966999999999998e-05 2020-06-12T02:39:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.888 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962539+0000", 2020-06-12T02:39:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9500000000000001e-06 2020-06-12T02:39:21.889 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.962547+0000", 2020-06-12T02:39:21.890 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0053905250000000002 2020-06-12T02:39:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967938+0000", 2020-06-12T02:39:21.891 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2150999999999999e-05 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.967950+0000", 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0085354579999999992 2020-06-12T02:39:21.892 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.893 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976485+0000", 2020-06-12T02:39:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7685000000000001e-05 2020-06-12T02:39:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.894 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.976543+0000", 2020-06-12T02:39:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014127268 2020-06-12T02:39:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.895 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 59/54 ECSubWrite(tid=229, reqid=osd.0.0:229, at_version=59'135, trim_to=0'0, roll_forward_to=59'129))", 2020-06-12T02:39:21.896 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:21.897 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 195.708539331, 2020-06-12T02:39:21.897 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815, 2020-06-12T02:39:21.897 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.897 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.897 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.898 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.898 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.898 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:21.898 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.898 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.899 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.899 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.899 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973465+0000", 2020-06-12T02:39:21.899 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.4363000000000001e-05 2020-06-12T02:39:21.899 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973520+0000", 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.9454e-05 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.900 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.901 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.901 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973549+0000", 2020-06-12T02:39:21.901 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0024999999999999e-05 2020-06-12T02:39:21.902 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.902 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.902 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.902 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973569+0000", 2020-06-12T02:39:21.902 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8090000000000004e-06 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973576+0000", 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000140753 2020-06-12T02:39:21.903 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.904 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.904 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.904 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973717+0000", 2020-06-12T02:39:21.904 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3908e-05 2020-06-12T02:39:21.904 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.905 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.905 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.905 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.973731+0000", 2020-06-12T02:39:21.905 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012274276000000001 2020-06-12T02:39:21.905 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986005+0000", 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3227e-05 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.906 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.907 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.907 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:05.986028+0000", 2020-06-12T02:39:21.907 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012562815 2020-06-12T02:39:21.907 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.907 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.908 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.908 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.908 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.908 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:780 1.3s0 1:ccce62eb:::smithi14213939-25:head [copy-from ver 14] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:21.908 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:21.909 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.70432631400001, 2020-06-12T02:39:21.909 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003, 2020-06-12T02:39:21.909 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.910 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.910 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.910 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.910 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.910 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 780 2020-06-12T02:39:21.911 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.911 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.911 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.911 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.912 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977678+0000", 2020-06-12T02:39:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.5221000000000003e-05 2020-06-12T02:39:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.913 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977764+0000", 2020-06-12T02:39:21.914 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.9520000000000006e-06 2020-06-12T02:39:21.914 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.914 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.914 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.915 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977774+0000", 2020-06-12T02:39:21.915 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4329999999999999e-05 2020-06-12T02:39:21.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.915 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.916 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.916 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977798+0000", 2020-06-12T02:39:21.916 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9209999999999992e-06 2020-06-12T02:39:21.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.916 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.917 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.917 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977806+0000", 2020-06-12T02:39:21.917 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.0995999999999997e-05 2020-06-12T02:39:21.917 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.918 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.918 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.918 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977867+0000", 2020-06-12T02:39:21.918 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013370499999999999 2020-06-12T02:39:21.918 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.919 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.919 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.919 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978001+0000", 2020-06-12T02:39:21.919 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026868889 2020-06-12T02:39:21.920 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.920 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.920 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.920 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.004869+0000", 2020-06-12T02:39:21.920 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095012699999999992 2020-06-12T02:39:21.921 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.921 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.921 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.922 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.014371+0000", 2020-06-12T02:39:21.922 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054221529999999999 2020-06-12T02:39:21.922 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.922 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.923 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.923 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019793+0000", 2020-06-12T02:39:21.923 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3596000000000004e-05 2020-06-12T02:39:21.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.924 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.924 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.924 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019877+0000", 2020-06-12T02:39:21.924 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.042198033000000003 2020-06-12T02:39:21.925 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.925 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.925 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.926 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.926 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:781 1.3s0 1:ccce62eb:::smithi14213939-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:21.927 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:21.927 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.70414311499999, 2020-06-12T02:39:21.927 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001, 2020-06-12T02:39:21.928 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.928 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.928 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.929 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.929 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.929 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 781 2020-06-12T02:39:21.929 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.930 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.930 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.930 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.931 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:21.931 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.932 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.932 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.932 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977862+0000", 2020-06-12T02:39:21.933 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8439999999999997e-05 2020-06-12T02:39:21.933 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.933 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.933 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.933 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977910+0000", 2020-06-12T02:39:21.934 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5899999999999998e-06 2020-06-12T02:39:21.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.934 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.934 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.934 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977916+0000", 2020-06-12T02:39:21.935 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3149999999999998e-06 2020-06-12T02:39:21.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.935 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.935 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.935 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977925+0000", 2020-06-12T02:39:21.936 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5000000000000001e-06 2020-06-12T02:39:21.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.936 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.936 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.936 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977930+0000", 2020-06-12T02:39:21.937 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00052289700000000003 2020-06-12T02:39:21.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.937 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.937 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978452+0000", 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.5878999999999997e-05 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:21.938 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.978518+0000", 2020-06-12T02:39:21.939 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031104733999999998 2020-06-12T02:39:21.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.939 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.939 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.939 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009623+0000", 2020-06-12T02:39:21.940 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112831 2020-06-12T02:39:21.940 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.940 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.940 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.940 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.009736+0000", 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011153902 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020890+0000", 2020-06-12T02:39:21.941 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010168800000000001 2020-06-12T02:39:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.020991+0000", 2020-06-12T02:39:21.942 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012173200000000001 2020-06-12T02:39:21.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.943 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.943 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.943 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.021113+0000", 2020-06-12T02:39:21.943 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.043251508000000001 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.944 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.2s1 68/54 ECSubWrite(tid=265, reqid=client.4555.0:848, at_version=68'155, trim_to=0'0, roll_forward_to=68'153))", 2020-06-12T02:39:21.945 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:21.945 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 186.247225071, 2020-06-12T02:39:21.945 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999, 2020-06-12T02:39:21.945 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.946 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:21.946 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.946 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.946 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.947 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:21.947 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.948 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.948 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.948 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.434780+0000", 2020-06-12T02:39:21.949 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0054188099999999996 2020-06-12T02:39:21.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.949 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.949 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.950 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440199+0000", 2020-06-12T02:39:21.950 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5537e-05 2020-06-12T02:39:21.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.951 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.951 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.951 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440254+0000", 2020-06-12T02:39:21.951 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6018000000000001e-05 2020-06-12T02:39:21.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.952 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.952 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.953 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440280+0000", 2020-06-12T02:39:21.953 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.077e-05 2020-06-12T02:39:21.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.954 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.954 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.954 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440291+0000", 2020-06-12T02:39:21.955 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000103528 2020-06-12T02:39:21.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.955 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.955 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.956 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440394+0000", 2020-06-12T02:39:21.956 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0917e-05 2020-06-12T02:39:21.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.957 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.957 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.957 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.440415+0000", 2020-06-12T02:39:21.958 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010007701000000001 2020-06-12T02:39:21.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.958 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.958 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.958 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450423+0000", 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8306000000000006e-05 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.450491+0000", 2020-06-12T02:39:21.959 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015711586999999999 2020-06-12T02:39:21.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.960 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.960 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.961 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.961 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1035 1.3s0 1:c4e39404:::smithi14213939-12:head [copy-from ver 61] snapc 3e=[3e,3d,3b,3a,35,32,16] ondisk+write+known_if_redirected e83)", 2020-06-12T02:39:21.961 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:21.961 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.716763474, 2020-06-12T02:39:21.961 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999, 2020-06-12T02:39:21.962 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.962 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:21.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.962 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.963 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.963 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1035 2020-06-12T02:39:21.963 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.964 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.964 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.964 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.965 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:21.965 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.965 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.965 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.966 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.966 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965241+0000", 2020-06-12T02:39:21.967 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013113999999999999 2020-06-12T02:39:21.967 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.967 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.967 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.968 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965372+0000", 2020-06-12T02:39:21.968 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3015e-05 2020-06-12T02:39:21.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.968 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.968 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.969 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965385+0000", 2020-06-12T02:39:21.969 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.3475000000000001e-05 2020-06-12T02:39:21.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.969 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.969 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.970 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965409+0000", 2020-06-12T02:39:21.970 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0103e-05 2020-06-12T02:39:21.970 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.970 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.970 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.971 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965419+0000", 2020-06-12T02:39:21.971 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3789999999999995e-05 2020-06-12T02:39:21.971 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.971 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965513+0000", 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000222504 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.972 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.973 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965735+0000", 2020-06-12T02:39:21.973 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019224207 2020-06-12T02:39:21.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.973 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.974 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:21.974 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.984960+0000", 2020-06-12T02:39:21.974 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0027365979999999998 2020-06-12T02:39:21.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.974 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.975 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:21.975 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987696+0000", 2020-06-12T02:39:21.975 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0020096369999999999 2020-06-12T02:39:21.975 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.976 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.976 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:21.976 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989706+0000", 2020-06-12T02:39:21.977 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00010253 2020-06-12T02:39:21.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.977 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.978 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.978 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.989808+0000", 2020-06-12T02:39:21.978 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.024566998999999999 2020-06-12T02:39:21.979 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.979 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.979 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.980 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.980 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.980 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1036 1.3s0 1:c4e39404:::smithi14213939-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e83)", 2020-06-12T02:39:21.980 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:21.980 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 171.71650435500001, 2020-06-12T02:39:21.981 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999, 2020-06-12T02:39:21.981 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:21.981 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:21.981 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:21.981 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:21.982 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:21.982 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1036 2020-06-12T02:39:21.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.982 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:21.982 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.983 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:21.983 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:21.983 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:21.983 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.984 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.984 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:21.984 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965500+0000", 2020-06-12T02:39:21.984 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6893999999999999e-05 2020-06-12T02:39:21.984 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.985 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.985 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:21.985 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965577+0000", 2020-06-12T02:39:21.985 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0888e-05 2020-06-12T02:39:21.986 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.986 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.986 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:21.986 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965588+0000", 2020-06-12T02:39:21.986 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2246999999999999e-05 2020-06-12T02:39:21.987 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.987 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.987 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:21.987 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965610+0000", 2020-06-12T02:39:21.987 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4543e-05 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965625+0000", 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00046629499999999998 2020-06-12T02:39:21.988 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.989 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.989 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.989 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966091+0000", 2020-06-12T02:39:21.990 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011021 2020-06-12T02:39:21.990 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.990 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.990 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966202+0000", 2020-06-12T02:39:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020702989000000002 2020-06-12T02:39:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.991 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.986905+0000", 2020-06-12T02:39:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.5466999999999999e-05 2020-06-12T02:39:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.992 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.987000+0000", 2020-06-12T02:39:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032408200000000002 2020-06-12T02:39:21.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990241+0000", 2020-06-12T02:39:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013136300000000001 2020-06-12T02:39:21.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990372+0000", 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014733699999999999 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:21.995 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.990519+0000", 2020-06-12T02:39:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.025019052999999999 2020-06-12T02:39:21.996 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:21.997 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:21.999 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-06-12T02:39:22.000 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:21.997+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:22.100 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:22.097+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:22.158 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:22.158 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:22.158 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:22.158 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:22.168 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-06-12T02:39:22.196 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-06-12T02:39:22.242 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:22.242+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:22.302 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:22.302+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:22.316 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:22.306+0000 7f67f4179700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:22.321 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:22.318+0000 7f67f2f17700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:22.328 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:22.329 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:22.329 INFO:teuthology.orchestra.run.smithi117.stdout: "complaint_time": 30, 2020-06-12T02:39:22.329 INFO:teuthology.orchestra.run.smithi117.stdout: "num_blocked_ops": 0 2020-06-12T02:39:22.329 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:22.350 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-06-12T02:39:22.403 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:22.402+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:22.463 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:22.464 INFO:teuthology.orchestra.run.smithi117.stdout: "size": 20, 2020-06-12T02:39:22.464 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 600, 2020-06-12T02:39:22.464 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [ 2020-06-12T02:39:22.464 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.464 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.1s1 24/18 ECSubWrite(tid=34, reqid=client.4555.0:221, at_version=24'5, trim_to=0'0, roll_forward_to=21'3))", 2020-06-12T02:39:22.465 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:22.465 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 231.317212987, 2020-06-12T02:39:22.465 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001, 2020-06-12T02:39:22.465 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.465 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:22.466 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.466 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.466 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.466 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:22.466 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.145740+0000", 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043356219999999999 2020-06-12T02:39:22.467 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.468 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.468 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.468 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150075+0000", 2020-06-12T02:39:22.468 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.9014000000000003e-05 2020-06-12T02:39:22.468 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.469 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.469 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.469 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150114+0000", 2020-06-12T02:39:22.469 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.2328999999999999e-05 2020-06-12T02:39:22.469 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.470 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.470 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.470 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150137+0000", 2020-06-12T02:39:22.471 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4470999999999999e-05 2020-06-12T02:39:22.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150151+0000", 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3979999999999994e-05 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.472 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.473 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.473 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150215+0000", 2020-06-12T02:39:22.473 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3300000000000005e-06 2020-06-12T02:39:22.473 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.473 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.474 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.474 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.150225+0000", 2020-06-12T02:39:22.474 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0057479769999999996 2020-06-12T02:39:22.474 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.474 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.475 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.475 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.155973+0000", 2020-06-12T02:39:22.475 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0327999999999995e-05 2020-06-12T02:39:22.475 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.475 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:31.156043+0000", 2020-06-12T02:39:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010303051000000001 2020-06-12T02:39:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 29/18 ECSubWrite(tid=139, reqid=client.4555.0:308, at_version=29'13, trim_to=0'0, roll_forward_to=29'11))", 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:22.477 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 226.17069947600001, 2020-06-12T02:39:22.478 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635, 2020-06-12T02:39:22.478 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.478 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:22.478 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.478 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.479 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.479 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:22.479 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.479 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.479 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.480 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.480 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.292253+0000", 2020-06-12T02:39:22.480 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031185000000000002 2020-06-12T02:39:22.480 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.480 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.481 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.481 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295372+0000", 2020-06-12T02:39:22.481 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.4177999999999994e-05 2020-06-12T02:39:22.481 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.482 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.482 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.482 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295436+0000", 2020-06-12T02:39:22.482 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1554999999999998e-05 2020-06-12T02:39:22.482 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295478+0000", 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.554e-05 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.483 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.484 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.484 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295493+0000", 2020-06-12T02:39:22.484 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6971000000000004e-05 2020-06-12T02:39:22.484 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.485 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.485 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.485 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295590+0000", 2020-06-12T02:39:22.485 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9780999999999999e-05 2020-06-12T02:39:22.485 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.295610+0000", 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0074258070000000004 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.486 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.487 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.488 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303036+0000", 2020-06-12T02:39:22.488 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.4017999999999998e-05 2020-06-12T02:39:22.488 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.488 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.488 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.489 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:35:36.303080+0000", 2020-06-12T02:39:22.489 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01082635 2020-06-12T02:39:22.489 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:648 1.es0 1:7e821f7f:::smithi14213939-44:head [copy-from ver 3] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:22.490 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:22.491 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.493150802, 2020-06-12T02:39:22.491 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998, 2020-06-12T02:39:22.491 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.492 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.492 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.492 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 648 2020-06-12T02:39:22.493 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.493 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.493 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.493 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.493 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:22.494 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.494 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.494 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.494 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.495 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.969802+0000", 2020-06-12T02:39:22.495 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00023142700000000001 2020-06-12T02:39:22.495 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.495 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970033+0000", 2020-06-12T02:39:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4318e-05 2020-06-12T02:39:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.496 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970058+0000", 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.0411999999999998e-05 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.497 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.498 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970108+0000", 2020-06-12T02:39:22.498 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0366000000000001e-05 2020-06-12T02:39:22.498 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.498 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.498 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970128+0000", 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014694999999999999 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.499 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970275+0000", 2020-06-12T02:39:22.500 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.4363000000000003e-05 2020-06-12T02:39:22.500 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.500 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.500 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:22.500 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970310+0000", 2020-06-12T02:39:22.501 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042921219999999998 2020-06-12T02:39:22.501 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.501 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974602+0000", 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00037759799999999999 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.502 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.503 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.974980+0000", 2020-06-12T02:39:22.503 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.019238278000000001 2020-06-12T02:39:22.503 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.503 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.503 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.504 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.994218+0000", 2020-06-12T02:39:22.504 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0037543089999999999 2020-06-12T02:39:22.504 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.504 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.504 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.505 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997972+0000", 2020-06-12T02:39:22.505 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0036599879999999999 2020-06-12T02:39:22.505 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.505 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.505 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.506 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001632+0000", 2020-06-12T02:39:22.506 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120544 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.001753+0000", 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031950674999999998 2020-06-12T02:39:22.507 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:649 1.es0 1:7e821f7f:::smithi14213939-44:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:22.509 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:22.509 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.492386874, 2020-06-12T02:39:22.509 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002, 2020-06-12T02:39:22.509 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.509 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 649 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.510 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.511 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.511 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.511 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:22.511 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.512 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.512 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.512 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.512 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970566+0000", 2020-06-12T02:39:22.512 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000187317 2020-06-12T02:39:22.513 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.513 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.513 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.513 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970753+0000", 2020-06-12T02:39:22.513 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.1378999999999996e-05 2020-06-12T02:39:22.514 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.514 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.514 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.514 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970815+0000", 2020-06-12T02:39:22.514 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.1593e-05 2020-06-12T02:39:22.515 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.515 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.515 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.515 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970856+0000", 2020-06-12T02:39:22.515 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.6008999999999999e-05 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970872+0000", 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000120862 2020-06-12T02:39:22.516 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.517 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.517 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.517 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.970993+0000", 2020-06-12T02:39:22.517 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.5282e-05 2020-06-12T02:39:22.517 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.971018+0000", 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004491999 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.518 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975510+0000", 2020-06-12T02:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016034400000000001 2020-06-12T02:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.519 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.520 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for blocked object", 2020-06-12T02:39:22.520 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.975671+0000", 2020-06-12T02:39:22.520 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.021795175999999999 2020-06-12T02:39:22.520 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.520 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997466+0000", 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000214071 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.521 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:22.522 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:03.997680+0000", 2020-06-12T02:39:22.522 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045505179999999999 2020-06-12T02:39:22.522 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002230+0000", 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.2979000000000005e-05 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.523 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.524 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.524 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002323+0000", 2020-06-12T02:39:22.524 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000114528 2020-06-12T02:39:22.524 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.524 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.525 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.525 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.002438+0000", 2020-06-12T02:39:22.525 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.031872057000000002 2020-06-12T02:39:22.525 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.526 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.526 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.526 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.526 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.526 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:657 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 547928~538485] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:22.527 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:22.527 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.269581819, 2020-06-12T02:39:22.527 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007, 2020-06-12T02:39:22.527 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.527 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 657 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.528 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.529 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.529 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.529 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:22.529 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.529 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.193371+0000", 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00072257799999999998 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.530 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.531 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.531 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194094+0000", 2020-06-12T02:39:22.531 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.2179999999999996e-06 2020-06-12T02:39:22.531 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.531 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.532 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.532 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194100+0000", 2020-06-12T02:39:22.532 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.6209999999999999e-06 2020-06-12T02:39:22.532 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.533 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.533 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.533 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194109+0000", 2020-06-12T02:39:22.533 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1900000000000003e-06 2020-06-12T02:39:22.533 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.534 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.534 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.534 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194115+0000", 2020-06-12T02:39:22.534 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8803e-05 2020-06-12T02:39:22.534 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.535 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.535 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.535 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194163+0000", 2020-06-12T02:39:22.535 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000112861 2020-06-12T02:39:22.535 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.194276+0000", 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024308049999999999 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.536 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.537 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.537 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.196707+0000", 2020-06-12T02:39:22.537 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0049282320000000003 2020-06-12T02:39:22.537 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.537 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201635+0000", 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00014222200000000001 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.538 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.539 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201777+0000", 2020-06-12T02:39:22.539 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00086831099999999997 2020-06-12T02:39:22.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.539 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.539 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202646+0000", 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0092748410000000007 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.541 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.541 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:658 1.es0 1:7b0a0fa9:::smithi14213939-22:head [write 1769539~409023] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:22.541 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:22.541 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.26129553199999, 2020-06-12T02:39:22.541 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992, 2020-06-12T02:39:22.542 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.542 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.542 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.543 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.543 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 658 2020-06-12T02:39:22.543 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.543 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.543 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.544 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.544 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:22.544 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.546 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.546 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.546 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.201657+0000", 2020-06-12T02:39:22.546 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00063147099999999999 2020-06-12T02:39:22.546 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.547 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.547 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.547 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202289+0000", 2020-06-12T02:39:22.547 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1046000000000001e-05 2020-06-12T02:39:22.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202300+0000", 2020-06-12T02:39:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2309e-05 2020-06-12T02:39:22.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202312+0000", 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4610000000000002e-06 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.549 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.550 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.550 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202320+0000", 2020-06-12T02:39:22.550 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00040874999999999999 2020-06-12T02:39:22.550 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.550 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.551 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.551 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202728+0000", 2020-06-12T02:39:22.551 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013494900000000001 2020-06-12T02:39:22.551 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.551 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.202863+0000", 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0030595930000000002 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.552 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.553 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.205923+0000", 2020-06-12T02:39:22.553 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001437867 2020-06-12T02:39:22.553 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.554 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.554 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.554 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.207361+0000", 2020-06-12T02:39:22.554 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0031561879999999999 2020-06-12T02:39:22.554 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210517+0000", 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6125999999999996e-05 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.555 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210593+0000", 2020-06-12T02:39:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0089357599999999992 2020-06-12T02:39:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.556 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:660 1.es0 1:7b0a0fa9:::smithi14213939-22:head [setxattr _header (57) in=7b,truncate 3747928] snapc 25=[25,24,23,21,1e,1d,16,13] ondisk+write+known_if_redirected e57)", 2020-06-12T02:39:22.557 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.254266288, 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256, 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.558 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.559 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.559 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 660 2020-06-12T02:39:22.559 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.559 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.559 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.560 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208686+0000", 2020-06-12T02:39:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1113999999999997e-05 2020-06-12T02:39:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208758+0000", 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8349999999999998e-06 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.562 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208764+0000", 2020-06-12T02:39:22.563 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1294999999999999e-05 2020-06-12T02:39:22.563 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.563 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.564 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.564 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208776+0000", 2020-06-12T02:39:22.564 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.8949999999999997e-06 2020-06-12T02:39:22.564 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.564 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208781+0000", 2020-06-12T02:39:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012459960000000001 2020-06-12T02:39:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210027+0000", 2020-06-12T02:39:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.8255e-05 2020-06-12T02:39:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.210125+0000", 2020-06-12T02:39:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0039632110000000003 2020-06-12T02:39:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.569 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.569 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.214088+0000", 2020-06-12T02:39:22.569 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003864438 2020-06-12T02:39:22.569 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.570 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.570 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.570 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.217953+0000", 2020-06-12T02:39:22.570 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.002720517 2020-06-12T02:39:22.570 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.571 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.571 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.571 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220673+0000", 2020-06-12T02:39:22.571 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0001237 2020-06-12T02:39:22.572 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.572 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.572 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.572 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.220797+0000", 2020-06-12T02:39:22.572 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012110256 2020-06-12T02:39:22.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.573 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.573 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.573 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.573 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.574 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:661 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e57)", 2020-06-12T02:39:22.574 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:22.574 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 198.254128837, 2020-06-12T02:39:22.574 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437, 2020-06-12T02:39:22.574 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.575 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.575 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.575 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 661 2020-06-12T02:39:22.576 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.576 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.576 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.576 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.576 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:22.577 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.577 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.577 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.577 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.578 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208824+0000", 2020-06-12T02:39:22.578 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.8109999999999999e-05 2020-06-12T02:39:22.578 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.579 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.579 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.579 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208862+0000", 2020-06-12T02:39:22.579 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.515e-06 2020-06-12T02:39:22.580 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.580 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.580 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.580 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208870+0000", 2020-06-12T02:39:22.581 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1133e-05 2020-06-12T02:39:22.581 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.581 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.581 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.582 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208881+0000", 2020-06-12T02:39:22.582 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0210000000000001e-06 2020-06-12T02:39:22.582 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.582 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.208885+0000", 2020-06-12T02:39:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021842860000000001 2020-06-12T02:39:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.584 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.584 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.584 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211069+0000", 2020-06-12T02:39:22.584 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6969000000000001e-05 2020-06-12T02:39:22.585 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.585 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.585 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:22.585 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.211146+0000", 2020-06-12T02:39:22.585 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010107263999999999 2020-06-12T02:39:22.586 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.586 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.586 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.587 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221253+0000", 2020-06-12T02:39:22.587 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.6966999999999996e-05 2020-06-12T02:39:22.587 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.587 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.588 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.588 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.221340+0000", 2020-06-12T02:39:22.588 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001948172 2020-06-12T02:39:22.588 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.588 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.589 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.589 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:04.223288+0000", 2020-06-12T02:39:22.589 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.014464437 2020-06-12T02:39:22.589 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.589 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.590 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.595 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.596 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:723 1.es0 1:7e821f7f:::smithi14213939-44:head [rollback 26] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:22.596 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:22.596 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 193.45334109800001, 2020-06-12T02:39:22.596 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496, 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.597 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 723 2020-06-12T02:39:22.598 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.598 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.598 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.599 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.599 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:22.599 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.599 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.599 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.600 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.600 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009612+0000", 2020-06-12T02:39:22.600 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.1588000000000001e-05 2020-06-12T02:39:22.600 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.600 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.601 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.601 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009663+0000", 2020-06-12T02:39:22.601 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0193e-05 2020-06-12T02:39:22.601 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.601 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.602 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.602 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009673+0000", 2020-06-12T02:39:22.602 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.7849000000000001e-05 2020-06-12T02:39:22.602 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.602 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.603 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.603 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009691+0000", 2020-06-12T02:39:22.603 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8859999999999998e-06 2020-06-12T02:39:22.603 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.604 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.604 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.604 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009698+0000", 2020-06-12T02:39:22.604 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7556000000000002e-05 2020-06-12T02:39:22.604 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.605 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.606 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.606 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009766+0000", 2020-06-12T02:39:22.606 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4888e-05 2020-06-12T02:39:22.607 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.607 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.608 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "op must wait for map", 2020-06-12T02:39:22.608 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009781+0000", 2020-06-12T02:39:22.608 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00237412 2020-06-12T02:39:22.608 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.609 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.609 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.609 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012155+0000", 2020-06-12T02:39:22.609 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000144807 2020-06-12T02:39:22.609 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.610 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.610 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.610 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.012300+0000", 2020-06-12T02:39:22.610 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001423428 2020-06-12T02:39:22.611 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.611 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.611 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.611 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.013723+0000", 2020-06-12T02:39:22.611 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0034184720000000001 2020-06-12T02:39:22.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.612 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.612 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.612 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017141+0000", 2020-06-12T02:39:22.613 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0043232569999999996 2020-06-12T02:39:22.613 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.613 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.613 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.613 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021465+0000", 2020-06-12T02:39:22.614 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.6452000000000001e-05 2020-06-12T02:39:22.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.614 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.614 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.614 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021521+0000", 2020-06-12T02:39:22.615 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011909496 2020-06-12T02:39:22.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.615 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.616 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.616 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.616 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:724 1.es0 1:7e821f7f:::smithi14213939-44:head [append 0~0] snapc 29=[26,25,24,23,1e,1d,16] ondisk+write+known_if_redirected e62)", 2020-06-12T02:39:22.616 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:22.617 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 193.45319448399999, 2020-06-12T02:39:22.617 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001, 2020-06-12T02:39:22.617 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.617 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.617 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.618 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.618 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 724 2020-06-12T02:39:22.619 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.619 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.619 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.620 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.620 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:22.620 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.621 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.621 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.621 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.621 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009758+0000", 2020-06-12T02:39:22.621 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.7926e-05 2020-06-12T02:39:22.622 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.622 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.622 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.622 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009826+0000", 2020-06-12T02:39:22.622 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.7350000000000008e-06 2020-06-12T02:39:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009836+0000", 2020-06-12T02:39:22.624 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5054e-05 2020-06-12T02:39:22.624 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.624 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.624 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.625 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009851+0000", 2020-06-12T02:39:22.625 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.9990000000000002e-06 2020-06-12T02:39:22.625 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.625 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.625 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.626 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009858+0000", 2020-06-12T02:39:22.626 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.3139000000000007e-05 2020-06-12T02:39:22.626 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.626 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.626 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.627 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009921+0000", 2020-06-12T02:39:22.627 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.328e-06 2020-06-12T02:39:22.627 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.627 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.628 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting_for_map not empty", 2020-06-12T02:39:22.628 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.009928+0000", 2020-06-12T02:39:22.628 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0045777470000000001 2020-06-12T02:39:22.628 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.629 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.629 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.629 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014506+0000", 2020-06-12T02:39:22.629 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000141779 2020-06-12T02:39:22.629 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.630 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.630 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.630 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.014648+0000", 2020-06-12T02:39:22.630 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00054088300000000003 2020-06-12T02:39:22.630 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.631 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.631 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.631 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.015189+0000", 2020-06-12T02:39:22.631 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0019558850000000001 2020-06-12T02:39:22.631 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.632 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.632 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.632 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.017145+0000", 2020-06-12T02:39:22.632 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.004474675 2020-06-12T02:39:22.632 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.633 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.633 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.633 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021619+0000", 2020-06-12T02:39:22.633 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.4041000000000004e-05 2020-06-12T02:39:22.633 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.634 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.634 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.634 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:09.021703+0000", 2020-06-12T02:39:22.634 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011945191000000001 2020-06-12T02:39:22.634 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.635 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.635 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.635 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.635 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.636 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:774 1.es0 1:7b491eff:::smithi14213939-42:head [write 467261~717275] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:22.637 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:22.637 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.49718161000001, 2020-06-12T02:39:22.637 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927, 2020-06-12T02:39:22.637 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.638 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.638 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.638 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.638 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.638 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 774 2020-06-12T02:39:22.639 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.639 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.639 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.639 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.639 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:22.640 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.640 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.640 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.641 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.965771+0000", 2020-06-12T02:39:22.641 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0013433830000000001 2020-06-12T02:39:22.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.641 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.641 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.642 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967115+0000", 2020-06-12T02:39:22.642 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.9728000000000002e-05 2020-06-12T02:39:22.642 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.642 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.642 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.643 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967134+0000", 2020-06-12T02:39:22.643 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.8232e-05 2020-06-12T02:39:22.643 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.643 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.644 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.644 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967163+0000", 2020-06-12T02:39:22.644 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2595999999999999e-05 2020-06-12T02:39:22.644 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.644 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.645 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.645 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967175+0000", 2020-06-12T02:39:22.646 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.5049000000000006e-05 2020-06-12T02:39:22.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.646 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.647 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.647 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967250+0000", 2020-06-12T02:39:22.647 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00016066400000000001 2020-06-12T02:39:22.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.648 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.648 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.648 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.967411+0000", 2020-06-12T02:39:22.649 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.003150272 2020-06-12T02:39:22.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.649 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.649 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.650 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.970561+0000", 2020-06-12T02:39:22.650 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0042516819999999997 2020-06-12T02:39:22.650 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.650 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.651 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.651 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974813+0000", 2020-06-12T02:39:22.651 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0024368089999999999 2020-06-12T02:39:22.651 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.651 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977250+0000", 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00013085500000000001 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.652 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.653 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.977380+0000", 2020-06-12T02:39:22.653 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.01160927 2020-06-12T02:39:22.653 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.653 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.654 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:775 1.es0 1:7b491eff:::smithi14213939-42:head [write 1847991~219270] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:22.655 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:22.655 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.49145009700001, 2020-06-12T02:39:22.655 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001, 2020-06-12T02:39:22.655 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.656 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.656 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.656 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.656 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.656 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 775 2020-06-12T02:39:22.657 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.657 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.657 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.657 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.657 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:22.658 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.658 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.658 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.658 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.658 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971503+0000", 2020-06-12T02:39:22.659 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00043692399999999999 2020-06-12T02:39:22.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.659 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.659 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.659 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971940+0000", 2020-06-12T02:39:22.660 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8199999999999999e-06 2020-06-12T02:39:22.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.660 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.660 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.660 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971946+0000", 2020-06-12T02:39:22.661 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.0339999999999999e-05 2020-06-12T02:39:22.661 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.661 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.661 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.661 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971957+0000", 2020-06-12T02:39:22.662 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.7849999999999997e-06 2020-06-12T02:39:22.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.662 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.662 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.663 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971963+0000", 2020-06-12T02:39:22.663 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012742160000000001 2020-06-12T02:39:22.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.663 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.663 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.664 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973237+0000", 2020-06-12T02:39:22.664 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000165515 2020-06-12T02:39:22.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.664 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.665 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.665 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.973402+0000", 2020-06-12T02:39:22.665 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012144646 2020-06-12T02:39:22.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.665 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.666 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.666 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.985547+0000", 2020-06-12T02:39:22.666 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0032757350000000001 2020-06-12T02:39:22.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.667 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.667 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.667 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.988823+0000", 2020-06-12T02:39:22.667 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012580009999999999 2020-06-12T02:39:22.667 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990081+0000", 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000138221 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.668 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.669 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.669 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.990219+0000", 2020-06-12T02:39:22.670 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.018716203000000001 2020-06-12T02:39:22.670 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.671 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.671 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.671 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.671 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:776 1.es0 1:7b491eff:::smithi14213939-42:head [setxattr _header (57) in=7b,truncate 2067261] snapc 30=[30,2b,25,24,23,1e,16] ondisk+write+known_if_redirected e68)", 2020-06-12T02:39:22.672 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:22.672 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.49095658100001, 2020-06-12T02:39:22.672 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999, 2020-06-12T02:39:22.672 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "commit sent; apply or cleanup", 2020-06-12T02:39:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.673 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 776 2020-06-12T02:39:22.674 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.674 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.674 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.674 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.674 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:22.675 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.675 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.675 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.675 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.675 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.971996+0000", 2020-06-12T02:39:22.676 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.2515000000000001e-05 2020-06-12T02:39:22.676 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.676 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.676 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.676 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972049+0000", 2020-06-12T02:39:22.677 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.5090000000000004e-06 2020-06-12T02:39:22.677 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.677 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.677 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.677 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972053+0000", 2020-06-12T02:39:22.678 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8839999999999997e-06 2020-06-12T02:39:22.678 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.678 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.678 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.678 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972060+0000", 2020-06-12T02:39:22.679 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.437e-06 2020-06-12T02:39:22.679 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.679 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.679 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.680 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972065+0000", 2020-06-12T02:39:22.680 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0021308 2020-06-12T02:39:22.680 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.680 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.680 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.681 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974195+0000", 2020-06-12T02:39:22.681 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000131264 2020-06-12T02:39:22.681 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.682 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.682 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.682 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974327+0000", 2020-06-12T02:39:22.682 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.013386011999999999 2020-06-12T02:39:22.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.683 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.683 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.683 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.987713+0000", 2020-06-12T02:39:22.683 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001720776 2020-06-12T02:39:22.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.684 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.684 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.684 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.989433+0000", 2020-06-12T02:39:22.685 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0050702309999999997 2020-06-12T02:39:22.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.685 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.685 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "commit_sent", 2020-06-12T02:39:22.686 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994504+0000", 2020-06-12T02:39:22.686 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00011697999999999999 2020-06-12T02:39:22.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.687 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.687 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.687 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.994621+0000", 2020-06-12T02:39:22.687 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.022624407999999999 2020-06-12T02:39:22.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.688 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.688 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.688 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.689 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.689 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:777 1.es0 1:7b491eff:::smithi14213939-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e68)", 2020-06-12T02:39:22.689 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:22.689 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.490862574, 2020-06-12T02:39:22.690 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001, 2020-06-12T02:39:22.691 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.691 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.691 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.692 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.692 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 777 2020-06-12T02:39:22.692 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.693 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.693 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.693 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.693 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:22.694 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.694 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.694 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.695 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.695 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972090+0000", 2020-06-12T02:39:22.695 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7934999999999999e-05 2020-06-12T02:39:22.695 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.696 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.697 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.697 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972118+0000", 2020-06-12T02:39:22.697 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.0300000000000004e-06 2020-06-12T02:39:22.697 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.698 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.698 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.698 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972122+0000", 2020-06-12T02:39:22.699 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.4499999999999998e-06 2020-06-12T02:39:22.699 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.699 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.699 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.700 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972130+0000", 2020-06-12T02:39:22.700 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.6800000000000002e-06 2020-06-12T02:39:22.700 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.700 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.701 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.701 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.972132+0000", 2020-06-12T02:39:22.701 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0025488310000000001 2020-06-12T02:39:22.702 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.702 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.702 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.702 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974681+0000", 2020-06-12T02:39:22.703 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000121249 2020-06-12T02:39:22.703 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.703 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.703 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "waiting for rw locks", 2020-06-12T02:39:22.704 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.974802+0000", 2020-06-12T02:39:22.704 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.020477826000000001 2020-06-12T02:39:22.704 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.704 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.705 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.705 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995280+0000", 2020-06-12T02:39:22.705 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.9695000000000002e-05 2020-06-12T02:39:22.705 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.706 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.706 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.706 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.995360+0000", 2020-06-12T02:39:22.706 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0033305629999999999 2020-06-12T02:39:22.707 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.707 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.707 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.707 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:14.998690+0000", 2020-06-12T02:39:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.026600259000000001 2020-06-12T02:39:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.709 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.709 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.709 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "MOSDECSubOpWrite(1.8s2 68/51 ECSubWrite(tid=393, reqid=client.4555.0:796, at_version=68'43, trim_to=0'0, roll_forward_to=65'42))", 2020-06-12T02:39:22.709 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:22.710 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 187.452701545, 2020-06-12T02:39:22.710 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993, 2020-06-12T02:39:22.710 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.710 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "reached pg", 2020-06-12T02:39:22.711 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.711 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.711 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.711 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:22.712 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.712 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.712 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.712 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.713 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.010251+0000", 2020-06-12T02:39:22.713 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0012601789999999999 2020-06-12T02:39:22.713 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.713 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.714 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.714 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011511+0000", 2020-06-12T02:39:22.714 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4533e-05 2020-06-12T02:39:22.714 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.715 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.715 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.715 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011536+0000", 2020-06-12T02:39:22.716 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5637e-05 2020-06-12T02:39:22.716 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.716 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.716 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.716 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011552+0000", 2020-06-12T02:39:22.717 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3069999999999997e-06 2020-06-12T02:39:22.717 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.717 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.717 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.717 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011559+0000", 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3882999999999997e-05 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011633+0000", 2020-06-12T02:39:22.718 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.1005999999999998e-05 2020-06-12T02:39:22.719 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.719 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.719 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_started", 2020-06-12T02:39:22.719 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.011654+0000", 2020-06-12T02:39:22.719 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0082588680000000008 2020-06-12T02:39:22.720 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.720 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.720 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "sub_op_committed", 2020-06-12T02:39:22.720 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019913+0000", 2020-06-12T02:39:22.720 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 4.6235e-05 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:15.019959+0000", 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0097076479999999993 2020-06-12T02:39:22.721 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.722 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.722 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.722 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.722 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.722 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:965 1.es0 1:7b0a0fa9:::smithi14213939-22:head [read 0~3747928,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.41190455200001, 2020-06-12T02:39:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168, 2020-06-12T02:39:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.724 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.724 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.724 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.724 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 965 2020-06-12T02:39:22.724 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.725 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.725 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.725 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.725 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.726 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051048+0000", 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000119429 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051168+0000", 2020-06-12T02:39:22.727 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.4109e-05 2020-06-12T02:39:22.728 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.728 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.728 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.728 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051182+0000", 2020-06-12T02:39:22.728 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.4901000000000001e-05 2020-06-12T02:39:22.729 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.729 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.729 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.729 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051207+0000", 2020-06-12T02:39:22.729 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.2519e-05 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051219+0000", 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.9046000000000001e-05 2020-06-12T02:39:22.730 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.731 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.731 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.731 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051308+0000", 2020-06-12T02:39:22.731 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00021562099999999999 2020-06-12T02:39:22.731 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051524+0000", 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0098135429999999992 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.732 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.061337+0000", 2020-06-12T02:39:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010289168 2020-06-12T02:39:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.733 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.734 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.734 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.734 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.734 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:966 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:22.734 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.41166248600001, 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514, 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.735 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.736 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.736 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 966 2020-06-12T02:39:22.736 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.736 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.736 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.737 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.738 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051290+0000", 2020-06-12T02:39:22.738 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.1188999999999999e-05 2020-06-12T02:39:22.738 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.738 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.739 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.739 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051361+0000", 2020-06-12T02:39:22.739 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.1687e-05 2020-06-12T02:39:22.739 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.739 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051373+0000", 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 3.6594000000000002e-05 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.740 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.741 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051410+0000", 2020-06-12T02:39:22.741 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 9.3819999999999993e-06 2020-06-12T02:39:22.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.741 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.742 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.742 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051419+0000", 2020-06-12T02:39:22.742 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00078715999999999996 2020-06-12T02:39:22.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.742 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.743 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.743 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052206+0000", 2020-06-12T02:39:22.743 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000127496 2020-06-12T02:39:22.743 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.743 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.744 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.744 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.052334+0000", 2020-06-12T02:39:22.744 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.011770006 2020-06-12T02:39:22.744 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.744 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.064104+0000", 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.012813514 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.745 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.746 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.746 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.747 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] ondisk+read+known_if_redirected e74)", 2020-06-12T02:39:22.747 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:22.747 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.411452795, 2020-06-12T02:39:22.747 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001, 2020-06-12T02:39:22.748 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.748 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.748 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.749 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:22.749 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.749 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.749 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.749 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.750 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051500+0000", 2020-06-12T02:39:22.751 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.3654999999999999e-05 2020-06-12T02:39:22.751 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.751 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.751 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.751 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051574+0000", 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.6580000000000002e-06 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051581+0000", 2020-06-12T02:39:22.752 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.7506000000000001e-05 2020-06-12T02:39:22.753 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.753 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.753 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.753 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051609+0000", 2020-06-12T02:39:22.753 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.8900000000000001e-06 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.051616+0000", 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0041024939999999999 2020-06-12T02:39:22.754 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055718+0000", 2020-06-12T02:39:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00017127599999999999 2020-06-12T02:39:22.755 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.055889+0000", 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.010664206000000001 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.756 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.757 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.757 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.066554+0000", 2020-06-12T02:39:22.757 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.015053685000000001 2020-06-12T02:39:22.757 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.757 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.758 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.758 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.758 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:967 1.es0 1:7b0a0fa9:::smithi14213939-22:head [sparse-read 0~3747928] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e74)", 2020-06-12T02:39:22.758 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:22.759 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 181.395918634, 2020-06-12T02:39:22.759 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005, 2020-06-12T02:39:22.759 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.759 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.759 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.760 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.761 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 967 2020-06-12T02:39:22.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.761 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.761 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.761 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.762 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067034+0000", 2020-06-12T02:39:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 5.5912000000000003e-05 2020-06-12T02:39:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067090+0000", 2020-06-12T02:39:22.764 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.3224000000000001e-05 2020-06-12T02:39:22.764 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.764 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.764 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.764 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067103+0000", 2020-06-12T02:39:22.765 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.5339999999999999e-05 2020-06-12T02:39:22.765 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.765 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.765 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.765 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067119+0000", 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 6.127e-06 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.067125+0000", 2020-06-12T02:39:22.766 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00095653899999999996 2020-06-12T02:39:22.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.767 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.767 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.767 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068081+0000", 2020-06-12T02:39:22.767 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.00012686500000000001 2020-06-12T02:39:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.068208+0000", 2020-06-12T02:39:22.768 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0083597529999999993 2020-06-12T02:39:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:21.076568+0000", 2020-06-12T02:39:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095337600000000005 2020-06-12T02:39:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.770 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: "description": "osd_op(client.4555.0:1039 1.es0 1:7b491eff:::smithi14213939-42:head [sparse-read 0~2067261] snapc 0=[] ondisk+read+known_if_redirected e83)", 2020-06-12T02:39:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: "initiated_at": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:22.771 INFO:teuthology.orchestra.run.smithi117.stdout: "age": 172.4978586, 2020-06-12T02:39:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992, 2020-06-12T02:39:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: "type_data": { 2020-06-12T02:39:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: "flag_point": "started", 2020-06-12T02:39:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: "client_info": { 2020-06-12T02:39:22.772 INFO:teuthology.orchestra.run.smithi117.stdout: "client": "client.4555", 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: "client_addr": "172.21.15.142:0/2112885608", 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: "tid": 1039 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: "events": [ 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.773 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "initiated", 2020-06-12T02:39:22.774 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:22.774 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0 2020-06-12T02:39:22.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.774 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.774 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "throttled", 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965094+0000", 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 7.0819000000000001e-05 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "header_read", 2020-06-12T02:39:22.775 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965165+0000", 2020-06-12T02:39:22.776 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 1.151e-05 2020-06-12T02:39:22.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.776 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.776 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "all_read", 2020-06-12T02:39:22.777 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965176+0000", 2020-06-12T02:39:22.777 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 2.0358000000000001e-05 2020-06-12T02:39:22.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.777 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.777 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "dispatched", 2020-06-12T02:39:22.778 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965197+0000", 2020-06-12T02:39:22.778 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 8.3389999999999993e-06 2020-06-12T02:39:22.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "queued_for_pg", 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.965205+0000", 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.001758173 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.779 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.780 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "reached_pg", 2020-06-12T02:39:22.781 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.966963+0000", 2020-06-12T02:39:22.781 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.000106857 2020-06-12T02:39:22.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.781 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.782 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "started", 2020-06-12T02:39:22.782 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.967070+0000", 2020-06-12T02:39:22.782 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0075360799999999997 2020-06-12T02:39:22.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2020-06-12T02:39:22.782 INFO:teuthology.orchestra.run.smithi117.stdout: { 2020-06-12T02:39:22.783 INFO:teuthology.orchestra.run.smithi117.stdout: "event": "done", 2020-06-12T02:39:22.783 INFO:teuthology.orchestra.run.smithi117.stdout: "time": "2020-06-12T02:36:29.974606+0000", 2020-06-12T02:39:22.783 INFO:teuthology.orchestra.run.smithi117.stdout: "duration": 0.0095121359999999992 2020-06-12T02:39:22.783 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.783 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2020-06-12T02:39:22.784 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2020-06-12T02:39:22.784 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:22.785 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-06-12T02:39:22.786 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:22.781+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:22.787 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-06-12T02:39:22.887 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:22.886+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:22.900 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:22.898+0000 7f08bcfa1700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:22.906 INFO:teuthology.orchestra.run.smithi142.stderr:2020-06-12T02:39:22.906+0000 7f08b759e700 -1 WARNING: all dangerous and experimental features are enabled. 2020-06-12T02:39:22.941 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0: {} 2020-06-12T02:39:22.947 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2020-06-12T02:39:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: "ops": [], 2020-06-12T02:39:22.947 INFO:teuthology.orchestra.run.smithi117.stdout: "num_ops": 0 2020-06-12T02:39:22.948 INFO:teuthology.orchestra.run.smithi117.stdout:} 2020-06-12T02:39:22.957 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-06-12T02:39:22.961 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1: {} 2020-06-12T02:39:22.983 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3: {} 2020-06-12T02:39:23.004 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:23.001+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:23.008 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4: {} 2020-06-12T02:39:23.032 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5: {} 2020-06-12T02:39:23.055 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6: {} 2020-06-12T02:39:23.064 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.064 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.073 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-06-12T02:39:23.079 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7: {} 2020-06-12T02:39:23.080 INFO:teuthology.orchestra.run.smithi142.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.080 INFO:teuthology.orchestra.run.smithi142.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.080 INFO:teuthology.orchestra.run.smithi142.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-06-12T02:39:23.080 INFO:teuthology.orchestra.run.smithi142.stderr:osd.2: problem getting command descriptions from osd.2 2020-06-12T02:39:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.081 INFO:teuthology.orchestra.run.smithi142.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-06-12T02:39:23.083 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-06-12T02:39:23.084 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-06-12T02:39:23.115 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:23.113+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:23.183 INFO:teuthology.orchestra.run.smithi142.stderr:noscrub is set 2020-06-12T02:39:23.196 INFO:tasks.ceph.osd.3.smithi142.stderr:2020-06-12T02:39:23.194+0000 7f9246da6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12033) UID: 0 2020-06-12T02:39:23.223 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.223 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.232 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-06-12T02:39:23.298 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:23.293+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:23.339 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.340 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.349 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-06-12T02:39:23.399 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:23.397+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:23.499 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.500 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.500 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:23.497+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:23.509 INFO:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-06-12T02:39:23.601 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:23.597+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:23.663 INFO:teuthology.orchestra.run.smithi117.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.663 INFO:teuthology.orchestra.run.smithi117.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.672 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-06-12T02:39:23.722 INFO:tasks.ceph.osd.0.smithi142.stderr:2020-06-12T02:39:23.722+0000 7f1436655700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12027) UID: 0 2020-06-12T02:39:23.790 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.791 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.799 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-06-12T02:39:23.811 INFO:tasks.ceph.osd.4.smithi117.stderr:2020-06-12T02:39:23.809+0000 7fbcafcc7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12008) UID: 0 2020-06-12T02:39:23.911 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:23.909+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:23.952 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:23.953 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:23.963 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-06-12T02:39:24.013 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:24.010+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:24.067 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:24.068 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:24.077 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-06-12T02:39:24.113 INFO:tasks.ceph.osd.7.smithi117.stderr:2020-06-12T02:39:24.109+0000 7fc424b5e700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12016) UID: 0 2020-06-12T02:39:24.214 INFO:tasks.ceph.osd.5.smithi117.stderr:2020-06-12T02:39:24.213+0000 7f026bfde700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12012) UID: 0 2020-06-12T02:39:24.235 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:24.235 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:24.240 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-06-12T02:39:24.315 INFO:tasks.ceph.osd.1.smithi142.stderr:2020-06-12T02:39:24.314+0000 7fcd650ad700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12030) UID: 0 2020-06-12T02:39:24.362 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2020-06-12T02:39:24.362 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-06-12T02:39:24.363 INFO:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-06-12T02:39:24.373 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-06-12T02:39:24.374 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2020-06-12T02:39:24.375 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2020-06-12T02:39:24.376 DEBUG:teuthology.task.console_log:Killing console logger for smithi142 2020-06-12T02:39:24.376 DEBUG:teuthology.task.console_log:Killing console logger for smithi117 2020-06-12T02:39:24.376 DEBUG:teuthology.exit:Finished running handlers